-- Logs begin at Fri 2022-08-05 01:09:00 UTC, end at Fri 2022-08-05 03:04:54 UTC. -- Aug 05 02:28:38.309342 dv-cinder-815582-13-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 05 02:28:38.321725 dv-cinder-815582-13-smb devstack@keystone.service[80811]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 05 02:28:38.323740 dv-cinder-815582-13-smb devstack@keystone.service[80811]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 5 02:28:38 2022] *** Aug 05 02:28:38.323740 dv-cinder-815582-13-smb devstack@keystone.service[80811]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 05 02:28:38.323740 dv-cinder-815582-13-smb devstack@keystone.service[80811]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 05 02:28:38.323740 dv-cinder-815582-13-smb devstack@keystone.service[80811]: nodename: dv-cinder-815582-13-smb Aug 05 02:28:38.323740 dv-cinder-815582-13-smb devstack@keystone.service[80811]: machine: x86_64 Aug 05 02:28:38.323740 dv-cinder-815582-13-smb devstack@keystone.service[80811]: clock source: unix Aug 05 02:28:38.323740 dv-cinder-815582-13-smb devstack@keystone.service[80811]: pcre jit disabled Aug 05 02:28:38.323740 dv-cinder-815582-13-smb devstack@keystone.service[80811]: detected number of CPU cores: 4 Aug 05 02:28:38.323740 dv-cinder-815582-13-smb devstack@keystone.service[80811]: current working directory: / Aug 05 02:28:38.323740 dv-cinder-815582-13-smb devstack@keystone.service[80811]: detected binary path: /usr/bin/uwsgi-core Aug 05 02:28:38.324398 dv-cinder-815582-13-smb devstack@keystone.service[80811]: your processes number limit is 47680 Aug 05 02:28:38.324398 dv-cinder-815582-13-smb devstack@keystone.service[80811]: your memory page size is 4096 bytes Aug 05 02:28:38.324398 dv-cinder-815582-13-smb devstack@keystone.service[80811]: detected max file descriptor number: 2048 Aug 05 02:28:38.324398 dv-cinder-815582-13-smb devstack@keystone.service[80811]: lock engine: pthread robust mutexes Aug 05 02:28:38.324398 dv-cinder-815582-13-smb devstack@keystone.service[80811]: thunder lock: enabled Aug 05 02:28:38.324398 dv-cinder-815582-13-smb devstack@keystone.service[80811]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 05 02:28:38.324398 dv-cinder-815582-13-smb devstack@keystone.service[80811]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 05 02:28:38.363159 dv-cinder-815582-13-smb devstack@keystone.service[80811]: Python main interpreter initialized at 0x55bad8eb09c0 Aug 05 02:28:38.363159 dv-cinder-815582-13-smb devstack@keystone.service[80811]: python threads support enabled Aug 05 02:28:38.363159 dv-cinder-815582-13-smb devstack@keystone.service[80811]: your server socket listen backlog is limited to 100 connections Aug 05 02:28:38.363159 dv-cinder-815582-13-smb devstack@keystone.service[80811]: your mercy for graceful operations on workers is 90 seconds Aug 05 02:28:38.363474 dv-cinder-815582-13-smb devstack@keystone.service[80811]: mapped 403077 bytes (393 KB) for 2 cores Aug 05 02:28:38.363570 dv-cinder-815582-13-smb devstack@keystone.service[80811]: *** Operational MODE: preforking *** Aug 05 02:28:38.363838 dv-cinder-815582-13-smb devstack@keystone.service[80811]: *** uWSGI is running in multiple interpreter mode *** Aug 05 02:28:38.363838 dv-cinder-815582-13-smb devstack@keystone.service[80811]: spawned uWSGI master process (pid: 80811) Aug 05 02:28:38.364030 dv-cinder-815582-13-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 05 02:28:38.365018 dv-cinder-815582-13-smb devstack@keystone.service[80811]: spawned uWSGI worker 1 (pid: 80822, cores: 1) Aug 05 02:28:38.365018 dv-cinder-815582-13-smb devstack@keystone.service[80811]: spawned uWSGI worker 2 (pid: 80823, cores: 1) Aug 05 02:28:38.365018 dv-cinder-815582-13-smb devstack@keystone.service[80811]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 05 02:28:43.911288 dv-cinder-815582-13-smb devstack@keystone.service[80823]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 02:28:43.911288 dv-cinder-815582-13-smb devstack@keystone.service[80823]: from cryptography.utils import int_from_bytes Aug 05 02:28:43.912083 dv-cinder-815582-13-smb devstack@keystone.service[80823]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 02:28:43.912083 dv-cinder-815582-13-smb devstack@keystone.service[80823]: from cryptography.utils import int_from_bytes Aug 05 02:28:43.915889 dv-cinder-815582-13-smb devstack@keystone.service[80822]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 02:28:43.915889 dv-cinder-815582-13-smb devstack@keystone.service[80822]: from cryptography.utils import int_from_bytes Aug 05 02:28:43.916342 dv-cinder-815582-13-smb devstack@keystone.service[80822]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 02:28:43.916342 dv-cinder-815582-13-smb devstack@keystone.service[80822]: from cryptography.utils import int_from_bytes Aug 05 02:28:43.961958 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 02:28:43.962152 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 02:28:43.962346 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] command line args: [] {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 02:28:43.962616 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 02:28:43.962797 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ================================================================================ {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 02:28:43.963079 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] admin_token = **** {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.963327 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] config_dir = [] {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.963520 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.963705 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] config_source = [] {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.963887 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] debug = True {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.963974 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 02:28:43.964086 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.964350 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 02:28:43.964350 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] command line args: [] {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 02:28:43.964470 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.964631 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 02:28:43.964713 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.964770 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ================================================================================ {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 02:28:43.964891 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.965015 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] admin_token = **** {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.965132 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.965255 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] config_dir = [] {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.965372 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] list_limit = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.965511 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.965647 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] log_config_append = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.965772 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] config_source = [] {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.965890 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.966011 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] debug = True {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.966123 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] log_dir = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.966239 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.966375 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] log_file = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.966486 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.966605 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.966717 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.966833 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.966928 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.967071 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.967190 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.967299 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.967418 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] list_limit = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.967518 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.967620 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] log_config_append = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.967714 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.967819 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.967920 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.968013 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] log_dir = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.968013 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] log_file = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.968199 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.968307 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.968408 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.968509 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.968603 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.968701 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.968794 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.968794 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.968982 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.968982 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.969179 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.969272 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.969366 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.969469 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.969571 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.969673 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.969673 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.969857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.969978 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.970073 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] publish_errors = False {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.970173 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.970273 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.970365 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.970465 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.970560 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.970651 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.970749 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.970842 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.971017 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.971198 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.971311 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] standard_threads = False {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.971505 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.971607 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.971714 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] publish_errors = False {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.971824 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.972015 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.972160 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.972160 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] use_journal = False {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.972351 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.972447 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] use_json = False {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.972567 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.972680 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] use_stderr = False {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.972798 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.972915 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] use_syslog = False {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.973035 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.973153 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.973265 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] standard_threads = False {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.973383 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.973495 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.973612 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.973732 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.973844 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.973955 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.974071 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.974189 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] use_journal = False {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.974189 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] use_json = False {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.974475 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.974589 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] use_stderr = False {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.974728 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.974842 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] use_syslog = False {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.974978 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.975093 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:28:43.975475 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.975592 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.975709 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.975827 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.975939 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.976056 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.976175 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.976287 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.976398 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.976510 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.976620 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.976737 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.976858 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.976975 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.977086 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.977197 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.977307 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.977430 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.977544 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.977656 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.977783 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.977902 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.978015 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.978139 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.978253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.978364 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.978474 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.978592 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.978703 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.978825 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.978943 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.978943 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.978943 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.979287 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.979397 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.979592 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.979747 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.979875 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.980065 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.980315 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.980548 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.980781 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.981028 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.981277 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.981479 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.981595 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.981751 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.981874 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.981987 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.982098 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.982209 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.982427 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.982658 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.982890 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.983144 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.983376 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.983532 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.983655 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.983801 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.983925 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.984073 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.984187 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.984304 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.984422 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.984540 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.984660 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.984772 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.984934 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.985055 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.985167 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.985277 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.985408 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.985518 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.985651 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.985758 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.985896 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.986005 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.986108 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.986209 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.986334 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.986446 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.986571 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.986697 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.986810 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.986924 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.987105 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.987216 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.987327 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.987451 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.987565 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.987678 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.987801 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.987916 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.988037 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.988151 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.988272 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.988393 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.988506 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.988607 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.988706 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.988817 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.988935 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.989056 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.989169 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.989346 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.989462 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.989580 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.989780 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.989905 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.990026 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.990139 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.990274 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.990390 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.990507 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.990631 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.990744 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.990856 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.990985 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.991101 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.991212 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.991336 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.991450 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.991568 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.991687 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.991800 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.991911 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.992534 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.992650 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.992762 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.992873 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.992984 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.993096 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.993219 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.993356 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.993473 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.993585 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.993696 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.993816 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.993935 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.994054 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.994168 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.994287 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.994406 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.994593 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.994710 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.994821 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.994933 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.994933 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.995183 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.995296 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.995421 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.995546 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.995659 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.995771 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.995883 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.995994 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.996106 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.996230 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.996344 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.996457 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.996568 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.996680 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.996798 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.996919 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.997032 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.997150 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.997262 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.997374 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.997487 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.997607 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.997720 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.997832 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.997944 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.998056 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] auth.external = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.998174 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.998296 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.998412 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.998527 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.998641 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.998754 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.998866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.999026 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] auth.password = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.999143 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.999256 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] auth.token = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.999368 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.999480 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.999593 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.999713 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.999827 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:43.999939 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.000051 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.000164 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.000273 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.000386 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.000500 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.000613 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.000725 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.000836 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.000948 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.001068 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] credential.caching = True {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.001181 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.001293 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.001405 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.001518 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.001631 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.001751 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.001894 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.002024 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.002139 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.002252 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.002365 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.002477 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.002591 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.002591 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.002814 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.002927 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.003067 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.003181 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.003305 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.003429 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.003543 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.003657 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.003771 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.003884 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.003996 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.004117 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.004231 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.004344 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.004463 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.004577 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] auth.external = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.004690 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.004811 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.004926 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] federation.caching = True {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.005038 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.005152 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.005264 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.005385 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.005499 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] auth.password = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.005612 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.005731 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] auth.token = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.005846 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.005959 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.006080 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.006194 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.006320 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.006442 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.006572 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.006686 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.006807 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.006922 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.007067 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.007181 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.007293 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.007405 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.007597 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.008348 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] credential.caching = True {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.008466 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] identity.caching = True {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.008584 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.008697 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.008810 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.008933 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.009049 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.009162 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.009275 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.009388 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.009501 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.009623 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.009738 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.009852 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.009852 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.010065 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.010178 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.010300 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.010415 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.010528 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.010641 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.010754 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.010866 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.011005 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.011123 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.011236 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.011349 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.011469 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.011583 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.011705 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.011820 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.011933 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.012046 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.012167 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] federation.caching = True {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.012281 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.012424 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.012541 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.012654 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.012766 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.012879 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.012991 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.013112 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.013234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.013349 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.013462 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.013575 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.013686 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.013807 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.013922 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.014035 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.014148 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.014261 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.014358 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.014477 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.014592 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.014711 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.014826 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.014938 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] identity.caching = True {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.015066 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.015191 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.015308 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.015420 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.015539 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.015652 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.015773 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.015887 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.016000 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.016113 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.016226 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.016340 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.016461 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.016575 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.016688 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.016801 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.016913 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.017033 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.017155 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.017269 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.017383 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.017496 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.017608 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.017721 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.017842 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.017957 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.018071 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.018183 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.018308 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.018423 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.018548 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.018663 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.018775 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.018888 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.019059 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.019176 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.019297 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.019297 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.019512 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.019625 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.019737 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.019849 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.019970 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.020084 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.user = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.020197 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.020310 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.020423 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.020423 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.020643 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.020758 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.020871 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.020992 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.021107 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.021219 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.021340 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.021454 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.021568 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.021568 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.021780 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.021899 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.022024 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.022139 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.022252 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.022365 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.022478 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.022592 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.022713 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.022828 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.022940 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.023070 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.023183 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.023296 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.023420 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.023420 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.023637 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.023750 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.023862 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.023975 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.024096 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.024210 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.024322 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.024441 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.024555 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.024668 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.024792 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.024906 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.025019 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.025121 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.025233 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.025346 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.025466 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.025580 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.025694 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.025807 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.025920 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.026032 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.026153 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.026268 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.026381 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.026493 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.026606 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.026718 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.user = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.026840 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.027006 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.027123 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.027237 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.027350 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.027462 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.027587 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.027702 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.027823 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.027937 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.028050 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.028171 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.028285 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.028398 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.028516 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.028629 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.028741 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] resource.caching = True {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.028863 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.028978 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.029091 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.029204 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.029316 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.029428 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.029549 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.029663 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.029776 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.029889 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.030001 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.030114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.030300 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.030417 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.030530 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.030642 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.030754 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.030867 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.031006 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.031130 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] role.caching = True {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.031244 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.031357 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] role.driver = sql {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.031470 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.031582 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.031703 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.031817 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.031930 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.032043 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.032157 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.032269 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.032394 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.032508 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.032621 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.032621 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.032832 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.032832 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.033053 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.033053 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.033267 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.033380 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.033492 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.033604 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.033725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.033839 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.033952 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.034064 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.034177 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.034177 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.034398 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.034512 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.034626 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.034626 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.034837 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.035001 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.035129 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.035246 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] resource.caching = True {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.035359 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.035472 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.035585 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.035697 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.035818 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.035932 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.036045 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.036158 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.036292 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.036406 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.036562 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.036679 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.036840 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.036955 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.037067 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.037180 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.037302 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.037417 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.037530 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.037643 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] role.caching = True {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.037754 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.037876 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] role.driver = sql {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.037990 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.038103 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.038215 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.038329 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.038442 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.038565 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.038680 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.038793 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.038930 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.039065 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.039180 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.039304 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.039422 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] token.caching = True {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.039535 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.039648 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.039760 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.039874 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.039998 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.040114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.040226 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.040339 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.040453 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.040566 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.040686 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.040801 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.040914 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.041027 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.041141 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.041253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.041253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.041476 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.041588 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.041700 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.041812 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.041925 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.042045 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.042159 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.042271 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.042383 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.042497 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.042609 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.042730 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.042844 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.042975 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.043090 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.043202 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.043314 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.043438 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] database.connection = **** {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.043564 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.043686 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.043800 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.043913 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.044025 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.044137 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.044257 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.044371 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.044483 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.044597 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.044709 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.044821 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.044941 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.045055 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.045168 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.045270 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.045382 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.045494 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.045615 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.045729 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.045841 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] token.caching = True {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.045953 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.046066 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.046178 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.046298 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.046412 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.046524 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.046636 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.046749 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.046861 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.047029 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.047146 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.047259 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.047372 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.047484 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.047596 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.047721 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.047837 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 02:28:44.047950 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.048062 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.048251 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.048489 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.048739 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.048991 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.049223 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.049466 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.049766 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.050031 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] database.connection = **** {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.050277 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.050526 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.050765 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.051032 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.051271 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.051510 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.051746 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.051984 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.052229 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.052465 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.052710 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.052946 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.053196 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.053433 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.053678 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.053910 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.054151 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.054397 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:28:44.055118 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 02:28:44.077717 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.077950 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.078178 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.080110 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.080346 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.080574 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.086558 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.088902 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.116224 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.116454 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.116552 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.116722 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.182092 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.182233 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.231933 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.232170 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.232598 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.232836 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.297536 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.297753 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.302570 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.302570 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.302862 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.302996 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.303078 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.303169 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.303247 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.303322 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.303395 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.303395 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.323953 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.324105 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.324223 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.324308 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.324450 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.324530 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.324670 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.324779 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.324887 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.324970 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.325104 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.325200 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.325317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.325413 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.336503 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.336601 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.349305 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.349482 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.349570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.349719 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.349802 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.349946 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.350037 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.350161 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.350507 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.350645 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.350727 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.350857 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80822) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.350940 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.351093 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80823) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:28:44.368818 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.369028 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 05 02:28:44.369147 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.369357 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 05 02:28:44.369440 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.369562 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 05 02:28:44.369680 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.369829 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.369925 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 05 02:28:44.370089 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.370170 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.370346 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.370426 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.370601 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.370689 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.370855 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.380438 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.380634 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.380717 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.380907 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.380992 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.381173 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.381254 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.381450 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.388307 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:28:44.388448 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80823) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:28:44.393093 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:28:44.393185 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80823) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:28:44.393375 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.393457 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.393654 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.393736 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.393935 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.394016 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.394213 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.394302 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.394470 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.394551 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.394734 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.394815 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.395027 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.395109 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.395296 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.395376 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.395562 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.395640 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.395823 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.395904 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.419446 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.419542 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.420943 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80823) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:28:44.421050 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:28:44.421220 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.421302 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.425867 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80823) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:28:44.425956 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:28:44.426143 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.426224 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.426420 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.426501 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.433695 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80823) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:28:44.433840 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:28:44.433932 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.434119 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.438064 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80823) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:28:44.438301 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:28:44.438382 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.438585 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.438667 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.438866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.438975 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.439183 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.439276 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.439465 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.439546 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.439743 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.439823 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.440015 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.440104 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.440307 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.456132 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.456408 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.456487 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.456685 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.460374 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80823) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:28:44.460658 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:28:44.463593 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.463884 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.464048 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.464176 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.468296 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80823) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:28:44.468595 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:28:44.471557 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80823) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:28:44.471880 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:28:44.474725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.475053 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.475136 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.475593 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.475688 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.475880 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.475962 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.476153 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.476235 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.476953 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.477042 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.477246 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.493702 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80823) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:28:44.493977 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.494059 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:28:44.494242 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.494323 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.494512 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.494593 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.494790 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.501450 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.501766 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.503038 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.503315 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.503407 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.503628 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.506163 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80823) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:28:44.506439 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.506519 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:28:44.506732 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.506821 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.507041 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.507136 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.507320 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.507401 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.507593 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.518865 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80823) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:28:44.519162 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:28:44.519248 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.519440 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.519533 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.519717 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.519797 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.519993 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.520072 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.520267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.520348 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.520539 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.520619 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.520819 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.536294 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80823) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:28:44.536641 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:28:44.539833 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80823) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:28:44.540187 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:28:44.542791 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.543171 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.545262 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.545644 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.546775 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80823) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:28:44.547089 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.547170 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:28:44.547371 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.547455 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.547728 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.553863 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.554240 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.556042 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80823) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:28:44.556476 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:28:44.559021 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.559311 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.559456 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.559594 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.559744 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.559870 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.560038 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.560314 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.567979 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80823) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:28:44.568271 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.568463 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:28:44.568544 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.568766 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.569048 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.575531 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80823) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:28:44.575807 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.576045 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80822) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:28:44.576127 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.576324 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.576417 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.576599 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.576680 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.576867 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.576948 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.577137 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.577225 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.577406 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.577488 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.577694 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.577773 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.577972 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.578053 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.578298 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.578377 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.578558 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.578646 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.578822 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.578902 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.579113 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80823) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.579195 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.579414 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.579685 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80822) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:28:44.613582 dv-cinder-815582-13-smb devstack@keystone.service[80823]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bad8eb09c0 pid: 80823 (default app) Aug 05 02:28:44.614214 dv-cinder-815582-13-smb devstack@keystone.service[80822]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bad8eb09c0 pid: 80822 (default app) Aug 05 02:28:44.616907 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14c2d0-3dd1-42e1-a837-c7367a86c14b None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:44.617746 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14c2d0-3dd1-42e1-a837-c7367a86c14b None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:44.618034 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14c2d0-3dd1-42e1-a837-c7367a86c14b None None] PATH_INFO: `/v3` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:44.622320 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 791 bytes} [Fri Aug 5 02:28:44 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:28:53.287462 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01992c75-fe00-4bd6-b52c-03aef298e48e None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:53.287902 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01992c75-fe00-4bd6-b52c-03aef298e48e None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:53.288036 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01992c75-fe00-4bd6-b52c-03aef298e48e None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:53.293102 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1/2] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:28:53 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:28:53.298235 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d1857-ac66-4e7d-b6e8-9dfa2d464393 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:53.298613 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d1857-ac66-4e7d-b6e8-9dfa2d464393 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:53.298791 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d1857-ac66-4e7d-b6e8-9dfa2d464393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:53.369640 dv-cinder-815582-13-smb devstack@keystone.service[80823]: INFO dbcounter [None req-820d1857-ac66-4e7d-b6e8-9dfa2d464393 None None] Registered counter for database keystone Aug 05 02:28:53.388961 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG oslo_db.sqlalchemy.engines [None req-820d1857-ac66-4e7d-b6e8-9dfa2d464393 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80823) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 02:28:53.395125 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writer thread running {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 02:28:53.579566 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG passlib.handlers.bcrypt [None req-820d1857-ac66-4e7d-b6e8-9dfa2d464393 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80823) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 05 02:28:53.579916 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG passlib.handlers.bcrypt [None req-820d1857-ac66-4e7d-b6e8-9dfa2d464393 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80823) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 05 02:28:53.634562 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-820d1857-ac66-4e7d-b6e8-9dfa2d464393 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:28:53.636228 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-820d1857-ac66-4e7d-b6e8-9dfa2d464393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:28:53.764972 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:28:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 05 02:28:53.907815 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01992c75-fe00-4bd6-b52c-03aef298e48e None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:53.976893 dv-cinder-815582-13-smb devstack@keystone.service[80822]: INFO dbcounter [None req-01992c75-fe00-4bd6-b52c-03aef298e48e None None] Registered counter for database keystone Aug 05 02:28:53.998162 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG oslo_db.sqlalchemy.engines [None req-01992c75-fe00-4bd6-b52c-03aef298e48e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80822) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 02:28:54.004229 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writer thread running {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 02:28:54.123113 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01992c75-fe00-4bd6-b52c-03aef298e48e None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:54.127398 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6108904-8523-4118-85d2-8e2713c736bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:54.128034 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6108904-8523-4118-85d2-8e2713c736bf admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:54.128318 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6108904-8523-4118-85d2-8e2713c736bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:54.128594 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6108904-8523-4118-85d2-8e2713c736bf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:54.136692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6108904-8523-4118-85d2-8e2713c736bf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:54.190929 dv-cinder-815582-13-smb devstack@keystone.service[80822]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f6108904-8523-4118-85d2-8e2713c736bf admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 05 02:28:54.191230 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6108904-8523-4118-85d2-8e2713c736bf admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:54.201391 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1324 bytes} [Fri Aug 5 02:28:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 05 02:28:54.207286 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d1857-ac66-4e7d-b6e8-9dfa2d464393 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:54.221465 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d1857-ac66-4e7d-b6e8-9dfa2d464393 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:54.226082 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992858a2-785e-46fd-a3a2-de92b884a7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:54.227724 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992858a2-785e-46fd-a3a2-de92b884a7da admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:54.228008 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992858a2-785e-46fd-a3a2-de92b884a7da admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:54.228281 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992858a2-785e-46fd-a3a2-de92b884a7da admin admin] PATH_INFO: `/v3/projects/7de4c8b74b3245d8bf8c7d1c57f4237e` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:54.229760 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992858a2-785e-46fd-a3a2-de92b884a7da admin admin] RBAC: Authorizing `identity:get_project(project_id=7de4c8b74b3245d8bf8c7d1c57f4237e)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:54.281431 dv-cinder-815582-13-smb devstack@keystone.service[80823]: WARNING keystone.common.rbac_enforcer.enforcer [None req-992858a2-785e-46fd-a3a2-de92b884a7da admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 05 02:28:54.281775 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992858a2-785e-46fd-a3a2-de92b884a7da admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:54.286534 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 3/5] 10.222.0.42 () {56 vars in 1207 bytes} [Fri Aug 5 02:28:54 2022] GET /identity/v3/projects/7de4c8b74b3245d8bf8c7d1c57f4237e => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:28:56.257071 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4355c-4db0-4cf5-b740-67cdaf4bb543 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:56.257689 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4355c-4db0-4cf5-b740-67cdaf4bb543 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:56.257689 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4355c-4db0-4cf5-b740-67cdaf4bb543 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:56.261746 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 3/6] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:28:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:28:56.267132 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a20f51-70d3-4c03-a901-6d8ffee14d16 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:56.267564 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a20f51-70d3-4c03-a901-6d8ffee14d16 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:56.267696 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a20f51-70d3-4c03-a901-6d8ffee14d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:56.288200 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-e6a20f51-70d3-4c03-a901-6d8ffee14d16 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:28:56.290292 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-e6a20f51-70d3-4c03-a901-6d8ffee14d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:28:56.298217 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:28:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 05 02:28:56.319591 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4355c-4db0-4cf5-b740-67cdaf4bb543 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:56.333546 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4355c-4db0-4cf5-b740-67cdaf4bb543 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:56.338383 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74252782-96c4-4341-9151-f1d0ce303024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:56.339016 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74252782-96c4-4341-9151-f1d0ce303024 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:56.339301 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74252782-96c4-4341-9151-f1d0ce303024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:56.339582 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74252782-96c4-4341-9151-f1d0ce303024 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:56.347112 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74252782-96c4-4341-9151-f1d0ce303024 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:56.348905 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74252782-96c4-4341-9151-f1d0ce303024 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:56.357799 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 4/8] 10.222.0.42 () {58 vars in 1324 bytes} [Fri Aug 5 02:28:56 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 05 02:28:56.363064 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a20f51-70d3-4c03-a901-6d8ffee14d16 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:56.372054 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a20f51-70d3-4c03-a901-6d8ffee14d16 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:56.376635 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432a0c1-a4e0-45b2-8e2e-4f4d5ab08cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:56.377268 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432a0c1-a4e0-45b2-8e2e-4f4d5ab08cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:56.377555 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432a0c1-a4e0-45b2-8e2e-4f4d5ab08cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:56.377834 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432a0c1-a4e0-45b2-8e2e-4f4d5ab08cb5 admin admin] PATH_INFO: `/v3/users/9858bbeee69c4062a3e73bac3fef2908` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:56.379241 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432a0c1-a4e0-45b2-8e2e-4f4d5ab08cb5 admin admin] RBAC: Authorizing `identity:get_user(user_id=9858bbeee69c4062a3e73bac3fef2908)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:56.381081 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432a0c1-a4e0-45b2-8e2e-4f4d5ab08cb5 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:56.383155 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 5/9] 10.222.0.42 () {56 vars in 1198 bytes} [Fri Aug 5 02:28:56 2022] GET /identity/v3/users/9858bbeee69c4062a3e73bac3fef2908 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:28:58.423714 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c5cca-f0e6-481f-be12-ef485a6ee031 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:58.424241 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c5cca-f0e6-481f-be12-ef485a6ee031 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:58.424341 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c5cca-f0e6-481f-be12-ef485a6ee031 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:58.425588 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 5/10] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:28:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:28:58.428863 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ead9a5-f770-413e-9b0f-16752ebd1d23 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:58.429850 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ead9a5-f770-413e-9b0f-16752ebd1d23 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:58.429992 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ead9a5-f770-413e-9b0f-16752ebd1d23 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:58.431192 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fa12a-bcd3-4d32-8aea-db3790bb07e5 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:58.431652 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fa12a-bcd3-4d32-8aea-db3790bb07e5 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:58.431754 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 6/11] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:28:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:28:58.431841 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fa12a-bcd3-4d32-8aea-db3790bb07e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:58.437397 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc706327-5e4e-4e7e-9c71-23190b09b6b6 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:58.437685 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc706327-5e4e-4e7e-9c71-23190b09b6b6 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:58.437968 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc706327-5e4e-4e7e-9c71-23190b09b6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:58.457338 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-fc706327-5e4e-4e7e-9c71-23190b09b6b6 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:28:58.458539 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-fc706327-5e4e-4e7e-9c71-23190b09b6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:28:58.474546 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG passlib.handlers.bcrypt [None req-0f4fa12a-bcd3-4d32-8aea-db3790bb07e5 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80822) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 05 02:28:58.475000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG passlib.handlers.bcrypt [None req-0f4fa12a-bcd3-4d32-8aea-db3790bb07e5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80822) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 05 02:28:58.521236 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-0f4fa12a-bcd3-4d32-8aea-db3790bb07e5 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:28:58.522893 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-0f4fa12a-bcd3-4d32-8aea-db3790bb07e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:28:58.537352 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 7/12] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:28:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:28:58.561177 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc706327-5e4e-4e7e-9c71-23190b09b6b6 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:58.584921 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:28:58.624634 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 6/13] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:28:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:28:58.646243 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fa12a-bcd3-4d32-8aea-db3790bb07e5 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:58.664486 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc706327-5e4e-4e7e-9c71-23190b09b6b6 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:58.696952 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628034fc-dbb6-4756-89c8-81436edfdc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:58.697592 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628034fc-dbb6-4756-89c8-81436edfdc8b None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:58.697872 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628034fc-dbb6-4756-89c8-81436edfdc8b None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:58.698146 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628034fc-dbb6-4756-89c8-81436edfdc8b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:58.709284 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628034fc-dbb6-4756-89c8-81436edfdc8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:28:58.717718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-628034fc-dbb6-4756-89c8-81436edfdc8b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:28:58.717718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:28:58.717718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:28:58.717718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:28:58.717718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:28:58.717718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:28:58.717718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:28:58.717718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:28:58.717718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:28:58.717718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:28:58.717718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:28:58.717718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:28:58.717718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:28:58.717718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:28:58.717718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:28:58.717718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:28:58.718808 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:28:58.718808 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:28:58.718808 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:28:58.718808 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:28:58.718808 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:28:58.718808 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:28:58.718808 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:28:58.718808 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:28:58.718808 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:28:58.718808 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:28:58.718808 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:28:58.718808 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:28:58.718808 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:28:58.718808 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:28:58.718808 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:28:58.718808 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:28:58.719779 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:28:58.719779 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:28:58.719779 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:28:58.719779 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:28:58.719779 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:28:58.719779 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:28:58.719779 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:28:58.719779 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:28:58.719779 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:28:58.719779 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:28:58.719779 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:28:58.719779 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:28:58.719779 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 8/14] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 5 02:28:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:28:58.724842 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628034fc-dbb6-4756-89c8-81436edfdc8b None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:58.745369 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fa12a-bcd3-4d32-8aea-db3790bb07e5 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:58.747658 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:28:58.780834 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f083bb6-0a57-49d1-98af-ba9575ac3f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:58.781653 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f083bb6-0a57-49d1-98af-ba9575ac3f8d None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:58.781946 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f083bb6-0a57-49d1-98af-ba9575ac3f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:58.782233 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f083bb6-0a57-49d1-98af-ba9575ac3f8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:58.806195 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:28:58.824209 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628034fc-dbb6-4756-89c8-81436edfdc8b None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:58.849754 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f083bb6-0a57-49d1-98af-ba9575ac3f8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:58.852134 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f083bb6-0a57-49d1-98af-ba9575ac3f8d None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:58.858217 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150d018-17aa-4a2f-b074-b7fffc312dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:58.858838 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150d018-17aa-4a2f-b074-b7fffc312dbb None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:58.859159 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150d018-17aa-4a2f-b074-b7fffc312dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:58.859440 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150d018-17aa-4a2f-b074-b7fffc312dbb None admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:58.860165 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f150d018-17aa-4a2f-b074-b7fffc312dbb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:28:58.860472 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f150d018-17aa-4a2f-b074-b7fffc312dbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:58.861872 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f150d018-17aa-4a2f-b074-b7fffc312dbb None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:58.873916 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 9/15] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:28:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:28:58.879549 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150d018-17aa-4a2f-b074-b7fffc312dbb None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:58.947035 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 7/16] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:28:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 05 02:28:58.952720 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f083bb6-0a57-49d1-98af-ba9575ac3f8d None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:58.955816 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:28:58.980327 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150d018-17aa-4a2f-b074-b7fffc312dbb None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:59.054048 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f083bb6-0a57-49d1-98af-ba9575ac3f8d None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:59.092101 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb6863-a475-42e4-bf2a-ca4a0b0e7b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:59.092982 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb6863-a475-42e4-bf2a-ca4a0b0e7b7e None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:59.093267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb6863-a475-42e4-bf2a-ca4a0b0e7b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:59.093543 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb6863-a475-42e4-bf2a-ca4a0b0e7b7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:59.112739 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb6863-a475-42e4-bf2a-ca4a0b0e7b7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:59.114217 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb6863-a475-42e4-bf2a-ca4a0b0e7b7e None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:59.119772 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1508a-b451-481a-bc17-582994381e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:59.120413 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1508a-b451-481a-bc17-582994381e0c None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:59.120693 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1508a-b451-481a-bc17-582994381e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:59.120966 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1508a-b451-481a-bc17-582994381e0c None admin] PATH_INFO: `/v3/users/9858bbeee69c4062a3e73bac3fef2908` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:59.122117 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c1508a-b451-481a-bc17-582994381e0c None admin] RBAC: Authorizing `identity:get_user(user_id=9858bbeee69c4062a3e73bac3fef2908)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:59.123584 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c1508a-b451-481a-bc17-582994381e0c None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:59.125357 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 10/17] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:28:58 2022] GET /identity/v3/users/9858bbeee69c4062a3e73bac3fef2908 => generated 247 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:28:59.130667 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1508a-b451-481a-bc17-582994381e0c None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:59.131851 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-afcb6863-a475-42e4-bf2a-ca4a0b0e7b7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:28:59.131851 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:28:59.131851 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:28:59.131851 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:28:59.131851 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:28:59.131851 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:28:59.131851 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:28:59.131851 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:28:59.131851 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:28:59.131851 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:28:59.131851 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:28:59.131851 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:28:59.131851 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:28:59.131851 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:28:59.131851 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:28:59.132803 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:28:59.132803 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:28:59.132803 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:28:59.132803 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:28:59.132803 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:28:59.132803 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:28:59.132803 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:28:59.132803 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:28:59.132803 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:28:59.132803 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:28:59.132803 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:28:59.132803 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:28:59.132803 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:28:59.132803 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:28:59.132803 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:28:59.132803 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:28:59.132803 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:28:59.133631 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:28:59.133631 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:28:59.133631 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:28:59.133631 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:28:59.133631 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 8/18] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:28:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:28:59.138543 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb6863-a475-42e4-bf2a-ca4a0b0e7b7e None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:59.145573 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:28:59.194114 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:28:59.230178 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1508a-b451-481a-bc17-582994381e0c None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:59.238108 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb6863-a475-42e4-bf2a-ca4a0b0e7b7e None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:59.264785 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d35814-d13f-44c5-8677-3d66f2961174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:59.265430 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d35814-d13f-44c5-8677-3d66f2961174 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:59.265714 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d35814-d13f-44c5-8677-3d66f2961174 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:59.265999 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d35814-d13f-44c5-8677-3d66f2961174 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:59.267198 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d35814-d13f-44c5-8677-3d66f2961174 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:59.268782 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d35814-d13f-44c5-8677-3d66f2961174 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:59.270667 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 11/19] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:28:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:28:59.271015 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1082382a-476e-4c98-b0ee-c1c52d8ba208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:59.271827 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082382a-476e-4c98-b0ee-c1c52d8ba208 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:59.271957 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082382a-476e-4c98-b0ee-c1c52d8ba208 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:59.272194 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082382a-476e-4c98-b0ee-c1c52d8ba208 None admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:59.272959 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1082382a-476e-4c98-b0ee-c1c52d8ba208 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:28:59.273834 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1082382a-476e-4c98-b0ee-c1c52d8ba208 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:59.275331 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1082382a-476e-4c98-b0ee-c1c52d8ba208 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:59.276991 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d35814-d13f-44c5-8677-3d66f2961174 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:59.303159 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 9/20] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:28:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:28:59.367939 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:28:59.388046 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d35814-d13f-44c5-8677-3d66f2961174 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:59.424889 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3376da77-04ca-45df-a45c-ac43d16e5ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:59.425538 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376da77-04ca-45df-a45c-ac43d16e5ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:59.425823 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376da77-04ca-45df-a45c-ac43d16e5ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:59.426113 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376da77-04ca-45df-a45c-ac43d16e5ec2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:59.426897 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3376da77-04ca-45df-a45c-ac43d16e5ec2 None admin] RBAC: Adding query filter params (role.id=83afe883a303495b966480fb9b5bb7dd, scope.domain.id=default, user.id=9858bbeee69c4062a3e73bac3fef2908) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:28:59.427245 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3376da77-04ca-45df-a45c-ac43d16e5ec2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:59.428891 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3376da77-04ca-45df-a45c-ac43d16e5ec2 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:59.436499 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 12/21] 10.222.0.42 () {56 vars in 1322 bytes} [Fri Aug 5 02:28:59 2022] GET /identity/v3/role_assignments?user.id=9858bbeee69c4062a3e73bac3fef2908&scope.domain.id=default&role.id=83afe883a303495b966480fb9b5bb7dd => generated 233 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:29:01.632215 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb1b55-a98a-4f14-9da1-5a404a257f46 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:01.633266 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb1b55-a98a-4f14-9da1-5a404a257f46 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:01.633755 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb1b55-a98a-4f14-9da1-5a404a257f46 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:01.635322 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 10/22] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:01.640841 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b256a5-c011-4156-98ba-eb7b42de87e3 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:01.641668 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b256a5-c011-4156-98ba-eb7b42de87e3 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:01.642158 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b256a5-c011-4156-98ba-eb7b42de87e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:01.660821 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-52b256a5-c011-4156-98ba-eb7b42de87e3 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:01.662371 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-52b256a5-c011-4156-98ba-eb7b42de87e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:01.744348 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 13/23] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:29:01.779077 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb1b55-a98a-4f14-9da1-5a404a257f46 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:01.794995 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862276fa-5729-438a-b5cd-34ff1a77c54b None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:01.795593 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862276fa-5729-438a-b5cd-34ff1a77c54b None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:01.796077 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862276fa-5729-438a-b5cd-34ff1a77c54b None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:01.797620 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 14/24] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:29:01.802674 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33191bf7-4217-4651-9426-e1e03c2cfaac None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:01.803224 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33191bf7-4217-4651-9426-e1e03c2cfaac None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:01.803717 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33191bf7-4217-4651-9426-e1e03c2cfaac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:01.837311 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-33191bf7-4217-4651-9426-e1e03c2cfaac None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:01.839026 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-33191bf7-4217-4651-9426-e1e03c2cfaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:01.964287 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 15/25] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:29:01.966444 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69209394-c806-4d09-ba06-e123fc78e135 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:01.966973 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69209394-c806-4d09-ba06-e123fc78e135 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:01.967838 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69209394-c806-4d09-ba06-e123fc78e135 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:01.969386 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 16/26] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:01.978100 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5a97f-3871-4b99-9ef8-0d4299737950 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:01.978608 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5a97f-3871-4b99-9ef8-0d4299737950 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:01.979124 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5a97f-3871-4b99-9ef8-0d4299737950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:01.984530 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb1b55-a98a-4f14-9da1-5a404a257f46 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:01.987260 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:01.999733 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-bee5a97f-3871-4b99-9ef8-0d4299737950 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:02.011717 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-bee5a97f-3871-4b99-9ef8-0d4299737950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:02.020931 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:02.058819 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5a5b8-33c9-45a3-bccb-c7c8deef6543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:02.059528 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5a5b8-33c9-45a3-bccb-c7c8deef6543 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:02.059805 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5a5b8-33c9-45a3-bccb-c7c8deef6543 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:02.060092 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5a5b8-33c9-45a3-bccb-c7c8deef6543 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:02.081694 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 17/27] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:29:02.082980 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5a5b8-33c9-45a3-bccb-c7c8deef6543 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:02.083253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5a97f-3871-4b99-9ef8-0d4299737950 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:02.084481 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5a5b8-33c9-45a3-bccb-c7c8deef6543 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:02.114623 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-9de5a5b8-33c9-45a3-bccb-c7c8deef6543 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:29:02.114623 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:02.114623 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:02.114623 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:02.114623 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:02.114623 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:02.114623 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:02.114623 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:02.114623 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:02.114623 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:02.114623 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:02.114623 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:02.114623 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:29:02.114623 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:29:02.114623 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:29:02.115507 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:29:02.115507 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:02.115507 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:02.115507 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:02.115507 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:02.115507 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:02.115507 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:02.115507 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:02.115507 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:02.115507 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:02.115507 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:02.115507 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:02.115507 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:02.115507 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:02.115507 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:02.115507 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:02.115507 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:02.116814 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:29:02.116814 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:29:02.116814 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:29:02.116814 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:29:02.116814 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 11/28] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:29:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:29:02.122997 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5a5b8-33c9-45a3-bccb-c7c8deef6543 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:02.201986 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5a97f-3871-4b99-9ef8-0d4299737950 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:02.299679 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b51518-19a5-4941-9209-2be6eae145ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:02.300345 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b51518-19a5-4941-9209-2be6eae145ad None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:02.300628 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b51518-19a5-4941-9209-2be6eae145ad None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:02.300904 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b51518-19a5-4941-9209-2be6eae145ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:02.307513 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5a5b8-33c9-45a3-bccb-c7c8deef6543 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:02.311254 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:02.331839 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b51518-19a5-4941-9209-2be6eae145ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:02.337408 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-85b51518-19a5-4941-9209-2be6eae145ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:29:02.337408 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:02.337408 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:02.337408 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:02.337408 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:02.337408 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:02.337408 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:02.337408 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:02.337408 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:02.337408 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:02.337408 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:02.337408 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:02.337408 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:02.337408 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:02.337408 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:02.337408 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:02.338467 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:02.338467 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:02.338467 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:02.338467 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:02.338467 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:02.338467 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:02.338467 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:02.338467 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:02.338467 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:02.338467 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:02.338467 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:02.338467 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:02.338467 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:02.338467 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:02.338467 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:02.338467 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:02.339415 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:02.339415 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:02.339415 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:02.339415 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:02.339415 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:02.339415 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:02.339415 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:02.339415 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:02.339415 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:02.339415 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:02.339415 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:29:02.339415 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:29:02.348959 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 18/29] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 5 02:29:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:29:02.350002 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b51518-19a5-4941-9209-2be6eae145ad None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:02.351828 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5a8c5-6db6-4402-84d1-d6338cea6d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:02.352735 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5a8c5-6db6-4402-84d1-d6338cea6d98 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:02.353209 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5a8c5-6db6-4402-84d1-d6338cea6d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:02.353693 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5a8c5-6db6-4402-84d1-d6338cea6d98 None admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:02.354647 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c5a8c5-6db6-4402-84d1-d6338cea6d98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:02.355194 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c5a8c5-6db6-4402-84d1-d6338cea6d98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:02.356776 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c5a8c5-6db6-4402-84d1-d6338cea6d98 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:02.369528 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 12/30] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:02.370765 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5a8c5-6db6-4402-84d1-d6338cea6d98 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:02.508377 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:02.541179 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b51518-19a5-4941-9209-2be6eae145ad None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:02.583459 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5a8c5-6db6-4402-84d1-d6338cea6d98 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:02.589044 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3114a-b790-4d55-9574-6e3da90aaa60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:02.590064 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3114a-b790-4d55-9574-6e3da90aaa60 None admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:02.590549 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3114a-b790-4d55-9574-6e3da90aaa60 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:02.591050 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3114a-b790-4d55-9574-6e3da90aaa60 None admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:02.592306 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be3114a-b790-4d55-9574-6e3da90aaa60 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:02.595848 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be3114a-b790-4d55-9574-6e3da90aaa60 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:02.623372 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e5610-7695-4ee4-ae73-18600d749da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:02.624089 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e5610-7695-4ee4-ae73-18600d749da9 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:02.624445 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e5610-7695-4ee4-ae73-18600d749da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:02.624794 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e5610-7695-4ee4-ae73-18600d749da9 None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:02.625700 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e5610-7695-4ee4-ae73-18600d749da9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:02.626209 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e5610-7695-4ee4-ae73-18600d749da9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:02.627670 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e5610-7695-4ee4-ae73-18600d749da9 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:02.640949 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 13/31] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:29:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:02.642506 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e5610-7695-4ee4-ae73-18600d749da9 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:02.739682 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:02.750297 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e5610-7695-4ee4-ae73-18600d749da9 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:02.786997 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c725fa4-ba77-4d55-bade-db6b33acc1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:02.787637 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c725fa4-ba77-4d55-bade-db6b33acc1ce None admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:02.787920 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c725fa4-ba77-4d55-bade-db6b33acc1ce None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:02.788197 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c725fa4-ba77-4d55-bade-db6b33acc1ce None admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:02.789126 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c725fa4-ba77-4d55-bade-db6b33acc1ce None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:02.790822 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c725fa4-ba77-4d55-bade-db6b33acc1ce None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:02.832572 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 19/32] 10.222.0.42 () {60 vars in 1131 bytes} [Fri Aug 5 02:29:02 2022] POST /identity/v3/roles => generated 219 bytes in 483 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:29:02.835193 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9258c-7a0d-4061-b501-ca2c38f6628e None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:02.838339 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9258c-7a0d-4061-b501-ca2c38f6628e None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:02.838981 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9258c-7a0d-4061-b501-ca2c38f6628e None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:02.840903 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 20/33] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:02.842068 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9258c-7a0d-4061-b501-ca2c38f6628e None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:02.948969 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:03.032954 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9258c-7a0d-4061-b501-ca2c38f6628e None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:03.040317 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 14/34] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Aug 5 02:29:02 2022] POST /identity/v3/projects => generated 301 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:29:03.042577 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8de885-4aa2-4ccb-b3d3-e666a1790240 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:03.043103 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8de885-4aa2-4ccb-b3d3-e666a1790240 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:03.043579 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8de885-4aa2-4ccb-b3d3-e666a1790240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:03.066725 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-6d8de885-4aa2-4ccb-b3d3-e666a1790240 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:03.069304 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-6d8de885-4aa2-4ccb-b3d3-e666a1790240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:03.107629 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89c7b3-cdda-4e60-a843-7080868cd721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:03.108220 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89c7b3-cdda-4e60-a843-7080868cd721 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:03.108508 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89c7b3-cdda-4e60-a843-7080868cd721 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:03.108794 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89c7b3-cdda-4e60-a843-7080868cd721 None admin] PATH_INFO: `/v3/users/9858bbeee69c4062a3e73bac3fef2908` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:03.115949 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f89c7b3-cdda-4e60-a843-7080868cd721 None admin] RBAC: Authorizing `identity:get_user(user_id=9858bbeee69c4062a3e73bac3fef2908)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:03.118180 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f89c7b3-cdda-4e60-a843-7080868cd721 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:03.119986 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 21/35] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:29:02 2022] GET /identity/v3/users/9858bbeee69c4062a3e73bac3fef2908 => generated 247 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:03.125476 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89c7b3-cdda-4e60-a843-7080868cd721 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:03.152925 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 15/36] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:29:03.155145 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb5774-3096-4ff8-b011-41703bc62eaa None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:03.155662 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb5774-3096-4ff8-b011-41703bc62eaa None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:03.156333 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb5774-3096-4ff8-b011-41703bc62eaa None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:03.158397 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 16/37] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:03.176272 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844e13b-b563-48e8-a4dc-4844ae18aca8 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:03.176901 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844e13b-b563-48e8-a4dc-4844ae18aca8 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:03.177184 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844e13b-b563-48e8-a4dc-4844ae18aca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:03.203184 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-c844e13b-b563-48e8-a4dc-4844ae18aca8 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:03.204564 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-c844e13b-b563-48e8-a4dc-4844ae18aca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:03.303128 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 17/38] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:29:03.303128 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844e13b-b563-48e8-a4dc-4844ae18aca8 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:03.303409 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89c7b3-cdda-4e60-a843-7080868cd721 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:03.303496 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:03.332793 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:03.347492 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e55b07-04cc-46fc-b531-0c231dfac5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:03.348228 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e55b07-04cc-46fc-b531-0c231dfac5fe None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:03.348524 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e55b07-04cc-46fc-b531-0c231dfac5fe None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:03.348813 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e55b07-04cc-46fc-b531-0c231dfac5fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:03.350175 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e55b07-04cc-46fc-b531-0c231dfac5fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:03.352597 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e55b07-04cc-46fc-b531-0c231dfac5fe None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:03.355146 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 22/39] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:29:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:29:03.356295 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7fb55-7946-41af-9952-4cfb1756ef0a None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:03.356878 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7fb55-7946-41af-9952-4cfb1756ef0a None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:03.356878 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7fb55-7946-41af-9952-4cfb1756ef0a None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:03.358278 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 23/40] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:03.358759 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7fb55-7946-41af-9952-4cfb1756ef0a None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:03.408710 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844e13b-b563-48e8-a4dc-4844ae18aca8 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:03.442136 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4311b6-5b55-41c7-bc10-57270d5262b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:03.442757 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4311b6-5b55-41c7-bc10-57270d5262b2 None admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:03.443068 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4311b6-5b55-41c7-bc10-57270d5262b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:03.443346 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4311b6-5b55-41c7-bc10-57270d5262b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:03.444055 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4311b6-5b55-41c7-bc10-57270d5262b2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:03.445587 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4311b6-5b55-41c7-bc10-57270d5262b2 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:03.466907 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7fb55-7946-41af-9952-4cfb1756ef0a None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:03.499952 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582abb88-1780-4455-8778-9d8500c5f60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:03.500579 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582abb88-1780-4455-8778-9d8500c5f60e None admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:03.500883 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582abb88-1780-4455-8778-9d8500c5f60e None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:03.501146 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582abb88-1780-4455-8778-9d8500c5f60e None admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:03.501855 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582abb88-1780-4455-8778-9d8500c5f60e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:03.502538 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 18/41] 10.222.0.42 () {60 vars in 1131 bytes} [Fri Aug 5 02:29:03 2022] POST /identity/v3/roles => generated 225 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:29:03.503286 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582abb88-1780-4455-8778-9d8500c5f60e None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:03.503806 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d051ae-7ab9-46b6-ab0d-1f28290eac30 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:03.504100 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d051ae-7ab9-46b6-ab0d-1f28290eac30 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:03.504381 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d051ae-7ab9-46b6-ab0d-1f28290eac30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:03.533319 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-a6d051ae-7ab9-46b6-ab0d-1f28290eac30 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:03.534571 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-a6d051ae-7ab9-46b6-ab0d-1f28290eac30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:03.612370 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:03.613413 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 24/42] 10.222.0.42 () {60 vars in 1131 bytes} [Fri Aug 5 02:29:03 2022] POST /identity/v3/roles => generated 223 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:29:03.614111 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582abb88-1780-4455-8778-9d8500c5f60e None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:03.641547 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 19/43] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:29:03.668195 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d051ae-7ab9-46b6-ab0d-1f28290eac30 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:03.680586 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:03.740544 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582abb88-1780-4455-8778-9d8500c5f60e None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:03.791191 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969dd649-be65-4ef5-a48f-106b9e3bd814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:03.791890 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969dd649-be65-4ef5-a48f-106b9e3bd814 None admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:03.792177 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969dd649-be65-4ef5-a48f-106b9e3bd814 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:03.792458 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969dd649-be65-4ef5-a48f-106b9e3bd814 None admin] PATH_INFO: `/v3/domains/default/users/9858bbeee69c4062a3e73bac3fef2908/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:03.793878 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d051ae-7ab9-46b6-ab0d-1f28290eac30 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:03.796387 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969dd649-be65-4ef5-a48f-106b9e3bd814 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=9858bbeee69c4062a3e73bac3fef2908, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:03.796933 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969dd649-be65-4ef5-a48f-106b9e3bd814 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:03.830694 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0df19-4adf-4b17-8afa-fa0364479b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:03.831541 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0df19-4adf-4b17-8afa-fa0364479b60 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:03.831647 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0df19-4adf-4b17-8afa-fa0364479b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:03.831930 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0df19-4adf-4b17-8afa-fa0364479b60 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:03.833112 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e0df19-4adf-4b17-8afa-fa0364479b60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:03.834570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e0df19-4adf-4b17-8afa-fa0364479b60 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:03.836868 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 20/44] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:29:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:03.842634 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0df19-4adf-4b17-8afa-fa0364479b60 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:03.860615 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 25/45] 10.222.0.42 () {58 vars in 1361 bytes} [Fri Aug 5 02:29:03 2022] PUT /identity/v3/domains/default/users/9858bbeee69c4062a3e73bac3fef2908/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:29:03.910663 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:03.958157 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0df19-4adf-4b17-8afa-fa0364479b60 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:03.994284 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6eecd-35c3-4473-a0b8-916c1af51546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:03.994927 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6eecd-35c3-4473-a0b8-916c1af51546 None admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:03.995241 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6eecd-35c3-4473-a0b8-916c1af51546 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:03.995522 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6eecd-35c3-4473-a0b8-916c1af51546 None admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:03.996227 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6eecd-35c3-4473-a0b8-916c1af51546 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:03.997718 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6eecd-35c3-4473-a0b8-916c1af51546 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:04.108121 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 21/46] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Aug 5 02:29:03 2022] POST /identity/v3/projects => generated 312 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:29:05.853390 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a65b3-3570-4aba-8f31-02935d3a4f32 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:05.853899 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a65b3-3570-4aba-8f31-02935d3a4f32 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:05.853998 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a65b3-3570-4aba-8f31-02935d3a4f32 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:05.855346 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 26/47] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:05.860537 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ea603-e6e9-4a40-83dc-4b7de012aed5 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:05.860933 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ea603-e6e9-4a40-83dc-4b7de012aed5 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:05.861100 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ea603-e6e9-4a40-83dc-4b7de012aed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:05.878802 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-bb8ea603-e6e9-4a40-83dc-4b7de012aed5 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:05.880029 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-bb8ea603-e6e9-4a40-83dc-4b7de012aed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:05.947749 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 22/48] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:29:05.970385 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a65b3-3570-4aba-8f31-02935d3a4f32 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:06.068918 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a65b3-3570-4aba-8f31-02935d3a4f32 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:06.079501 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:06.102271 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f77187-bda9-4421-a7b1-f4c5bddcbe18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:06.102912 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f77187-bda9-4421-a7b1-f4c5bddcbe18 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:06.103348 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f77187-bda9-4421-a7b1-f4c5bddcbe18 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:06.103673 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f77187-bda9-4421-a7b1-f4c5bddcbe18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:06.107635 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced8a8c-0b56-42ed-8663-84555a0182d7 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:06.107926 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced8a8c-0b56-42ed-8663-84555a0182d7 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:06.108209 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced8a8c-0b56-42ed-8663-84555a0182d7 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:06.109559 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 23/49] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:29:06.114100 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f77187-bda9-4421-a7b1-f4c5bddcbe18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:06.114386 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587ec59-1082-4acf-b1b5-6a997e1e36f1 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:06.114733 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587ec59-1082-4acf-b1b5-6a997e1e36f1 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:06.115109 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587ec59-1082-4acf-b1b5-6a997e1e36f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:06.119375 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-a7f77187-bda9-4421-a7b1-f4c5bddcbe18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:29:06.119375 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:06.119375 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:06.119375 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:06.119375 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:06.119375 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:06.119375 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:06.119375 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:06.119375 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:06.119375 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:06.119375 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:06.119375 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:06.119375 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:06.119375 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:06.119375 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:06.119375 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:06.120365 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:06.120365 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:06.120365 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:06.120365 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:06.120365 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:06.120365 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:06.120365 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:06.120365 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:06.120365 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:06.120365 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:06.120365 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:06.120365 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:06.120365 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:06.120365 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:06.120365 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:06.120365 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:06.121292 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:06.121292 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:06.121292 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:06.121292 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:06.121292 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:06.121292 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:06.121292 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:06.121292 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:06.121292 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:06.121292 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:06.121292 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:29:06.121292 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:29:06.127102 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 27/50] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 5 02:29:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:29:06.129667 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f77187-bda9-4421-a7b1-f4c5bddcbe18 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:06.133709 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-5587ec59-1082-4acf-b1b5-6a997e1e36f1 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:06.134930 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-5587ec59-1082-4acf-b1b5-6a997e1e36f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:06.171130 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:06.202669 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 24/51] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:29:06.226303 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587ec59-1082-4acf-b1b5-6a997e1e36f1 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:06.235356 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f77187-bda9-4421-a7b1-f4c5bddcbe18 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:06.271938 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861d448-3199-4622-b19d-d268d7b559bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:06.272608 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861d448-3199-4622-b19d-d268d7b559bf None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:06.272952 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861d448-3199-4622-b19d-d268d7b559bf None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:06.273734 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861d448-3199-4622-b19d-d268d7b559bf None admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:06.274461 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861d448-3199-4622-b19d-d268d7b559bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:06.274770 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861d448-3199-4622-b19d-d268d7b559bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:06.276223 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861d448-3199-4622-b19d-d268d7b559bf None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:06.284717 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 28/52] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:29:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:29:06.290438 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861d448-3199-4622-b19d-d268d7b559bf None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:06.321198 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:06.325464 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587ec59-1082-4acf-b1b5-6a997e1e36f1 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:06.359608 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6ab49-fc4f-4f20-abae-4f049026a1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:06.360195 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6ab49-fc4f-4f20-abae-4f049026a1c9 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:06.360485 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6ab49-fc4f-4f20-abae-4f049026a1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:06.360768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6ab49-fc4f-4f20-abae-4f049026a1c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:06.361944 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba6ab49-fc4f-4f20-abae-4f049026a1c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:06.363450 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba6ab49-fc4f-4f20-abae-4f049026a1c9 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:06.365245 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 25/53] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:29:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:29:06.371349 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6ab49-fc4f-4f20-abae-4f049026a1c9 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:06.387525 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861d448-3199-4622-b19d-d268d7b559bf None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:06.413226 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:06.421276 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e3b39-c811-430f-ae62-78931adfea2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:06.421919 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e3b39-c811-430f-ae62-78931adfea2b None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:06.422207 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e3b39-c811-430f-ae62-78931adfea2b None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:06.426786 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e3b39-c811-430f-ae62-78931adfea2b None admin] PATH_INFO: `/v3/users/9858bbeee69c4062a3e73bac3fef2908` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:06.426786 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9e3b39-c811-430f-ae62-78931adfea2b None admin] RBAC: Authorizing `identity:get_user(user_id=9858bbeee69c4062a3e73bac3fef2908)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:06.426786 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9e3b39-c811-430f-ae62-78931adfea2b None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:06.426786 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 29/54] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:29:06 2022] GET /identity/v3/users/9858bbeee69c4062a3e73bac3fef2908 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:29:06.432677 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e3b39-c811-430f-ae62-78931adfea2b None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:06.469264 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6ab49-fc4f-4f20-abae-4f049026a1c9 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:06.502467 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e7c19-1d2b-4f19-abe1-a722ead4ab6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:06.503137 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e7c19-1d2b-4f19-abe1-a722ead4ab6c None admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:06.503429 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e7c19-1d2b-4f19-abe1-a722ead4ab6c None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:06.503713 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e7c19-1d2b-4f19-abe1-a722ead4ab6c None admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:06.504401 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e7c19-1d2b-4f19-abe1-a722ead4ab6c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:06.505845 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e7c19-1d2b-4f19-abe1-a722ead4ab6c None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:06.526382 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:06.529275 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e3b39-c811-430f-ae62-78931adfea2b None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:06.561643 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a560f-151b-4ad6-bfd9-8f44ff71446d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:06.562262 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a560f-151b-4ad6-bfd9-8f44ff71446d None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:06.562544 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a560f-151b-4ad6-bfd9-8f44ff71446d None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:06.562820 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a560f-151b-4ad6-bfd9-8f44ff71446d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:06.564028 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7a560f-151b-4ad6-bfd9-8f44ff71446d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:06.565588 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7a560f-151b-4ad6-bfd9-8f44ff71446d None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:06.569831 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 30/55] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:29:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:29:06.573576 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a560f-151b-4ad6-bfd9-8f44ff71446d None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:06.595128 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 26/56] 10.222.0.42 () {60 vars in 1140 bytes} [Fri Aug 5 02:29:06 2022] POST /identity/v3/projects => generated 298 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:29:06.676522 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a560f-151b-4ad6-bfd9-8f44ff71446d None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:06.712223 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c3e82-9b8f-4ae8-9b0f-38d757a176c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:06.712857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c3e82-9b8f-4ae8-9b0f-38d757a176c8 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:06.713146 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c3e82-9b8f-4ae8-9b0f-38d757a176c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:06.713435 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c3e82-9b8f-4ae8-9b0f-38d757a176c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:06.714315 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179c3e82-9b8f-4ae8-9b0f-38d757a176c8 None admin] RBAC: Adding query filter params (role.id=83afe883a303495b966480fb9b5bb7dd, scope.domain.id=default, user.id=9858bbeee69c4062a3e73bac3fef2908) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:06.714550 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179c3e82-9b8f-4ae8-9b0f-38d757a176c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:06.716052 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179c3e82-9b8f-4ae8-9b0f-38d757a176c8 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:06.722427 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 31/57] 10.222.0.42 () {56 vars in 1322 bytes} [Fri Aug 5 02:29:06 2022] GET /identity/v3/role_assignments?user.id=9858bbeee69c4062a3e73bac3fef2908&scope.domain.id=default&role.id=83afe883a303495b966480fb9b5bb7dd => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:29:08.634012 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e0098-d8be-4816-a390-6fa1144137ba None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:08.634497 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e0098-d8be-4816-a390-6fa1144137ba None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:08.634497 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e0098-d8be-4816-a390-6fa1144137ba None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:08.635894 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 27/58] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:08.641015 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf085d12-a925-4087-a870-a404f0bbf635 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:08.641410 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf085d12-a925-4087-a870-a404f0bbf635 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:08.641574 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf085d12-a925-4087-a870-a404f0bbf635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:08.659934 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-cf085d12-a925-4087-a870-a404f0bbf635 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:08.661475 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-cf085d12-a925-4087-a870-a404f0bbf635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:08.687230 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:08.726874 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 32/59] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:29:08.750563 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e0098-d8be-4816-a390-6fa1144137ba None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:08.840579 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:08.849776 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e0098-d8be-4816-a390-6fa1144137ba None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:08.882729 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd18283-413a-4660-bf3f-094236875a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:08.883397 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd18283-413a-4660-bf3f-094236875a8a None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:08.883685 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd18283-413a-4660-bf3f-094236875a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:08.883965 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd18283-413a-4660-bf3f-094236875a8a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:08.885199 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd18283-413a-4660-bf3f-094236875a8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:08.886622 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd18283-413a-4660-bf3f-094236875a8a None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:08.888335 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 28/60] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:29:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:08.899086 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf085d12-a925-4087-a870-a404f0bbf635 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:08.994208 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf085d12-a925-4087-a870-a404f0bbf635 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:09.026327 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a095f-9c6f-41be-94b5-3735e4ceba1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:09.026935 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a095f-9c6f-41be-94b5-3735e4ceba1d None admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:09.027244 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a095f-9c6f-41be-94b5-3735e4ceba1d None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:09.027520 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a095f-9c6f-41be-94b5-3735e4ceba1d None admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:09.028191 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a095f-9c6f-41be-94b5-3735e4ceba1d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:09.029655 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a095f-9c6f-41be-94b5-3735e4ceba1d None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:09.136747 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 33/61] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 5 02:29:08 2022] POST /identity/v3/users => generated 275 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:29:12.187188 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770d255-04cb-4a09-93f9-0b4bd48240a2 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:12.187701 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770d255-04cb-4a09-93f9-0b4bd48240a2 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:12.187773 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770d255-04cb-4a09-93f9-0b4bd48240a2 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:12.189096 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 29/62] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:12.194216 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3053d-7aea-425e-b7f9-7680fb4e0f63 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:12.195567 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3053d-7aea-425e-b7f9-7680fb4e0f63 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:12.196075 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3053d-7aea-425e-b7f9-7680fb4e0f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:12.227958 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-b2b3053d-7aea-425e-b7f9-7680fb4e0f63 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:12.229504 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-b2b3053d-7aea-425e-b7f9-7680fb4e0f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:12.243823 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:12.333446 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 34/63] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:29:12.368484 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770d255-04cb-4a09-93f9-0b4bd48240a2 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:12.387734 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628e8c1-148d-4226-8e3e-a1737cc22c6a None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:12.388036 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628e8c1-148d-4226-8e3e-a1737cc22c6a None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:12.388299 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628e8c1-148d-4226-8e3e-a1737cc22c6a None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:12.389800 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 35/64] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:12.405120 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00101d3f-59ba-4709-9645-605aeb87afc8 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:12.405399 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00101d3f-59ba-4709-9645-605aeb87afc8 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:12.405687 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00101d3f-59ba-4709-9645-605aeb87afc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:12.429769 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-00101d3f-59ba-4709-9645-605aeb87afc8 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:12.430981 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-00101d3f-59ba-4709-9645-605aeb87afc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:12.557882 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 36/65] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:29:12.565824 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770d255-04cb-4a09-93f9-0b4bd48240a2 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:12.607027 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764682e6-246b-4172-b635-8f0a045fc5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:12.607693 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764682e6-246b-4172-b635-8f0a045fc5b7 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:12.607978 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764682e6-246b-4172-b635-8f0a045fc5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:12.608255 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764682e6-246b-4172-b635-8f0a045fc5b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:12.620707 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db148b-fea4-4775-87f1-d4e61c97b46c None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:12.620987 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db148b-fea4-4775-87f1-d4e61c97b46c None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:12.621269 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db148b-fea4-4775-87f1-d4e61c97b46c None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:12.622776 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 37/66] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:29:12.626973 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db148b-fea4-4775-87f1-d4e61c97b46c None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:12.629886 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764682e6-246b-4172-b635-8f0a045fc5b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:12.637269 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-764682e6-246b-4172-b635-8f0a045fc5b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:29:12.637269 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:12.637269 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:12.637269 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:12.637269 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:12.637269 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:12.637269 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:12.637269 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:12.637269 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:12.637269 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:12.637269 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:12.637269 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:12.637269 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:12.637269 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:12.637269 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:12.637269 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:12.638181 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:12.638181 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:12.638181 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:12.638181 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:12.638181 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:12.638181 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:12.638181 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:12.638181 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:12.638181 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:12.638181 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:12.638181 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:12.638181 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:12.638181 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:12.638181 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:12.638181 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:12.638181 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:12.638928 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:12.638928 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:12.638928 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:12.638928 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:12.638928 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:12.638928 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:12.638928 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:12.638928 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:12.638928 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:12.638928 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:12.638928 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:29:12.638928 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:29:12.638928 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 30/67] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:29:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:29:12.639934 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d1ff0-ccdd-4114-a450-70a0a55976ff None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:12.640035 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d1ff0-ccdd-4114-a450-70a0a55976ff None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:12.640758 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d1ff0-ccdd-4114-a450-70a0a55976ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:12.659152 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-a40d1ff0-ccdd-4114-a450-70a0a55976ff None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:12.660360 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-a40d1ff0-ccdd-4114-a450-70a0a55976ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:12.674924 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:12.709445 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:12.731842 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db148b-fea4-4775-87f1-d4e61c97b46c None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:12.736050 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 31/68] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:29:12.737529 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fcdc8-d8fd-4de0-909d-426de670143e None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:12.738081 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fcdc8-d8fd-4de0-909d-426de670143e None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:12.738557 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fcdc8-d8fd-4de0-909d-426de670143e None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:12.740338 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 32/69] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:12.741242 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030fcdc8-d8fd-4de0-909d-426de670143e None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:12.782848 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357720c-aaba-466e-a8bb-6e0b0c2e230b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:12.783530 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357720c-aaba-466e-a8bb-6e0b0c2e230b None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:12.783821 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357720c-aaba-466e-a8bb-6e0b0c2e230b None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:12.784124 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357720c-aaba-466e-a8bb-6e0b0c2e230b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:12.797685 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a357720c-aaba-466e-a8bb-6e0b0c2e230b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:12.805334 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-a357720c-aaba-466e-a8bb-6e0b0c2e230b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:29:12.805334 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:12.805334 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:12.805334 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:12.805334 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:12.805334 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:12.805334 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:12.805334 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:12.805334 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:12.805334 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:12.805334 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:12.805334 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:12.805334 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:12.805334 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:12.805334 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:12.805334 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:12.806186 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:12.806186 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:12.806186 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:12.806186 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:12.806186 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:12.806186 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:12.806186 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:12.806186 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:12.806186 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:12.806186 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:12.806186 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:12.806186 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:12.806186 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:12.806186 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:12.806186 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:12.806186 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:12.807933 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:12.807933 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:12.807933 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:12.807933 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:12.807933 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:12.807933 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:12.807933 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:12.807933 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:12.807933 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:12.807933 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:12.807933 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:29:12.807933 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:29:12.807933 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 38/70] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 5 02:29:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:29:12.809226 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b53f2b-9249-493e-95eb-123e72b42784 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:12.809522 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b53f2b-9249-493e-95eb-123e72b42784 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:12.809807 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b53f2b-9249-493e-95eb-123e72b42784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:12.828558 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-c0b53f2b-9249-493e-95eb-123e72b42784 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:12.829757 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-c0b53f2b-9249-493e-95eb-123e72b42784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:12.850048 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030fcdc8-d8fd-4de0-909d-426de670143e None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:12.887520 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c051cb-1f92-45c0-9fed-89bee7cd953d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:12.888151 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c051cb-1f92-45c0-9fed-89bee7cd953d None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:12.888441 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c051cb-1f92-45c0-9fed-89bee7cd953d None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:12.888735 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c051cb-1f92-45c0-9fed-89bee7cd953d None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:12.889446 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c051cb-1f92-45c0-9fed-89bee7cd953d None admin] RBAC: Adding query filter params (name=member) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:12.889758 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c051cb-1f92-45c0-9fed-89bee7cd953d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:12.891198 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c051cb-1f92-45c0-9fed-89bee7cd953d None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:12.900369 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 33/71] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 5 02:29:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:12.901359 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 39/72] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:29:12.901643 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c051cb-1f92-45c0-9fed-89bee7cd953d None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:12.907616 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b53f2b-9249-493e-95eb-123e72b42784 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:12.917758 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:12.983627 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:13.016456 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b53f2b-9249-493e-95eb-123e72b42784 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:13.020471 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c051cb-1f92-45c0-9fed-89bee7cd953d None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:13.051091 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e965d3d-7da5-425f-bbc0-29a3b36bc5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:13.051718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e965d3d-7da5-425f-bbc0-29a3b36bc5bc None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:13.052005 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e965d3d-7da5-425f-bbc0-29a3b36bc5bc None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:13.052286 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e965d3d-7da5-425f-bbc0-29a3b36bc5bc None admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:13.053008 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e965d3d-7da5-425f-bbc0-29a3b36bc5bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:13.053318 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e965d3d-7da5-425f-bbc0-29a3b36bc5bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:13.054810 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291980b-4dc1-4e4e-b9d9-c8c9bd4f4cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:13.055410 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e965d3d-7da5-425f-bbc0-29a3b36bc5bc None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:13.055505 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291980b-4dc1-4e4e-b9d9-c8c9bd4f4cfd None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:13.055771 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291980b-4dc1-4e4e-b9d9-c8c9bd4f4cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:13.056052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291980b-4dc1-4e4e-b9d9-c8c9bd4f4cfd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:13.063445 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 40/73] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:29:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:13.064174 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e965d3d-7da5-425f-bbc0-29a3b36bc5bc None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:13.066531 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291980b-4dc1-4e4e-b9d9-c8c9bd4f4cfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:13.071949 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-a291980b-4dc1-4e4e-b9d9-c8c9bd4f4cfd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:29:13.071949 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:13.071949 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:13.071949 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:13.071949 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:13.071949 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:13.071949 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:13.071949 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:13.071949 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:13.071949 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:13.071949 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:13.071949 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:13.071949 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:13.071949 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:13.071949 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:13.071949 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:13.072803 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:13.072803 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:13.072803 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:13.072803 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:13.072803 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:13.072803 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:13.072803 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:13.072803 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:13.072803 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:13.072803 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:13.072803 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:13.072803 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:13.072803 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:13.072803 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:13.072803 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:13.072803 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:13.073582 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:13.073582 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:13.073582 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:13.073582 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:13.073582 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:13.073582 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:13.073582 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:13.073582 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:13.073582 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:13.073582 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:13.073582 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:29:13.073582 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:29:13.073582 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 34/74] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:29:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:29:13.074193 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291980b-4dc1-4e4e-b9d9-c8c9bd4f4cfd None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:13.144309 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:13.165392 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e965d3d-7da5-425f-bbc0-29a3b36bc5bc None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:13.172477 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291980b-4dc1-4e4e-b9d9-c8c9bd4f4cfd None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:13.194408 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:13.200679 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d3a8b-c18c-4905-862c-91931bc49fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:13.201320 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d3a8b-c18c-4905-862c-91931bc49fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:13.201607 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d3a8b-c18c-4905-862c-91931bc49fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:13.201888 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d3a8b-c18c-4905-862c-91931bc49fd3 None admin] PATH_INFO: `/v3/users/ff4872f4d7ca4f069406cc8c9ff750f7` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:13.206727 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c316d-344c-44c2-aab9-f4d32c8a713f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:13.207392 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c316d-344c-44c2-aab9-f4d32c8a713f None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:13.209596 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c316d-344c-44c2-aab9-f4d32c8a713f None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:13.209596 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c316d-344c-44c2-aab9-f4d32c8a713f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:13.215509 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7d3a8b-c18c-4905-862c-91931bc49fd3 None admin] RBAC: Authorizing `identity:get_user(user_id=ff4872f4d7ca4f069406cc8c9ff750f7)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:13.217279 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7d3a8b-c18c-4905-862c-91931bc49fd3 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:13.218458 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c316d-344c-44c2-aab9-f4d32c8a713f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:13.218921 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 41/75] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:29:13 2022] GET /identity/v3/users/ff4872f4d7ca4f069406cc8c9ff750f7 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:13.220101 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85e0a5-0e83-441a-93d1-269ba204fe76 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:13.220391 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85e0a5-0e83-441a-93d1-269ba204fe76 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:13.220670 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85e0a5-0e83-441a-93d1-269ba204fe76 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:13.222129 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 42/76] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:13.223717 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85e0a5-0e83-441a-93d1-269ba204fe76 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:13.223819 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-ac6c316d-344c-44c2-aab9-f4d32c8a713f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:29:13.223819 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:13.223819 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:13.223819 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:13.223819 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:13.223819 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:13.223819 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:13.223819 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:13.223819 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:13.223819 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:13.223819 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:13.223819 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:13.223819 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:13.223819 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:13.223819 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:13.223819 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:13.224597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:13.224597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:13.224597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:13.224597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:13.224597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:13.224597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:13.224597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:13.224597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:13.224597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:13.224597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:13.224597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:13.224597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:13.224597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:13.224597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:13.224597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:13.224597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:13.230322 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:13.230322 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:13.230322 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:13.230322 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:13.230322 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:13.230322 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:13.230322 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:13.230322 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:13.230322 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:13.230322 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:13.230322 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:29:13.230322 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:29:13.230322 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 35/77] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 5 02:29:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:29:13.230322 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c316d-344c-44c2-aab9-f4d32c8a713f None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:13.326665 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c316d-344c-44c2-aab9-f4d32c8a713f None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:13.330908 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85e0a5-0e83-441a-93d1-269ba204fe76 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:13.355907 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:13.360571 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3517136a-413f-43e1-b8d2-dc4e2738e7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:13.361196 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517136a-413f-43e1-b8d2-dc4e2738e7e4 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:13.361485 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517136a-413f-43e1-b8d2-dc4e2738e7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:13.361767 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517136a-413f-43e1-b8d2-dc4e2738e7e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:13.362483 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3517136a-413f-43e1-b8d2-dc4e2738e7e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:13.362792 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3517136a-413f-43e1-b8d2-dc4e2738e7e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:13.364215 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3517136a-413f-43e1-b8d2-dc4e2738e7e4 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:13.365061 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa226574-4fd0-4bea-8d6f-615c63d6db53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:13.365704 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa226574-4fd0-4bea-8d6f-615c63d6db53 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:13.365993 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa226574-4fd0-4bea-8d6f-615c63d6db53 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:13.366275 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa226574-4fd0-4bea-8d6f-615c63d6db53 None admin] PATH_INFO: `/v3/users/9858bbeee69c4062a3e73bac3fef2908` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:13.367562 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa226574-4fd0-4bea-8d6f-615c63d6db53 None admin] RBAC: Authorizing `identity:get_user(user_id=9858bbeee69c4062a3e73bac3fef2908)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:13.369078 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa226574-4fd0-4bea-8d6f-615c63d6db53 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:13.372240 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 43/78] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:29:13 2022] GET /identity/v3/users/9858bbeee69c4062a3e73bac3fef2908 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:13.372240 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa226574-4fd0-4bea-8d6f-615c63d6db53 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:13.372547 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 36/79] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 5 02:29:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:13.372547 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546cd97-057d-45c0-a3c6-5b8008d21d1c None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:13.372547 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546cd97-057d-45c0-a3c6-5b8008d21d1c None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:13.372547 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546cd97-057d-45c0-a3c6-5b8008d21d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:13.391558 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-4546cd97-057d-45c0-a3c6-5b8008d21d1c None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:13.392767 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-4546cd97-057d-45c0-a3c6-5b8008d21d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:13.430577 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:13.458726 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 37/80] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:29:13.467190 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546cd97-057d-45c0-a3c6-5b8008d21d1c None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:13.484612 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa226574-4fd0-4bea-8d6f-615c63d6db53 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:13.518197 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551452ef-a0c1-419e-819e-88e748763845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:13.518818 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551452ef-a0c1-419e-819e-88e748763845 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:13.519134 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551452ef-a0c1-419e-819e-88e748763845 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:13.519414 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551452ef-a0c1-419e-819e-88e748763845 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:13.558383 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546cd97-057d-45c0-a3c6-5b8008d21d1c None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:13.581359 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:13.586001 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551452ef-a0c1-419e-819e-88e748763845 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:13.587564 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551452ef-a0c1-419e-819e-88e748763845 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:13.592619 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7337476-66c4-4c71-93f9-e32c60dbdded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:13.593302 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7337476-66c4-4c71-93f9-e32c60dbdded None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:13.593592 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7337476-66c4-4c71-93f9-e32c60dbdded None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:13.593874 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7337476-66c4-4c71-93f9-e32c60dbdded None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:13.594594 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7337476-66c4-4c71-93f9-e32c60dbdded None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:13.594937 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7337476-66c4-4c71-93f9-e32c60dbdded None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:13.596362 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7337476-66c4-4c71-93f9-e32c60dbdded None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:13.604648 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 38/81] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:29:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:13.605515 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7337476-66c4-4c71-93f9-e32c60dbdded None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:13.645414 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:13.690219 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 44/82] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:29:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:29:13.691089 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551452ef-a0c1-419e-819e-88e748763845 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:13.706599 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7337476-66c4-4c71-93f9-e32c60dbdded None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:13.739682 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c981df-67e5-4379-a30d-e7ccd825c953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:13.740312 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c981df-67e5-4379-a30d-e7ccd825c953 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:13.740603 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c981df-67e5-4379-a30d-e7ccd825c953 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:13.740888 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c981df-67e5-4379-a30d-e7ccd825c953 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:13.789322 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551452ef-a0c1-419e-819e-88e748763845 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:13.795464 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:13.807995 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c981df-67e5-4379-a30d-e7ccd825c953 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:13.809493 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c981df-67e5-4379-a30d-e7ccd825c953 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:13.822887 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3482bf6b-a1b4-4580-9a8d-10ef87b705c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:13.823556 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482bf6b-a1b4-4580-9a8d-10ef87b705c0 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:13.823850 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482bf6b-a1b4-4580-9a8d-10ef87b705c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:13.824127 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482bf6b-a1b4-4580-9a8d-10ef87b705c0 None admin] PATH_INFO: `/v3/users/ff4872f4d7ca4f069406cc8c9ff750f7` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:13.825300 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3482bf6b-a1b4-4580-9a8d-10ef87b705c0 None admin] RBAC: Authorizing `identity:get_user(user_id=ff4872f4d7ca4f069406cc8c9ff750f7)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:13.826751 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3482bf6b-a1b4-4580-9a8d-10ef87b705c0 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:13.828449 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 45/83] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:29:13 2022] GET /identity/v3/users/ff4872f4d7ca4f069406cc8c9ff750f7 => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:13.829215 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3482bf6b-a1b4-4580-9a8d-10ef87b705c0 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:13.857948 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:13.907321 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 39/84] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:29:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:29:13.908068 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c981df-67e5-4379-a30d-e7ccd825c953 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:13.930105 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3482bf6b-a1b4-4580-9a8d-10ef87b705c0 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:13.964211 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e76497-e849-4391-96e0-801a92241f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:13.964849 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e76497-e849-4391-96e0-801a92241f99 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:13.965134 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e76497-e849-4391-96e0-801a92241f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:13.965418 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e76497-e849-4391-96e0-801a92241f99 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:13.966554 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e76497-e849-4391-96e0-801a92241f99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:13.968062 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e76497-e849-4391-96e0-801a92241f99 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:13.969633 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 46/85] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:29:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:13.974235 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e76497-e849-4391-96e0-801a92241f99 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:13.992563 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:14.006981 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c981df-67e5-4379-a30d-e7ccd825c953 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:14.040984 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2880cd-102d-4b6d-a61f-36eb995b7201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:14.041629 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2880cd-102d-4b6d-a61f-36eb995b7201 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:14.041922 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2880cd-102d-4b6d-a61f-36eb995b7201 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:14.042201 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2880cd-102d-4b6d-a61f-36eb995b7201 None admin] PATH_INFO: `/v3/users/ff4872f4d7ca4f069406cc8c9ff750f7` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:14.043651 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2880cd-102d-4b6d-a61f-36eb995b7201 None admin] RBAC: Authorizing `identity:get_user(user_id=ff4872f4d7ca4f069406cc8c9ff750f7)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:14.045123 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2880cd-102d-4b6d-a61f-36eb995b7201 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:14.046732 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 40/86] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:29:13 2022] GET /identity/v3/users/ff4872f4d7ca4f069406cc8c9ff750f7 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:14.047525 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2880cd-102d-4b6d-a61f-36eb995b7201 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:14.068764 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:14.077766 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e76497-e849-4391-96e0-801a92241f99 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:14.117833 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3077e-a51a-47d5-ae5a-0026ba57e3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:14.118408 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3077e-a51a-47d5-ae5a-0026ba57e3cb None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:14.118692 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3077e-a51a-47d5-ae5a-0026ba57e3cb None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:14.118975 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3077e-a51a-47d5-ae5a-0026ba57e3cb None admin] PATH_INFO: `/v3/projects/4e2cf55519e4431b85bdc27977f9165d` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:14.120143 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c3077e-a51a-47d5-ae5a-0026ba57e3cb None admin] RBAC: Authorizing `identity:get_project(project_id=4e2cf55519e4431b85bdc27977f9165d)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:14.121593 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c3077e-a51a-47d5-ae5a-0026ba57e3cb None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:14.123276 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 47/87] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:29:13 2022] GET /identity/v3/projects/4e2cf55519e4431b85bdc27977f9165d => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:14.124031 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3077e-a51a-47d5-ae5a-0026ba57e3cb None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:14.148406 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2880cd-102d-4b6d-a61f-36eb995b7201 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:14.181248 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e7070-db0f-43e4-a88f-501d14b384d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:14.181879 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e7070-db0f-43e4-a88f-501d14b384d8 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:14.182169 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e7070-db0f-43e4-a88f-501d14b384d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:14.182458 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e7070-db0f-43e4-a88f-501d14b384d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:14.206301 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:14.230352 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3077e-a51a-47d5-ae5a-0026ba57e3cb None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:14.249698 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e7070-db0f-43e4-a88f-501d14b384d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:14.251186 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e7070-db0f-43e4-a88f-501d14b384d8 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:14.265840 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5c3a2-dee6-40fd-a151-37303d3f511a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:14.266484 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5c3a2-dee6-40fd-a151-37303d3f511a None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:14.266769 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5c3a2-dee6-40fd-a151-37303d3f511a None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:14.267082 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5c3a2-dee6-40fd-a151-37303d3f511a None admin] PATH_INFO: `/v3/projects/4e2cf55519e4431b85bdc27977f9165d` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:14.268252 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5c3a2-dee6-40fd-a151-37303d3f511a None admin] RBAC: Authorizing `identity:get_project(project_id=4e2cf55519e4431b85bdc27977f9165d)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:14.269713 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5c3a2-dee6-40fd-a151-37303d3f511a None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:14.271443 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 48/88] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:29:14 2022] GET /identity/v3/projects/4e2cf55519e4431b85bdc27977f9165d => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:14.272191 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5c3a2-dee6-40fd-a151-37303d3f511a None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:14.301742 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:14.357522 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 41/89] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:29:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:29:14.358438 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e7070-db0f-43e4-a88f-501d14b384d8 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:14.376980 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5c3a2-dee6-40fd-a151-37303d3f511a None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:14.409273 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce448f-ce02-4b0c-9037-e5052160eb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:14.409737 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:14.409888 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce448f-ce02-4b0c-9037-e5052160eb9a None admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:14.410172 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce448f-ce02-4b0c-9037-e5052160eb9a None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:14.410451 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce448f-ce02-4b0c-9037-e5052160eb9a None admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:14.411168 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce448f-ce02-4b0c-9037-e5052160eb9a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:14.412611 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce448f-ce02-4b0c-9037-e5052160eb9a None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:14.453278 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e7070-db0f-43e4-a88f-501d14b384d8 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:14.485949 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7a9ca-eea1-459e-8276-e04d34a7023b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:14.486565 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7a9ca-eea1-459e-8276-e04d34a7023b None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:14.486849 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7a9ca-eea1-459e-8276-e04d34a7023b None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:14.487152 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7a9ca-eea1-459e-8276-e04d34a7023b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:14.524947 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 49/90] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 5 02:29:14 2022] POST /identity/v3/users => generated 289 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:29:14.525904 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce448f-ce02-4b0c-9037-e5052160eb9a None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:14.556745 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7a9ca-eea1-459e-8276-e04d34a7023b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:14.558529 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7a9ca-eea1-459e-8276-e04d34a7023b None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:14.623177 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:14.623374 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:14.640973 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce448f-ce02-4b0c-9037-e5052160eb9a None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:14.673522 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 42/91] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:29:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:29:14.674716 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7a9ca-eea1-459e-8276-e04d34a7023b None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:14.676809 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebca97-c5ef-460c-9d3f-7ed73e493003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:14.677432 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebca97-c5ef-460c-9d3f-7ed73e493003 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:14.677714 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebca97-c5ef-460c-9d3f-7ed73e493003 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:14.677989 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebca97-c5ef-460c-9d3f-7ed73e493003 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:14.678859 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ebca97-c5ef-460c-9d3f-7ed73e493003 None admin] RBAC: Adding query filter params (role.id=dd9e162a1a25432d871c4c2c0ab779a5, scope.project.id=4e2cf55519e4431b85bdc27977f9165d, user.id=ff4872f4d7ca4f069406cc8c9ff750f7) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:14.679767 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ebca97-c5ef-460c-9d3f-7ed73e493003 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:14.681242 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ebca97-c5ef-460c-9d3f-7ed73e493003 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:14.688704 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 50/92] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:29:14 2022] GET /identity/v3/role_assignments?user.id=ff4872f4d7ca4f069406cc8c9ff750f7&scope.project.id=4e2cf55519e4431b85bdc27977f9165d&role.id=dd9e162a1a25432d871c4c2c0ab779a5 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:14.689520 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebca97-c5ef-460c-9d3f-7ed73e493003 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:14.801862 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7a9ca-eea1-459e-8276-e04d34a7023b None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:14.833940 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebca97-c5ef-460c-9d3f-7ed73e493003 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:14.845932 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a813e-13d1-44ac-a3a4-5e78a656d2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:14.847120 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a813e-13d1-44ac-a3a4-5e78a656d2e5 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:14.847120 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a813e-13d1-44ac-a3a4-5e78a656d2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:14.847120 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a813e-13d1-44ac-a3a4-5e78a656d2e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:14.847996 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a813e-13d1-44ac-a3a4-5e78a656d2e5 None admin] RBAC: Adding query filter params (role.id=83afe883a303495b966480fb9b5bb7dd, scope.project.id=4e2cf55519e4431b85bdc27977f9165d, user.id=9858bbeee69c4062a3e73bac3fef2908) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:14.848373 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a813e-13d1-44ac-a3a4-5e78a656d2e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:14.849914 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a813e-13d1-44ac-a3a4-5e78a656d2e5 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:14.860553 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 43/93] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:29:14 2022] GET /identity/v3/role_assignments?user.id=9858bbeee69c4062a3e73bac3fef2908&scope.project.id=4e2cf55519e4431b85bdc27977f9165d&role.id=83afe883a303495b966480fb9b5bb7dd => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:14.861406 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a813e-13d1-44ac-a3a4-5e78a656d2e5 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:14.889917 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:14.890105 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127d15f-0395-4fd4-a25d-344def70b3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:14.891316 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127d15f-0395-4fd4-a25d-344def70b3ab None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:14.891543 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127d15f-0395-4fd4-a25d-344def70b3ab None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:14.891831 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127d15f-0395-4fd4-a25d-344def70b3ab None admin] PATH_INFO: `/v3/projects/203913d69590486f96944248d10475c5` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:14.893172 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127d15f-0395-4fd4-a25d-344def70b3ab None admin] RBAC: Authorizing `identity:get_project(project_id=203913d69590486f96944248d10475c5)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:14.894721 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127d15f-0395-4fd4-a25d-344def70b3ab None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:14.896543 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 51/94] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:29:14 2022] GET /identity/v3/projects/203913d69590486f96944248d10475c5 => generated 312 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:14.903413 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127d15f-0395-4fd4-a25d-344def70b3ab None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:14.925339 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:15.036069 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a813e-13d1-44ac-a3a4-5e78a656d2e5 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:15.051507 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127d15f-0395-4fd4-a25d-344def70b3ab None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:15.098447 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79d76d-2aec-4173-8254-94ee14f1bd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:15.099140 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79d76d-2aec-4173-8254-94ee14f1bd2b None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:15.099426 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79d76d-2aec-4173-8254-94ee14f1bd2b None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:15.099702 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79d76d-2aec-4173-8254-94ee14f1bd2b None admin] PATH_INFO: `/v3/projects/4e2cf55519e4431b85bdc27977f9165d` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:15.101029 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85770b86-f601-4108-aa70-5896d26555a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:15.101659 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85770b86-f601-4108-aa70-5896d26555a2 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:15.101944 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85770b86-f601-4108-aa70-5896d26555a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:15.102227 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85770b86-f601-4108-aa70-5896d26555a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:15.102933 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f79d76d-2aec-4173-8254-94ee14f1bd2b None admin] RBAC: Authorizing `identity:get_project(project_id=4e2cf55519e4431b85bdc27977f9165d)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:15.103055 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85770b86-f601-4108-aa70-5896d26555a2 None admin] RBAC: Adding query filter params (role.id=dd9e162a1a25432d871c4c2c0ab779a5, scope.project.id=203913d69590486f96944248d10475c5, user.id=ff4872f4d7ca4f069406cc8c9ff750f7) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:15.103345 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85770b86-f601-4108-aa70-5896d26555a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:15.104425 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f79d76d-2aec-4173-8254-94ee14f1bd2b None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:15.104780 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85770b86-f601-4108-aa70-5896d26555a2 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:15.106280 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 44/95] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:29:14 2022] GET /identity/v3/projects/4e2cf55519e4431b85bdc27977f9165d => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:15.110736 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 52/96] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:29:14 2022] GET /identity/v3/role_assignments?user.id=ff4872f4d7ca4f069406cc8c9ff750f7&scope.project.id=203913d69590486f96944248d10475c5&role.id=dd9e162a1a25432d871c4c2c0ab779a5 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:29:15.119385 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79d76d-2aec-4173-8254-94ee14f1bd2b None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:15.229732 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:15.246349 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79d76d-2aec-4173-8254-94ee14f1bd2b None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:15.287063 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9da30e-bbce-48ed-8c1b-457c268d779a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:15.287682 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9da30e-bbce-48ed-8c1b-457c268d779a None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:15.287971 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9da30e-bbce-48ed-8c1b-457c268d779a None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:15.288280 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9da30e-bbce-48ed-8c1b-457c268d779a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:15.289090 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9da30e-bbce-48ed-8c1b-457c268d779a None admin] RBAC: Adding query filter params (role.id=428314713da6487e8047a1f333265cda, scope.project.id=4e2cf55519e4431b85bdc27977f9165d, user.id=ff4872f4d7ca4f069406cc8c9ff750f7) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:15.289403 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9da30e-bbce-48ed-8c1b-457c268d779a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:15.290880 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9da30e-bbce-48ed-8c1b-457c268d779a None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:15.297083 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 45/97] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:29:15 2022] GET /identity/v3/role_assignments?user.id=ff4872f4d7ca4f069406cc8c9ff750f7&scope.project.id=4e2cf55519e4431b85bdc27977f9165d&role.id=428314713da6487e8047a1f333265cda => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:29:17.330843 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1824ed-a4ca-41fa-a126-4f009cd2ff5b None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:17.331819 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1824ed-a4ca-41fa-a126-4f009cd2ff5b None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:17.332303 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1824ed-a4ca-41fa-a126-4f009cd2ff5b None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:17.333889 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 53/98] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:17.349576 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7826a-8278-42fd-a6bf-c2b7b25b227d None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:17.350449 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7826a-8278-42fd-a6bf-c2b7b25b227d None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:17.351798 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7826a-8278-42fd-a6bf-c2b7b25b227d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:17.375514 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-7af7826a-8278-42fd-a6bf-c2b7b25b227d None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:17.377054 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-7af7826a-8278-42fd-a6bf-c2b7b25b227d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:17.468642 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 46/99] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:29:17.513441 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1824ed-a4ca-41fa-a126-4f009cd2ff5b None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:17.613332 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:17.641640 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1824ed-a4ca-41fa-a126-4f009cd2ff5b None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:17.684372 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c5d6a-75c7-49a5-bf58-a36127ad1e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:17.685024 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c5d6a-75c7-49a5-bf58-a36127ad1e43 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:17.685311 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c5d6a-75c7-49a5-bf58-a36127ad1e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:17.685590 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c5d6a-75c7-49a5-bf58-a36127ad1e43 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:17.698823 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c5d6a-75c7-49a5-bf58-a36127ad1e43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:17.703892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-bb1c5d6a-75c7-49a5-bf58-a36127ad1e43 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:29:17.703892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:17.703892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:17.703892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:17.703892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:17.703892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:17.703892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:17.703892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:17.703892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:17.703892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:17.703892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:17.703892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:17.703892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:17.703892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:17.703892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:17.703892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:17.704725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:17.704725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:17.704725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:17.704725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:17.704725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:17.704725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:17.704725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:17.704725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:17.704725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:17.704725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:17.704725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:17.704725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:17.704725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:17.704725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:17.704725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:17.704725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:17.705516 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:17.705516 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:17.705516 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:17.705516 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:17.705516 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:17.705516 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:17.705516 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:17.705516 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:17.705516 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:17.705516 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:17.705516 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:29:17.705516 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:29:17.705516 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 54/100] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:29:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:29:17.713074 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7826a-8278-42fd-a6bf-c2b7b25b227d None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:17.833388 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:17.857580 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7826a-8278-42fd-a6bf-c2b7b25b227d None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:17.864769 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a001f-3bef-47d1-bd5f-90956e80ec72 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:17.864998 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a001f-3bef-47d1-bd5f-90956e80ec72 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:17.865546 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a001f-3bef-47d1-bd5f-90956e80ec72 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:17.867797 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 55/101] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:17.877714 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f84453-f200-4b8e-af02-9b2d848bd48f None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:17.878275 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f84453-f200-4b8e-af02-9b2d848bd48f None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:17.878756 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f84453-f200-4b8e-af02-9b2d848bd48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:17.920005 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-e8f84453-f200-4b8e-af02-9b2d848bd48f None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:17.921585 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-e8f84453-f200-4b8e-af02-9b2d848bd48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:17.931733 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c0e77-cfda-4cb6-b62a-a6ee1cf15f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:17.934989 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c0e77-cfda-4cb6-b62a-a6ee1cf15f7a None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:17.934989 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c0e77-cfda-4cb6-b62a-a6ee1cf15f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:17.934989 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c0e77-cfda-4cb6-b62a-a6ee1cf15f7a None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:17.934989 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c0e77-cfda-4cb6-b62a-a6ee1cf15f7a None admin] RBAC: Adding query filter params (name=member) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:17.934989 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c0e77-cfda-4cb6-b62a-a6ee1cf15f7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:17.935848 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c0e77-cfda-4cb6-b62a-a6ee1cf15f7a None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:17.949314 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 47/102] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 5 02:29:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:17.954388 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c0e77-cfda-4cb6-b62a-a6ee1cf15f7a None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:18.061837 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 56/103] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:29:18.063440 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89796c11-ee97-417d-acc9-45ae5307e274 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:18.063738 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89796c11-ee97-417d-acc9-45ae5307e274 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:18.064023 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89796c11-ee97-417d-acc9-45ae5307e274 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:18.065424 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 57/104] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:18.071233 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90760555-3a81-41a5-8ecc-7f1546f7a244 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:18.071524 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90760555-3a81-41a5-8ecc-7f1546f7a244 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:18.071812 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90760555-3a81-41a5-8ecc-7f1546f7a244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:18.072750 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c0e77-cfda-4cb6-b62a-a6ee1cf15f7a None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:18.107956 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-90760555-3a81-41a5-8ecc-7f1546f7a244 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:18.108592 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da83532-47c0-45e3-af1e-13027ad460a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:18.109173 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-90760555-3a81-41a5-8ecc-7f1546f7a244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:18.109726 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da83532-47c0-45e3-af1e-13027ad460a3 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:18.110206 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da83532-47c0-45e3-af1e-13027ad460a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:18.110678 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da83532-47c0-45e3-af1e-13027ad460a3 None admin] PATH_INFO: `/v3/users/ff4872f4d7ca4f069406cc8c9ff750f7` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:18.112090 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da83532-47c0-45e3-af1e-13027ad460a3 None admin] RBAC: Authorizing `identity:get_user(user_id=ff4872f4d7ca4f069406cc8c9ff750f7)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:18.113745 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da83532-47c0-45e3-af1e-13027ad460a3 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:18.115663 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 48/105] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:29:17 2022] GET /identity/v3/users/ff4872f4d7ca4f069406cc8c9ff750f7 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:29:18.116666 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da83532-47c0-45e3-af1e-13027ad460a3 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:18.129278 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:18.211512 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:18.216197 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 58/106] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:29:18.220476 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90760555-3a81-41a5-8ecc-7f1546f7a244 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:18.225333 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da83532-47c0-45e3-af1e-13027ad460a3 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:18.265257 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba424e5-bebe-455f-b987-357e54889848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:18.266273 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba424e5-bebe-455f-b987-357e54889848 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:18.266571 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba424e5-bebe-455f-b987-357e54889848 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:18.266857 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba424e5-bebe-455f-b987-357e54889848 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:18.287342 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba424e5-bebe-455f-b987-357e54889848 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:18.292812 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-8ba424e5-bebe-455f-b987-357e54889848 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 02:29:18.292812 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:18.292812 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:18.292812 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:18.292812 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:18.292812 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:18.292812 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:18.292812 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:18.292812 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:18.292812 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:18.292812 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:18.292812 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:18.292812 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:18.292812 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:18.292812 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:18.292812 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:18.293661 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:18.293661 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:18.293661 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:18.293661 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:18.293661 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:18.293661 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:18.293661 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:18.293661 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:18.293661 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:18.293661 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:18.293661 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:18.293661 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:18.293661 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:18.293661 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:18.293661 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:18.293661 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:18.294387 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:18.294387 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:18.294387 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:18.294387 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:18.294387 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:18.294387 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:18.294387 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:18.294387 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:18.294387 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:18.294387 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:18.294387 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 02:29:18.294387 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:29:18.294387 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 49/107] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:29:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:29:18.295865 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac2acc-1fa4-40e7-9abc-161850f8863e None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:18.295865 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac2acc-1fa4-40e7-9abc-161850f8863e None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:18.295865 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac2acc-1fa4-40e7-9abc-161850f8863e None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:18.297211 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 50/108] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:18.298075 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f987c3b-8665-462f-b239-297a8b40db16 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:18.298360 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f987c3b-8665-462f-b239-297a8b40db16 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:18.298637 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f987c3b-8665-462f-b239-297a8b40db16 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:18.303158 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 51/109] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:18.303158 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f987c3b-8665-462f-b239-297a8b40db16 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:18.344133 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90760555-3a81-41a5-8ecc-7f1546f7a244 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:18.379381 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359d810-6dca-4504-99f7-34408fc596b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:18.379965 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359d810-6dca-4504-99f7-34408fc596b8 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:18.380252 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359d810-6dca-4504-99f7-34408fc596b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:18.380537 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359d810-6dca-4504-99f7-34408fc596b8 None admin] PATH_INFO: `/v3/projects/4e2cf55519e4431b85bdc27977f9165d` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:18.381705 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e359d810-6dca-4504-99f7-34408fc596b8 None admin] RBAC: Authorizing `identity:get_project(project_id=4e2cf55519e4431b85bdc27977f9165d)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:18.383702 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e359d810-6dca-4504-99f7-34408fc596b8 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:18.385533 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 59/110] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:29:18 2022] GET /identity/v3/projects/4e2cf55519e4431b85bdc27977f9165d => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:18.386187 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359d810-6dca-4504-99f7-34408fc596b8 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:18.391081 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:18.425794 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f987c3b-8665-462f-b239-297a8b40db16 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:18.454716 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:18.462147 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093e722-2ee0-46f9-80ab-17fb4807ef37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:18.462793 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093e722-2ee0-46f9-80ab-17fb4807ef37 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:18.463103 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093e722-2ee0-46f9-80ab-17fb4807ef37 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:18.463385 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093e722-2ee0-46f9-80ab-17fb4807ef37 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:18.473348 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1093e722-2ee0-46f9-80ab-17fb4807ef37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:18.478961 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-1093e722-2ee0-46f9-80ab-17fb4807ef37 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:29:18.478961 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:18.478961 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:18.478961 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:18.478961 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:18.478961 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:18.478961 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:18.478961 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:18.478961 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:18.478961 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:18.478961 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:18.478961 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:18.478961 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:18.478961 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:18.478961 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:18.478961 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:18.479801 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:18.479801 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:18.479801 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:18.479801 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:18.479801 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:18.479801 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:18.479801 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:18.479801 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:18.479801 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:18.479801 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:18.479801 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:18.479801 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:18.479801 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:18.479801 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:18.479801 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:18.479801 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:18.480580 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:18.480580 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:18.480580 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:18.480580 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:18.480580 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:18.480580 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:18.480580 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:18.480580 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:18.480580 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:18.480580 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:18.480580 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:29:18.480580 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:29:18.480580 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 52/111] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 5 02:29:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:29:18.481352 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2ce85-33d5-4b3c-8c4a-4a9fdfa2826a None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:18.481694 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2ce85-33d5-4b3c-8c4a-4a9fdfa2826a None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:18.481919 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2ce85-33d5-4b3c-8c4a-4a9fdfa2826a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:18.488252 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359d810-6dca-4504-99f7-34408fc596b8 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:18.499328 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-4fb2ce85-33d5-4b3c-8c4a-4a9fdfa2826a None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:18.500504 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-4fb2ce85-33d5-4b3c-8c4a-4a9fdfa2826a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:18.530804 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8949c-304e-49c4-91dc-4fbbf4382ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:18.531466 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8949c-304e-49c4-91dc-4fbbf4382ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:18.531753 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8949c-304e-49c4-91dc-4fbbf4382ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:18.532032 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8949c-304e-49c4-91dc-4fbbf4382ac5 None admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:18.532755 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f8949c-304e-49c4-91dc-4fbbf4382ac5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:18.533062 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f8949c-304e-49c4-91dc-4fbbf4382ac5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:18.534485 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f8949c-304e-49c4-91dc-4fbbf4382ac5 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:18.542829 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 60/112] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 5 02:29:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:18.547532 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599d43c-f4f3-4698-af24-65bfd32b2e7d None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:18.547532 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599d43c-f4f3-4698-af24-65bfd32b2e7d None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:18.547532 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599d43c-f4f3-4698-af24-65bfd32b2e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:18.562812 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-9599d43c-f4f3-4698-af24-65bfd32b2e7d None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:18.564019 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-9599d43c-f4f3-4698-af24-65bfd32b2e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:18.573083 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 53/113] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:29:18.573905 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2ce85-33d5-4b3c-8c4a-4a9fdfa2826a None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:18.638181 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 61/114] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:29:18.638358 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:18.639796 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f5ae9-2886-41ff-8c2d-fb912e3f9a4b None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:18.640241 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f5ae9-2886-41ff-8c2d-fb912e3f9a4b None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:18.640524 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f5ae9-2886-41ff-8c2d-fb912e3f9a4b None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:18.641942 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 62/115] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:18.642479 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f5ae9-2886-41ff-8c2d-fb912e3f9a4b None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:18.682046 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2ce85-33d5-4b3c-8c4a-4a9fdfa2826a None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:18.704045 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:18.715715 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc0eab-790c-4d9d-b8eb-89d3132ed6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:18.716398 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc0eab-790c-4d9d-b8eb-89d3132ed6ce None admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:18.716689 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc0eab-790c-4d9d-b8eb-89d3132ed6ce None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:18.716974 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc0eab-790c-4d9d-b8eb-89d3132ed6ce None admin] PATH_INFO: `/v3/projects/4e2cf55519e4431b85bdc27977f9165d/users/ff4872f4d7ca4f069406cc8c9ff750f7/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:18.719051 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abc0eab-790c-4d9d-b8eb-89d3132ed6ce None admin] RBAC: Authorizing `identity:create_grant(project_id=4e2cf55519e4431b85bdc27977f9165d, user_id=ff4872f4d7ca4f069406cc8c9ff750f7, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:18.720522 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abc0eab-790c-4d9d-b8eb-89d3132ed6ce None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:18.744637 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f5ae9-2886-41ff-8c2d-fb912e3f9a4b None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:18.777083 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ddf26e-6fe5-45b0-bfdf-6b706c5ffe0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:18.777692 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddf26e-6fe5-45b0-bfdf-6b706c5ffe0b None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:18.777976 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddf26e-6fe5-45b0-bfdf-6b706c5ffe0b None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:18.778250 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddf26e-6fe5-45b0-bfdf-6b706c5ffe0b None admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:18.779035 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ddf26e-6fe5-45b0-bfdf-6b706c5ffe0b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:18.779340 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ddf26e-6fe5-45b0-bfdf-6b706c5ffe0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:18.782372 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ddf26e-6fe5-45b0-bfdf-6b706c5ffe0b None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:18.788783 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 63/116] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:29:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:18.789580 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ddf26e-6fe5-45b0-bfdf-6b706c5ffe0b None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:18.805613 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 54/117] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 5 02:29:18 2022] PUT /identity/v3/projects/4e2cf55519e4431b85bdc27977f9165d/users/ff4872f4d7ca4f069406cc8c9ff750f7/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:29:18.806551 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc0eab-790c-4d9d-b8eb-89d3132ed6ce None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:18.922792 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ddf26e-6fe5-45b0-bfdf-6b706c5ffe0b None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:18.949748 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:18.950690 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc0eab-790c-4d9d-b8eb-89d3132ed6ce None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:18.967603 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8e6de-461f-452f-95a4-3f3a102c5ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:18.968268 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8e6de-461f-452f-95a4-3f3a102c5ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:18.968590 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8e6de-461f-452f-95a4-3f3a102c5ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:18.968843 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8e6de-461f-452f-95a4-3f3a102c5ea7 None admin] PATH_INFO: `/v3/users/753cfdaad96942258c292c2bc5904853` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:18.978330 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:18.985315 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d8e6de-461f-452f-95a4-3f3a102c5ea7 None admin] RBAC: Authorizing `identity:get_user(user_id=753cfdaad96942258c292c2bc5904853)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:18.987041 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d8e6de-461f-452f-95a4-3f3a102c5ea7 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:18.988886 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 64/118] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:29:18 2022] GET /identity/v3/users/753cfdaad96942258c292c2bc5904853 => generated 289 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:18.990275 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d842dff-35dd-4814-8abd-2ab4a0864f92 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:18.990703 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d842dff-35dd-4814-8abd-2ab4a0864f92 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:18.995445 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f60cfe-d059-41be-baa4-51494352bace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:18.995445 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f60cfe-d059-41be-baa4-51494352bace None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:18.995445 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f60cfe-d059-41be-baa4-51494352bace None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:18.995445 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f60cfe-d059-41be-baa4-51494352bace None admin] PATH_INFO: `/v3/roles/member` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:18.995767 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d842dff-35dd-4814-8abd-2ab4a0864f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:19.008527 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f60cfe-d059-41be-baa4-51494352bace None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:19.014112 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-b9f60cfe-d059-41be-baa4-51494352bace None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:29:19.014112 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:19.014112 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:19.014112 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:19.014112 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:19.014112 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:19.014112 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:19.014112 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:19.014112 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:19.014112 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:19.014112 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:19.014112 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:19.014112 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:19.014112 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:19.014112 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:19.014112 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:19.018500 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:19.018500 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:19.018500 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:19.018500 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:19.018500 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:19.018500 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:19.018500 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:19.018500 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:19.018500 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:19.018500 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:19.018500 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:19.018500 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:19.018500 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:19.018500 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:19.018500 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:19.018500 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:19.019477 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:19.019477 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:19.019477 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:19.019477 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:19.019477 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:19.019477 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:19.019477 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:19.019477 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:19.019477 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:19.019477 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:19.019477 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:29:19.019477 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:29:19.020273 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-6d842dff-35dd-4814-8abd-2ab4a0864f92 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:19.020361 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 55/119] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:29:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:29:19.020427 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-6d842dff-35dd-4814-8abd-2ab4a0864f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:19.020490 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f60cfe-d059-41be-baa4-51494352bace None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:19.091932 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 65/120] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:29:19.098260 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d842dff-35dd-4814-8abd-2ab4a0864f92 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:19.124075 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f60cfe-d059-41be-baa4-51494352bace None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:19.162633 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370fea0-eb3a-43b8-8a1b-253db40475cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:19.163766 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370fea0-eb3a-43b8-8a1b-253db40475cf None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:19.164053 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370fea0-eb3a-43b8-8a1b-253db40475cf None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:19.164331 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370fea0-eb3a-43b8-8a1b-253db40475cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:19.176012 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1370fea0-eb3a-43b8-8a1b-253db40475cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:19.182301 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-1370fea0-eb3a-43b8-8a1b-253db40475cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:29:19.182301 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:19.182301 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:19.182301 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:19.182301 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:19.182301 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:19.182301 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:19.182301 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:19.182301 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:19.182301 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:19.182301 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:19.182301 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:19.182301 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:19.182301 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:19.182301 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:19.182301 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:19.183289 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:19.183289 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:19.183289 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:19.183289 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:19.183289 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:19.183289 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:19.183289 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:19.183289 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:19.183289 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:19.183289 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:19.183289 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:19.183289 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:19.183289 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:19.183289 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:19.183289 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:19.183289 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:19.184076 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:19.184076 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:19.184076 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:19.184076 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:19.184076 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:19.184076 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:19.184076 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:19.184076 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:19.184076 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:19.184076 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:19.184076 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:29:19.184076 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:29:19.184076 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 56/121] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 5 02:29:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:29:19.184697 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370fea0-eb3a-43b8-8a1b-253db40475cf None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:19.215408 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d842dff-35dd-4814-8abd-2ab4a0864f92 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:19.228792 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:19.230045 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:19.251964 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32105699-3b53-4d9b-ada7-85d16e93f8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:19.252618 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32105699-3b53-4d9b-ada7-85d16e93f8f7 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:19.253236 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32105699-3b53-4d9b-ada7-85d16e93f8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:19.253350 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32105699-3b53-4d9b-ada7-85d16e93f8f7 None admin] PATH_INFO: `/v3/users/ff4872f4d7ca4f069406cc8c9ff750f7` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:19.255429 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32105699-3b53-4d9b-ada7-85d16e93f8f7 None admin] RBAC: Authorizing `identity:get_user(user_id=ff4872f4d7ca4f069406cc8c9ff750f7)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:19.258230 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32105699-3b53-4d9b-ada7-85d16e93f8f7 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:19.268109 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 66/122] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:29:19 2022] GET /identity/v3/users/ff4872f4d7ca4f069406cc8c9ff750f7 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:19.268109 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32105699-3b53-4d9b-ada7-85d16e93f8f7 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:19.313306 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370fea0-eb3a-43b8-8a1b-253db40475cf None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:19.348215 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4003aef-b91c-4609-a160-652debd30738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:19.348844 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4003aef-b91c-4609-a160-652debd30738 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:19.349175 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4003aef-b91c-4609-a160-652debd30738 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:19.349550 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4003aef-b91c-4609-a160-652debd30738 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:19.381010 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32105699-3b53-4d9b-ada7-85d16e93f8f7 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:19.419584 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4003aef-b91c-4609-a160-652debd30738 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:19.420717 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7c8d3-cb6e-4724-b5d9-b8a5f4b285e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:19.421196 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4003aef-b91c-4609-a160-652debd30738 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:19.421362 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7c8d3-cb6e-4724-b5d9-b8a5f4b285e9 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:19.421620 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7c8d3-cb6e-4724-b5d9-b8a5f4b285e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:19.421895 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7c8d3-cb6e-4724-b5d9-b8a5f4b285e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:19.422604 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e7c8d3-cb6e-4724-b5d9-b8a5f4b285e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:19.422913 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e7c8d3-cb6e-4724-b5d9-b8a5f4b285e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:19.424309 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e7c8d3-cb6e-4724-b5d9-b8a5f4b285e9 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:19.432818 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 67/123] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 5 02:29:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:19.435856 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7c8d3-cb6e-4724-b5d9-b8a5f4b285e9 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:19.464943 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:19.489714 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:19.525672 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 57/124] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:29:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:29:19.526436 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4003aef-b91c-4609-a160-652debd30738 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:19.559413 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7c8d3-cb6e-4724-b5d9-b8a5f4b285e9 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:19.596435 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca2ba0-5671-4c0f-8039-9deeb99d7270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:19.597079 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca2ba0-5671-4c0f-8039-9deeb99d7270 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:19.597364 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca2ba0-5671-4c0f-8039-9deeb99d7270 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:19.597640 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca2ba0-5671-4c0f-8039-9deeb99d7270 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:19.598791 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ca2ba0-5671-4c0f-8039-9deeb99d7270 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:19.600281 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ca2ba0-5671-4c0f-8039-9deeb99d7270 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:19.606945 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 68/125] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:29:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:19.606945 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca2ba0-5671-4c0f-8039-9deeb99d7270 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:19.632598 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4003aef-b91c-4609-a160-652debd30738 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:19.667637 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086f075-66e4-4c07-86db-202634124bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:19.668267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086f075-66e4-4c07-86db-202634124bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:19.668554 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086f075-66e4-4c07-86db-202634124bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:19.668829 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086f075-66e4-4c07-86db-202634124bf9 None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:19.669546 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c086f075-66e4-4c07-86db-202634124bf9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:19.669853 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c086f075-66e4-4c07-86db-202634124bf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:19.671285 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c086f075-66e4-4c07-86db-202634124bf9 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:19.679436 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 58/126] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:29:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:19.680053 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086f075-66e4-4c07-86db-202634124bf9 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:19.682621 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:19.706207 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca2ba0-5671-4c0f-8039-9deeb99d7270 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:19.715688 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:19.741785 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b49c6eb-b4a6-46d0-bf64-44d9f41b8381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:19.742428 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49c6eb-b4a6-46d0-bf64-44d9f41b8381 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:19.742716 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49c6eb-b4a6-46d0-bf64-44d9f41b8381 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:19.743015 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49c6eb-b4a6-46d0-bf64-44d9f41b8381 None admin] PATH_INFO: `/v3/projects/4e2cf55519e4431b85bdc27977f9165d` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:19.744416 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b49c6eb-b4a6-46d0-bf64-44d9f41b8381 None admin] RBAC: Authorizing `identity:get_project(project_id=4e2cf55519e4431b85bdc27977f9165d)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:19.745870 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b49c6eb-b4a6-46d0-bf64-44d9f41b8381 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:19.752384 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 69/127] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:29:19 2022] GET /identity/v3/projects/4e2cf55519e4431b85bdc27977f9165d => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:19.752384 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b49c6eb-b4a6-46d0-bf64-44d9f41b8381 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:19.788778 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086f075-66e4-4c07-86db-202634124bf9 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:19.823543 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49fcd9-6d41-4824-9fcb-c288c8f4960f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:19.824189 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49fcd9-6d41-4824-9fcb-c288c8f4960f None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:19.824477 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49fcd9-6d41-4824-9fcb-c288c8f4960f None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:19.824755 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49fcd9-6d41-4824-9fcb-c288c8f4960f None admin] PATH_INFO: `/v3/users/ff4872f4d7ca4f069406cc8c9ff750f7` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:19.826702 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49fcd9-6d41-4824-9fcb-c288c8f4960f None admin] RBAC: Authorizing `identity:get_user(user_id=ff4872f4d7ca4f069406cc8c9ff750f7)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:19.828399 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49fcd9-6d41-4824-9fcb-c288c8f4960f None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:19.834314 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 59/128] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:29:19 2022] GET /identity/v3/users/ff4872f4d7ca4f069406cc8c9ff750f7 => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:19.834314 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49fcd9-6d41-4824-9fcb-c288c8f4960f None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:19.857737 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b49c6eb-b4a6-46d0-bf64-44d9f41b8381 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:19.893132 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea20aa6-2715-4fe6-8092-c12419f31ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:19.893780 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea20aa6-2715-4fe6-8092-c12419f31ce1 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:19.894085 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea20aa6-2715-4fe6-8092-c12419f31ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:19.894349 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea20aa6-2715-4fe6-8092-c12419f31ce1 None admin] PATH_INFO: `/v3/projects/4e2cf55519e4431b85bdc27977f9165d` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:19.895538 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea20aa6-2715-4fe6-8092-c12419f31ce1 None admin] RBAC: Authorizing `identity:get_project(project_id=4e2cf55519e4431b85bdc27977f9165d)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:19.896999 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea20aa6-2715-4fe6-8092-c12419f31ce1 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:19.899254 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 70/129] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:29:19 2022] GET /identity/v3/projects/4e2cf55519e4431b85bdc27977f9165d => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:19.904796 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea20aa6-2715-4fe6-8092-c12419f31ce1 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:19.907478 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:19.940888 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49fcd9-6d41-4824-9fcb-c288c8f4960f None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:19.952937 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:19.977321 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed37293-9483-4aac-9c9b-f95e86c2f7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:19.977963 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed37293-9483-4aac-9c9b-f95e86c2f7b5 None admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:19.978345 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed37293-9483-4aac-9c9b-f95e86c2f7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:19.978629 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed37293-9483-4aac-9c9b-f95e86c2f7b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:19.979356 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed37293-9483-4aac-9c9b-f95e86c2f7b5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:19.980827 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed37293-9483-4aac-9c9b-f95e86c2f7b5 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:20.008393 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea20aa6-2715-4fe6-8092-c12419f31ce1 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:20.040852 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c30e0b0-4f42-4bad-9367-3c61b0ec2d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:20.041496 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30e0b0-4f42-4bad-9367-3c61b0ec2d4d None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:20.041781 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30e0b0-4f42-4bad-9367-3c61b0ec2d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:20.042060 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30e0b0-4f42-4bad-9367-3c61b0ec2d4d None admin] PATH_INFO: `/v3/users/9858bbeee69c4062a3e73bac3fef2908` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:20.043245 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c30e0b0-4f42-4bad-9367-3c61b0ec2d4d None admin] RBAC: Authorizing `identity:get_user(user_id=9858bbeee69c4062a3e73bac3fef2908)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:20.044713 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c30e0b0-4f42-4bad-9367-3c61b0ec2d4d None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:20.046304 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 71/130] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:29:19 2022] GET /identity/v3/users/9858bbeee69c4062a3e73bac3fef2908 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:20.047069 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c30e0b0-4f42-4bad-9367-3c61b0ec2d4d None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:20.070039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 60/131] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Aug 5 02:29:19 2022] POST /identity/v3/projects => generated 302 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:29:20.071182 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed37293-9483-4aac-9c9b-f95e86c2f7b5 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:20.168728 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c30e0b0-4f42-4bad-9367-3c61b0ec2d4d None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:20.184582 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:20.207196 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed37293-9483-4aac-9c9b-f95e86c2f7b5 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:20.207604 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f20119-c4de-411f-908a-88cb0ef6b74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:20.208301 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f20119-c4de-411f-908a-88cb0ef6b74a None admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:20.208592 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f20119-c4de-411f-908a-88cb0ef6b74a None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:20.208879 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f20119-c4de-411f-908a-88cb0ef6b74a None admin] PATH_INFO: `/v3/projects/4e2cf55519e4431b85bdc27977f9165d/users/ff4872f4d7ca4f069406cc8c9ff750f7/roles/428314713da6487e8047a1f333265cda` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:20.211444 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f20119-c4de-411f-908a-88cb0ef6b74a None admin] RBAC: Authorizing `identity:create_grant(project_id=4e2cf55519e4431b85bdc27977f9165d, user_id=ff4872f4d7ca4f069406cc8c9ff750f7, role_id=428314713da6487e8047a1f333265cda)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:20.212956 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f20119-c4de-411f-908a-88cb0ef6b74a None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:20.237374 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:20.250707 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb1331-d6bd-4315-bbcf-e0e233e40299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:20.251391 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb1331-d6bd-4315-bbcf-e0e233e40299 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:20.251678 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb1331-d6bd-4315-bbcf-e0e233e40299 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:20.257597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb1331-d6bd-4315-bbcf-e0e233e40299 None admin] PATH_INFO: `/v3/projects/203913d69590486f96944248d10475c5` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:20.257597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb1331-d6bd-4315-bbcf-e0e233e40299 None admin] RBAC: Authorizing `identity:get_project(project_id=203913d69590486f96944248d10475c5)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:20.257597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb1331-d6bd-4315-bbcf-e0e233e40299 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:20.257597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 61/132] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:29:20 2022] GET /identity/v3/projects/203913d69590486f96944248d10475c5 => generated 312 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:20.257597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb1331-d6bd-4315-bbcf-e0e233e40299 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:20.309804 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 72/133] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 5 02:29:20 2022] PUT /identity/v3/projects/4e2cf55519e4431b85bdc27977f9165d/users/ff4872f4d7ca4f069406cc8c9ff750f7/roles/428314713da6487e8047a1f333265cda => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:29:20.310420 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f20119-c4de-411f-908a-88cb0ef6b74a None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:20.389115 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb1331-d6bd-4315-bbcf-e0e233e40299 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:20.435310 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42789a58-0d04-4d15-8518-cc5c28559ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:20.435977 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42789a58-0d04-4d15-8518-cc5c28559ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:20.436230 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42789a58-0d04-4d15-8518-cc5c28559ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:20.436519 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42789a58-0d04-4d15-8518-cc5c28559ed6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:20.437658 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42789a58-0d04-4d15-8518-cc5c28559ed6 None admin] RBAC: Adding query filter params (role.id=d1d918bf6fa5478e8535ec7f1efa8e0c, scope.project.id=4e2cf55519e4431b85bdc27977f9165d, user.id=753cfdaad96942258c292c2bc5904853) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:20.437975 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42789a58-0d04-4d15-8518-cc5c28559ed6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:20.439837 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42789a58-0d04-4d15-8518-cc5c28559ed6 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:20.447591 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 62/134] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:29:20 2022] GET /identity/v3/role_assignments?user.id=753cfdaad96942258c292c2bc5904853&scope.project.id=4e2cf55519e4431b85bdc27977f9165d&role.id=d1d918bf6fa5478e8535ec7f1efa8e0c => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:20.448234 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42789a58-0d04-4d15-8518-cc5c28559ed6 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:20.474539 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f20119-c4de-411f-908a-88cb0ef6b74a None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:20.553469 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2a56c-e64c-433c-a236-1ffe3a1dda57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:20.554771 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2a56c-e64c-433c-a236-1ffe3a1dda57 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:20.555208 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2a56c-e64c-433c-a236-1ffe3a1dda57 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:20.555488 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2a56c-e64c-433c-a236-1ffe3a1dda57 None admin] PATH_INFO: `/v3/projects/4e2cf55519e4431b85bdc27977f9165d` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:20.556704 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2a56c-e64c-433c-a236-1ffe3a1dda57 None admin] RBAC: Authorizing `identity:get_project(project_id=4e2cf55519e4431b85bdc27977f9165d)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:20.558772 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2a56c-e64c-433c-a236-1ffe3a1dda57 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:20.560918 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 73/135] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:29:20 2022] GET /identity/v3/projects/4e2cf55519e4431b85bdc27977f9165d => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:20.567146 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2a56c-e64c-433c-a236-1ffe3a1dda57 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:20.572963 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:20.660260 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:20.690086 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42789a58-0d04-4d15-8518-cc5c28559ed6 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:20.734662 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2a56c-e64c-433c-a236-1ffe3a1dda57 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:20.755679 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5f4d8-0eb2-49c9-9e14-7fe3e1583acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:20.756444 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5f4d8-0eb2-49c9-9e14-7fe3e1583acf None admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:20.756733 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5f4d8-0eb2-49c9-9e14-7fe3e1583acf None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:20.757079 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5f4d8-0eb2-49c9-9e14-7fe3e1583acf None admin] PATH_INFO: `/v3/projects/203913d69590486f96944248d10475c5/users/ff4872f4d7ca4f069406cc8c9ff750f7/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:20.759146 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e5f4d8-0eb2-49c9-9e14-7fe3e1583acf None admin] RBAC: Authorizing `identity:create_grant(project_id=203913d69590486f96944248d10475c5, user_id=ff4872f4d7ca4f069406cc8c9ff750f7, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:20.760630 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e5f4d8-0eb2-49c9-9e14-7fe3e1583acf None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:20.785078 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b058c1-353c-4d32-b76a-36178893293d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:20.786146 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b058c1-353c-4d32-b76a-36178893293d None admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:20.786648 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b058c1-353c-4d32-b76a-36178893293d None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:20.787293 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b058c1-353c-4d32-b76a-36178893293d None admin] PATH_INFO: `/v3/projects/4e2cf55519e4431b85bdc27977f9165d/users/9858bbeee69c4062a3e73bac3fef2908/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:20.790095 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b058c1-353c-4d32-b76a-36178893293d None admin] RBAC: Authorizing `identity:create_grant(project_id=4e2cf55519e4431b85bdc27977f9165d, user_id=9858bbeee69c4062a3e73bac3fef2908, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:20.795899 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b058c1-353c-4d32-b76a-36178893293d None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:20.844309 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 63/136] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 5 02:29:20 2022] PUT /identity/v3/projects/203913d69590486f96944248d10475c5/users/ff4872f4d7ca4f069406cc8c9ff750f7/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:29:20.872545 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 74/137] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 5 02:29:20 2022] PUT /identity/v3/projects/4e2cf55519e4431b85bdc27977f9165d/users/9858bbeee69c4062a3e73bac3fef2908/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:29:21.065430 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898cb06-6100-4e5c-9283-f7cb2b082e86 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:21.065778 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898cb06-6100-4e5c-9283-f7cb2b082e86 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:21.066117 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898cb06-6100-4e5c-9283-f7cb2b082e86 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:21.067806 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 64/138] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:21.074067 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c55757-7b96-4603-b987-8241c1a06546 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:21.074651 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c55757-7b96-4603-b987-8241c1a06546 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:21.075155 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c55757-7b96-4603-b987-8241c1a06546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:21.100056 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-c0c55757-7b96-4603-b987-8241c1a06546 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:21.101922 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-c0c55757-7b96-4603-b987-8241c1a06546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:21.202756 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 75/139] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:29:21.227465 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898cb06-6100-4e5c-9283-f7cb2b082e86 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:21.344639 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898cb06-6100-4e5c-9283-f7cb2b082e86 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:21.359966 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:21.381548 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c47ff3-06b5-423c-9335-24c9339be8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:21.383130 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c47ff3-06b5-423c-9335-24c9339be8d0 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:21.383902 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c47ff3-06b5-423c-9335-24c9339be8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:21.384241 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c47ff3-06b5-423c-9335-24c9339be8d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:21.395659 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c47ff3-06b5-423c-9335-24c9339be8d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:21.401367 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-22c47ff3-06b5-423c-9335-24c9339be8d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:29:21.401367 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:21.401367 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:21.401367 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:21.401367 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:21.401367 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:21.401367 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:21.401367 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:21.401367 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:21.401367 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:21.401367 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:21.401367 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:21.401367 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:21.401367 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:21.401367 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:21.401367 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:21.402248 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:21.402248 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:21.402248 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:21.402248 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:21.402248 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:21.402248 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:21.402248 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:21.402248 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:21.402248 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:21.402248 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:21.402248 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:21.402248 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:21.402248 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:21.402248 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:21.402248 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:21.402248 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:21.403014 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:21.403014 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:21.403014 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:21.403014 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:21.403014 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:21.403014 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:21.403014 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:21.403014 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:21.403014 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:21.403014 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:21.403014 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:29:21.403014 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:29:21.404164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 65/140] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:29:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:29:21.409298 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c55757-7b96-4603-b987-8241c1a06546 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:21.460312 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:21.544348 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c55757-7b96-4603-b987-8241c1a06546 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:21.592851 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae405e71-596a-4ff0-ac57-2f1407d6d2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:21.593475 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae405e71-596a-4ff0-ac57-2f1407d6d2d4 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:21.593753 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae405e71-596a-4ff0-ac57-2f1407d6d2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:21.594026 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae405e71-596a-4ff0-ac57-2f1407d6d2d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:21.594740 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae405e71-596a-4ff0-ac57-2f1407d6d2d4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:21.595070 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae405e71-596a-4ff0-ac57-2f1407d6d2d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:21.596459 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae405e71-596a-4ff0-ac57-2f1407d6d2d4 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:21.605401 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 76/141] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 5 02:29:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:21.610998 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c47ff3-06b5-423c-9335-24c9339be8d0 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:21.733911 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c47ff3-06b5-423c-9335-24c9339be8d0 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:21.772042 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339642b7-d4c7-4ca5-a15b-ef30ac9f0f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:21.772744 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339642b7-d4c7-4ca5-a15b-ef30ac9f0f22 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:21.773036 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339642b7-d4c7-4ca5-a15b-ef30ac9f0f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:21.773321 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339642b7-d4c7-4ca5-a15b-ef30ac9f0f22 None admin] PATH_INFO: `/v3/users/ff4872f4d7ca4f069406cc8c9ff750f7` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:21.774527 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339642b7-d4c7-4ca5-a15b-ef30ac9f0f22 None admin] RBAC: Authorizing `identity:get_user(user_id=ff4872f4d7ca4f069406cc8c9ff750f7)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:21.776050 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339642b7-d4c7-4ca5-a15b-ef30ac9f0f22 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:21.777973 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 66/142] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:29:21 2022] GET /identity/v3/users/ff4872f4d7ca4f069406cc8c9ff750f7 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:21.783217 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae405e71-596a-4ff0-ac57-2f1407d6d2d4 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:21.926595 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:21.937071 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae405e71-596a-4ff0-ac57-2f1407d6d2d4 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:21.983194 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15d9c4a-58e9-4ac1-bba4-e18ae9c42784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:21.983830 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d9c4a-58e9-4ac1-bba4-e18ae9c42784 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:21.984118 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d9c4a-58e9-4ac1-bba4-e18ae9c42784 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:21.984397 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d9c4a-58e9-4ac1-bba4-e18ae9c42784 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:22.064959 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15d9c4a-58e9-4ac1-bba4-e18ae9c42784 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:22.066461 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15d9c4a-58e9-4ac1-bba4-e18ae9c42784 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:22.169286 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:22.179964 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 77/143] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:29:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:29:22.185712 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339642b7-d4c7-4ca5-a15b-ef30ac9f0f22 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:22.233676 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:22.292394 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339642b7-d4c7-4ca5-a15b-ef30ac9f0f22 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:22.327565 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a31308-1517-4126-a29b-589ccffb6cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:22.328283 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a31308-1517-4126-a29b-589ccffb6cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:22.328902 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a31308-1517-4126-a29b-589ccffb6cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:22.329194 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a31308-1517-4126-a29b-589ccffb6cc9 None admin] PATH_INFO: `/v3/projects/4e2cf55519e4431b85bdc27977f9165d` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:22.330385 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a31308-1517-4126-a29b-589ccffb6cc9 None admin] RBAC: Authorizing `identity:get_project(project_id=4e2cf55519e4431b85bdc27977f9165d)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:22.331884 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a31308-1517-4126-a29b-589ccffb6cc9 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:22.333921 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 67/144] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:29:22 2022] GET /identity/v3/projects/4e2cf55519e4431b85bdc27977f9165d => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:22.340499 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15d9c4a-58e9-4ac1-bba4-e18ae9c42784 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:22.445014 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15d9c4a-58e9-4ac1-bba4-e18ae9c42784 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:22.486344 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444077ba-5286-4e44-9f37-76c5c7964487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:22.486993 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444077ba-5286-4e44-9f37-76c5c7964487 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:22.487284 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444077ba-5286-4e44-9f37-76c5c7964487 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:22.487565 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444077ba-5286-4e44-9f37-76c5c7964487 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:22.488358 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444077ba-5286-4e44-9f37-76c5c7964487 None admin] RBAC: Adding query filter params (role.id=dd9e162a1a25432d871c4c2c0ab779a5, scope.project.id=4e2cf55519e4431b85bdc27977f9165d, user.id=ff4872f4d7ca4f069406cc8c9ff750f7) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:22.488668 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444077ba-5286-4e44-9f37-76c5c7964487 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:22.490136 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444077ba-5286-4e44-9f37-76c5c7964487 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:22.499895 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 78/145] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:29:22 2022] GET /identity/v3/role_assignments?user.id=ff4872f4d7ca4f069406cc8c9ff750f7&scope.project.id=4e2cf55519e4431b85bdc27977f9165d&role.id=dd9e162a1a25432d871c4c2c0ab779a5 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:23.018890 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca7c4d-9299-4410-8978-073ca94aa218 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:23.019402 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca7c4d-9299-4410-8978-073ca94aa218 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:23.019473 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca7c4d-9299-4410-8978-073ca94aa218 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:23.020844 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 68/146] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:23.034401 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300b80d-094d-4d0b-8c89-eb7d83e427f6 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:23.034844 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300b80d-094d-4d0b-8c89-eb7d83e427f6 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:23.035061 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300b80d-094d-4d0b-8c89-eb7d83e427f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:23.055612 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-2300b80d-094d-4d0b-8c89-eb7d83e427f6 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:23.056807 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-2300b80d-094d-4d0b-8c89-eb7d83e427f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:23.127554 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:23.148857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 79/147] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:29:23.169605 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2f72a-dd35-4a89-acd1-e2ca61b9a071 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:23.169906 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2f72a-dd35-4a89-acd1-e2ca61b9a071 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:23.170201 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2f72a-dd35-4a89-acd1-e2ca61b9a071 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:23.171595 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 69/148] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:23.173403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2300b80d-094d-4d0b-8c89-eb7d83e427f6 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:23.203320 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678fbe3-e82b-45bf-a181-3b2ec9cecfa9 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:23.203620 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678fbe3-e82b-45bf-a181-3b2ec9cecfa9 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:23.203908 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678fbe3-e82b-45bf-a181-3b2ec9cecfa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:23.230913 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-d678fbe3-e82b-45bf-a181-3b2ec9cecfa9 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:23.232141 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-d678fbe3-e82b-45bf-a181-3b2ec9cecfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:23.283578 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2300b80d-094d-4d0b-8c89-eb7d83e427f6 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:23.320490 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 70/149] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:29:23.331235 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f7ffc-d011-486d-8d1b-746b7cc75acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:23.331893 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f7ffc-d011-486d-8d1b-746b7cc75acc None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:23.332170 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f7ffc-d011-486d-8d1b-746b7cc75acc None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:23.332447 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f7ffc-d011-486d-8d1b-746b7cc75acc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:23.339652 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93f7ffc-d011-486d-8d1b-746b7cc75acc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:23.341116 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93f7ffc-d011-486d-8d1b-746b7cc75acc None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:23.342737 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 80/150] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:29:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:23.348507 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678fbe3-e82b-45bf-a181-3b2ec9cecfa9 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:23.353018 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f7ffc-d011-486d-8d1b-746b7cc75acc None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:23.409704 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:23.480639 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678fbe3-e82b-45bf-a181-3b2ec9cecfa9 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:23.490531 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:23.532093 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86797c3b-e56e-4e79-88d5-41240c4b6544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:23.533120 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86797c3b-e56e-4e79-88d5-41240c4b6544 None admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:23.533601 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86797c3b-e56e-4e79-88d5-41240c4b6544 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:23.534101 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86797c3b-e56e-4e79-88d5-41240c4b6544 None admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:23.539791 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86797c3b-e56e-4e79-88d5-41240c4b6544 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:23.541289 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86797c3b-e56e-4e79-88d5-41240c4b6544 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:23.556533 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f7ffc-d011-486d-8d1b-746b7cc75acc None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:23.598630 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24a72f-db28-41f0-b8ea-8946874e153d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:23.599357 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24a72f-db28-41f0-b8ea-8946874e153d None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:23.599696 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24a72f-db28-41f0-b8ea-8946874e153d None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:23.600032 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24a72f-db28-41f0-b8ea-8946874e153d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:23.611820 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f24a72f-db28-41f0-b8ea-8946874e153d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:23.617792 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-2f24a72f-db28-41f0-b8ea-8946874e153d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:29:23.617792 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:23.617792 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:23.617792 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:23.617792 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:23.617792 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:23.617792 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:23.617792 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:23.617792 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:23.617792 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:23.617792 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:23.617792 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:23.617792 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:23.617792 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:23.617792 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:23.617792 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:23.618618 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:23.618618 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:23.618618 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:23.618618 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:23.618618 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:23.618618 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:23.618618 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:23.618618 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:23.618618 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:23.618618 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:23.618618 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:23.618618 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:23.618618 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:23.618618 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:23.618618 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:23.618618 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:23.619427 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:23.619427 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:23.619427 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:23.619427 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:23.619427 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:23.619427 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:23.619427 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:23.619427 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:23.619427 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:23.619427 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:23.619427 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:29:23.619427 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:29:23.619427 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 81/151] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 5 02:29:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:29:23.624947 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24a72f-db28-41f0-b8ea-8946874e153d None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:23.664022 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 71/152] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 5 02:29:23 2022] POST /identity/v3/users => generated 283 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:29:23.766492 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24a72f-db28-41f0-b8ea-8946874e153d None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:23.790358 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:23.812817 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951dc802-1a7f-4d0c-90e8-eca072d5006d None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:23.813122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba2ccb-c0c5-4348-88a3-ddec0c2c2cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:23.813650 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951dc802-1a7f-4d0c-90e8-eca072d5006d None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:23.813752 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba2ccb-c0c5-4348-88a3-ddec0c2c2cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:23.814002 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba2ccb-c0c5-4348-88a3-ddec0c2c2cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:23.814317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba2ccb-c0c5-4348-88a3-ddec0c2c2cc2 None admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:23.814641 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951dc802-1a7f-4d0c-90e8-eca072d5006d None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:23.815070 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba2ccb-c0c5-4348-88a3-ddec0c2c2cc2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:23.815379 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba2ccb-c0c5-4348-88a3-ddec0c2c2cc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:23.816817 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba2ccb-c0c5-4348-88a3-ddec0c2c2cc2 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:23.817018 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 72/153] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:29:23.830177 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c15ec-af70-4855-8abe-26fc30dabf4f None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:23.830385 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 82/154] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:29:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:29:23.830463 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c15ec-af70-4855-8abe-26fc30dabf4f None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:23.830733 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c15ec-af70-4855-8abe-26fc30dabf4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:23.837606 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba2ccb-c0c5-4348-88a3-ddec0c2c2cc2 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:23.857137 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-4c6c15ec-af70-4855-8abe-26fc30dabf4f None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:23.858353 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-4c6c15ec-af70-4855-8abe-26fc30dabf4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:23.949235 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 73/155] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:29:23.951260 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4be774-afdd-41c4-9103-19da170c8ffc None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:23.951545 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4be774-afdd-41c4-9103-19da170c8ffc None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:23.951823 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4be774-afdd-41c4-9103-19da170c8ffc None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:23.953501 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 74/156] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:23.958612 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb05dd-215f-49b4-99cc-ec12e9a03057 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:23.958902 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb05dd-215f-49b4-99cc-ec12e9a03057 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:23.959208 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb05dd-215f-49b4-99cc-ec12e9a03057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:23.980607 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-35bb05dd-215f-49b4-99cc-ec12e9a03057 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:23.981813 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-35bb05dd-215f-49b4-99cc-ec12e9a03057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:23.992997 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba2ccb-c0c5-4348-88a3-ddec0c2c2cc2 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:24.013193 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:24.034459 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f520547-d0fd-4749-9662-1abf8bf85675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:24.035289 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f520547-d0fd-4749-9662-1abf8bf85675 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:24.035641 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f520547-d0fd-4749-9662-1abf8bf85675 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:24.035990 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f520547-d0fd-4749-9662-1abf8bf85675 None admin] PATH_INFO: `/v3/users/ff4872f4d7ca4f069406cc8c9ff750f7` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:24.037430 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f520547-d0fd-4749-9662-1abf8bf85675 None admin] RBAC: Authorizing `identity:get_user(user_id=ff4872f4d7ca4f069406cc8c9ff750f7)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:24.039587 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f520547-d0fd-4749-9662-1abf8bf85675 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:24.044980 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 83/157] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:29:23 2022] GET /identity/v3/users/ff4872f4d7ca4f069406cc8c9ff750f7 => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:29:24.044980 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f520547-d0fd-4749-9662-1abf8bf85675 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:24.083984 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 75/158] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:29:24.086415 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb05dd-215f-49b4-99cc-ec12e9a03057 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:24.105770 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:24.177187 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f520547-d0fd-4749-9662-1abf8bf85675 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:24.204831 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb05dd-215f-49b4-99cc-ec12e9a03057 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:24.225272 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c677ec8-1072-4e59-b31e-0f8adc7cdc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:24.226221 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c677ec8-1072-4e59-b31e-0f8adc7cdc40 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:24.226657 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c677ec8-1072-4e59-b31e-0f8adc7cdc40 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:24.226940 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c677ec8-1072-4e59-b31e-0f8adc7cdc40 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:24.241943 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c677ec8-1072-4e59-b31e-0f8adc7cdc40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:24.247568 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-2c677ec8-1072-4e59-b31e-0f8adc7cdc40 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 02:29:24.247568 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:24.247568 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:24.247568 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:24.247568 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:24.247568 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:24.247568 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:24.247568 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:24.247568 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:24.247568 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:24.247568 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:24.247568 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:24.247568 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:24.247568 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:24.247568 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:24.247568 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:24.248438 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:24.248438 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:24.248438 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:24.248438 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:24.248438 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:24.248438 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:24.248438 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:24.248438 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:24.248438 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:24.248438 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:24.248438 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:24.248438 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:24.248438 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:24.248438 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:24.248438 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:24.248438 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:24.249427 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:24.249427 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:24.249427 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:24.249427 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:24.249427 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:24.249427 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:24.249427 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:24.249427 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:24.249427 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:24.249427 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:24.249427 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 02:29:24.249427 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:29:24.249427 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 84/159] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:29:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:29:24.250116 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161531d0-9d39-4f23-8071-d5d3f73fb111 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:24.250185 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a173969-feae-40a1-a913-a101847283f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:24.250269 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161531d0-9d39-4f23-8071-d5d3f73fb111 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:24.250482 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161531d0-9d39-4f23-8071-d5d3f73fb111 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:24.251591 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a173969-feae-40a1-a913-a101847283f0 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:24.251591 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a173969-feae-40a1-a913-a101847283f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:24.251591 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a173969-feae-40a1-a913-a101847283f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:24.252028 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 85/160] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:24.252734 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161531d0-9d39-4f23-8071-d5d3f73fb111 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:24.293912 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:24.351224 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a173969-feae-40a1-a913-a101847283f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:24.352628 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a173969-feae-40a1-a913-a101847283f0 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:24.393330 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161531d0-9d39-4f23-8071-d5d3f73fb111 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:24.395781 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:24.432735 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79093a-6b3c-441d-88d8-996cb54aaf7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:24.433380 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79093a-6b3c-441d-88d8-996cb54aaf7f None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:24.433663 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79093a-6b3c-441d-88d8-996cb54aaf7f None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:24.433937 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79093a-6b3c-441d-88d8-996cb54aaf7f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:24.447465 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd79093a-6b3c-441d-88d8-996cb54aaf7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:24.452557 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-dd79093a-6b3c-441d-88d8-996cb54aaf7f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:29:24.452557 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:24.452557 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:24.452557 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:24.452557 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:24.452557 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:24.452557 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:24.452557 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:24.452557 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:24.452557 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:24.452557 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:24.452557 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:24.452557 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:24.452557 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:24.452557 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:24.452557 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:24.453448 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:24.453448 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:24.453448 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:24.453448 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:24.453448 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:24.453448 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:24.453448 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:24.453448 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:24.453448 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:24.453448 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:24.453448 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:24.453448 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:24.453448 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:24.453448 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:24.453448 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:24.453448 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:24.454664 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:24.454664 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:24.454664 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:24.454664 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:24.454664 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:24.454664 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:24.454664 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:24.454664 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:24.454664 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:24.454664 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:24.454664 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:29:24.454664 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:29:24.454664 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 86/161] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:29:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:29:24.454664 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79093a-6b3c-441d-88d8-996cb54aaf7f None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:24.469957 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 76/162] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:29:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:29:24.472148 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4446d7-22aa-49a0-b8bc-ef490e4abd46 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:24.472444 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4446d7-22aa-49a0-b8bc-ef490e4abd46 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:24.472717 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4446d7-22aa-49a0-b8bc-ef490e4abd46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:24.500570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-de4446d7-22aa-49a0-b8bc-ef490e4abd46 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:24.502648 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-de4446d7-22aa-49a0-b8bc-ef490e4abd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:24.567815 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:24.583776 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79093a-6b3c-441d-88d8-996cb54aaf7f None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:24.591698 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 77/163] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:29:24.593182 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4446d7-22aa-49a0-b8bc-ef490e4abd46 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:24.638739 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1389cc1-fa7f-4af9-85ae-edb3b99534c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:24.639325 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1389cc1-fa7f-4af9-85ae-edb3b99534c1 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:24.639606 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1389cc1-fa7f-4af9-85ae-edb3b99534c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:24.639878 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1389cc1-fa7f-4af9-85ae-edb3b99534c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:24.640654 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1389cc1-fa7f-4af9-85ae-edb3b99534c1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:24.640996 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1389cc1-fa7f-4af9-85ae-edb3b99534c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:24.642505 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1389cc1-fa7f-4af9-85ae-edb3b99534c1 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:24.663018 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 87/164] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 5 02:29:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:24.663018 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1389cc1-fa7f-4af9-85ae-edb3b99534c1 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:24.703918 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:24.710754 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4446d7-22aa-49a0-b8bc-ef490e4abd46 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:24.750050 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf45ac7-5b0b-412d-982a-7548ea022824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:24.751065 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf45ac7-5b0b-412d-982a-7548ea022824 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:24.751577 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf45ac7-5b0b-412d-982a-7548ea022824 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:24.752506 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf45ac7-5b0b-412d-982a-7548ea022824 None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:24.753724 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf45ac7-5b0b-412d-982a-7548ea022824 None admin] RBAC: Adding query filter params (name=member) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:24.754236 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf45ac7-5b0b-412d-982a-7548ea022824 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:24.755957 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf45ac7-5b0b-412d-982a-7548ea022824 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:24.766915 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 78/165] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 5 02:29:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:24.768295 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf45ac7-5b0b-412d-982a-7548ea022824 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:24.839330 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:24.858523 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1389cc1-fa7f-4af9-85ae-edb3b99534c1 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:24.932454 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a378a92-c94e-46f4-9c4e-967188389dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:24.933613 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a378a92-c94e-46f4-9c4e-967188389dfc None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:24.935180 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a378a92-c94e-46f4-9c4e-967188389dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:24.936349 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a378a92-c94e-46f4-9c4e-967188389dfc None admin] PATH_INFO: `/v3/projects/4e2cf55519e4431b85bdc27977f9165d` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:24.938389 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a378a92-c94e-46f4-9c4e-967188389dfc None admin] RBAC: Authorizing `identity:get_project(project_id=4e2cf55519e4431b85bdc27977f9165d)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:24.940272 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a378a92-c94e-46f4-9c4e-967188389dfc None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:24.942306 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf45ac7-5b0b-412d-982a-7548ea022824 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:24.945740 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 88/166] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:29:24 2022] GET /identity/v3/projects/4e2cf55519e4431b85bdc27977f9165d => generated 298 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:24.947726 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a378a92-c94e-46f4-9c4e-967188389dfc None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:25.011924 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f4910f-ba69-475b-848e-bddc46c1173a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:25.012332 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4910f-ba69-475b-848e-bddc46c1173a None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:25.012626 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4910f-ba69-475b-848e-bddc46c1173a None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:25.012905 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4910f-ba69-475b-848e-bddc46c1173a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:25.047885 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f4910f-ba69-475b-848e-bddc46c1173a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:25.053457 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-f3f4910f-ba69-475b-848e-bddc46c1173a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:29:25.053457 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:25.053457 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:25.053457 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:25.053457 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:25.053457 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:25.053457 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:25.053457 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:25.053457 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:25.053457 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:25.053457 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:25.053457 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:25.053457 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:25.053457 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:25.053457 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:25.053457 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:25.054971 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:25.054971 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:25.054971 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:25.054971 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:25.054971 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:25.054971 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:25.054971 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:25.054971 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:25.054971 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:25.054971 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:25.054971 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:25.054971 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:25.054971 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:25.054971 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:25.054971 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:25.054971 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:25.056508 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:25.056508 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:25.056508 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:25.056508 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:25.056508 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:25.056508 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:25.056508 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:25.056508 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:25.056508 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:25.056508 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:25.056508 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:29:25.056508 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:29:25.056508 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 79/167] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 5 02:29:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:29:25.056508 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f4910f-ba69-475b-848e-bddc46c1173a None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:25.073435 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:25.081253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a378a92-c94e-46f4-9c4e-967188389dfc None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:25.152262 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9ca47-9f66-4021-817c-fed745f50165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:25.153272 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9ca47-9f66-4021-817c-fed745f50165 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:25.153761 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9ca47-9f66-4021-817c-fed745f50165 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:25.154182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9ca47-9f66-4021-817c-fed745f50165 None admin] PATH_INFO: `/v3/users/753cfdaad96942258c292c2bc5904853` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:25.157732 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd9ca47-9f66-4021-817c-fed745f50165 None admin] RBAC: Authorizing `identity:get_user(user_id=753cfdaad96942258c292c2bc5904853)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:25.160848 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd9ca47-9f66-4021-817c-fed745f50165 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:25.165572 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 89/168] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:29:24 2022] GET /identity/v3/users/753cfdaad96942258c292c2bc5904853 => generated 289 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:25.171373 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9ca47-9f66-4021-817c-fed745f50165 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:25.289331 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9ca47-9f66-4021-817c-fed745f50165 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:25.312912 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f4910f-ba69-475b-848e-bddc46c1173a None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:25.322330 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:25.326361 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdce1bb-fa5f-448e-8955-639ff6b273d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:25.327020 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdce1bb-fa5f-448e-8955-639ff6b273d9 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:25.327315 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdce1bb-fa5f-448e-8955-639ff6b273d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:25.328167 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdce1bb-fa5f-448e-8955-639ff6b273d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:25.328605 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdce1bb-fa5f-448e-8955-639ff6b273d9 None admin] RBAC: Adding query filter params (role.id=428314713da6487e8047a1f333265cda, scope.project.id=4e2cf55519e4431b85bdc27977f9165d, user.id=ff4872f4d7ca4f069406cc8c9ff750f7) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:25.329062 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdce1bb-fa5f-448e-8955-639ff6b273d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:25.330605 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdce1bb-fa5f-448e-8955-639ff6b273d9 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:25.337567 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 90/169] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:29:25 2022] GET /identity/v3/role_assignments?user.id=ff4872f4d7ca4f069406cc8c9ff750f7&scope.project.id=4e2cf55519e4431b85bdc27977f9165d&role.id=428314713da6487e8047a1f333265cda => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:25.338555 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdce1bb-fa5f-448e-8955-639ff6b273d9 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:25.384387 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27964f59-a256-449a-bb9e-ab5741a5b2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:25.385051 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:25.385158 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27964f59-a256-449a-bb9e-ab5741a5b2cf None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:25.385347 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27964f59-a256-449a-bb9e-ab5741a5b2cf None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:25.385624 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27964f59-a256-449a-bb9e-ab5741a5b2cf None admin] PATH_INFO: `/v3/users/ff4872f4d7ca4f069406cc8c9ff750f7` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:25.386844 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27964f59-a256-449a-bb9e-ab5741a5b2cf None admin] RBAC: Authorizing `identity:get_user(user_id=ff4872f4d7ca4f069406cc8c9ff750f7)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:25.388358 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27964f59-a256-449a-bb9e-ab5741a5b2cf None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:25.390017 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 80/170] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:29:25 2022] GET /identity/v3/users/ff4872f4d7ca4f069406cc8c9ff750f7 => generated 275 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:25.390821 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27964f59-a256-449a-bb9e-ab5741a5b2cf None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:25.462887 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdce1bb-fa5f-448e-8955-639ff6b273d9 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:25.518595 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c121e263-4bc0-499c-8d44-14700dbe99a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:25.519332 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121e263-4bc0-499c-8d44-14700dbe99a2 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:25.519622 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121e263-4bc0-499c-8d44-14700dbe99a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:25.519952 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121e263-4bc0-499c-8d44-14700dbe99a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:25.520703 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c121e263-4bc0-499c-8d44-14700dbe99a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:25.521015 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c121e263-4bc0-499c-8d44-14700dbe99a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:25.523108 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c121e263-4bc0-499c-8d44-14700dbe99a2 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:25.539817 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 91/171] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:29:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:25.540601 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c121e263-4bc0-499c-8d44-14700dbe99a2 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:25.644544 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:25.656247 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c121e263-4bc0-499c-8d44-14700dbe99a2 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:25.679400 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27964f59-a256-449a-bb9e-ab5741a5b2cf None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:25.696921 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c163c1-a3f9-4eeb-a980-6943bdeca3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:25.697555 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c163c1-a3f9-4eeb-a980-6943bdeca3a3 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:25.697843 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c163c1-a3f9-4eeb-a980-6943bdeca3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:25.698127 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c163c1-a3f9-4eeb-a980-6943bdeca3a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:25.742756 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062d6e5-1a31-4f0a-8c9f-9fb4bf65c968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:25.743494 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062d6e5-1a31-4f0a-8c9f-9fb4bf65c968 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:25.743785 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062d6e5-1a31-4f0a-8c9f-9fb4bf65c968 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:25.744068 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062d6e5-1a31-4f0a-8c9f-9fb4bf65c968 None admin] PATH_INFO: `/v3/projects/4e2cf55519e4431b85bdc27977f9165d` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:25.746441 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a062d6e5-1a31-4f0a-8c9f-9fb4bf65c968 None admin] RBAC: Authorizing `identity:get_project(project_id=4e2cf55519e4431b85bdc27977f9165d)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:25.749795 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a062d6e5-1a31-4f0a-8c9f-9fb4bf65c968 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:25.754111 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 81/172] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:29:25 2022] GET /identity/v3/projects/4e2cf55519e4431b85bdc27977f9165d => generated 298 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:25.757641 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062d6e5-1a31-4f0a-8c9f-9fb4bf65c968 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:25.829813 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c163c1-a3f9-4eeb-a980-6943bdeca3a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:25.836172 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c163c1-a3f9-4eeb-a980-6943bdeca3a3 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:25.848027 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:25.946479 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062d6e5-1a31-4f0a-8c9f-9fb4bf65c968 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:25.987419 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7cfc0e-c915-40d2-b896-ac741aa81321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:25.988099 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7cfc0e-c915-40d2-b896-ac741aa81321 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:25.988725 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7cfc0e-c915-40d2-b896-ac741aa81321 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:25.989009 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7cfc0e-c915-40d2-b896-ac741aa81321 None admin] PATH_INFO: `/v3/users/9858bbeee69c4062a3e73bac3fef2908` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:25.990495 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7cfc0e-c915-40d2-b896-ac741aa81321 None admin] RBAC: Authorizing `identity:get_user(user_id=9858bbeee69c4062a3e73bac3fef2908)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:25.992625 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7cfc0e-c915-40d2-b896-ac741aa81321 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:25.994726 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 82/173] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:29:25 2022] GET /identity/v3/users/9858bbeee69c4062a3e73bac3fef2908 => generated 247 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:25.995427 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7cfc0e-c915-40d2-b896-ac741aa81321 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:26.049976 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:26.086578 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 92/174] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:29:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:29:26.087388 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c163c1-a3f9-4eeb-a980-6943bdeca3a3 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:26.112783 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7cfc0e-c915-40d2-b896-ac741aa81321 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:26.127824 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:26.151489 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94f9be-7d8c-47b2-8aea-5ac6f470d5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:26.152601 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94f9be-7d8c-47b2-8aea-5ac6f470d5ad None admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:26.152891 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94f9be-7d8c-47b2-8aea-5ac6f470d5ad None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:26.153332 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94f9be-7d8c-47b2-8aea-5ac6f470d5ad None admin] PATH_INFO: `/v3/projects/4e2cf55519e4431b85bdc27977f9165d/users/753cfdaad96942258c292c2bc5904853/roles/d1d918bf6fa5478e8535ec7f1efa8e0c` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:26.155424 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb94f9be-7d8c-47b2-8aea-5ac6f470d5ad None admin] RBAC: Authorizing `identity:create_grant(project_id=4e2cf55519e4431b85bdc27977f9165d, user_id=753cfdaad96942258c292c2bc5904853, role_id=d1d918bf6fa5478e8535ec7f1efa8e0c)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:26.157475 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb94f9be-7d8c-47b2-8aea-5ac6f470d5ad None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:26.238356 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 83/175] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 5 02:29:25 2022] PUT /identity/v3/projects/4e2cf55519e4431b85bdc27977f9165d/users/753cfdaad96942258c292c2bc5904853/roles/d1d918bf6fa5478e8535ec7f1efa8e0c => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:29:26.239374 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94f9be-7d8c-47b2-8aea-5ac6f470d5ad None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:26.257661 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c163c1-a3f9-4eeb-a980-6943bdeca3a3 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:26.318534 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e4ef4c-6432-4479-af99-1af8e71f0809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:26.319242 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4ef4c-6432-4479-af99-1af8e71f0809 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:26.321588 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4ef4c-6432-4479-af99-1af8e71f0809 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:26.321880 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4ef4c-6432-4479-af99-1af8e71f0809 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:26.387796 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94f9be-7d8c-47b2-8aea-5ac6f470d5ad None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:26.426979 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7074af12-eb9e-4abb-897f-b51e6cf5d25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:26.426979 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074af12-eb9e-4abb-897f-b51e6cf5d25b None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:26.426979 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074af12-eb9e-4abb-897f-b51e6cf5d25b None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:26.426979 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074af12-eb9e-4abb-897f-b51e6cf5d25b None admin] PATH_INFO: `/v3/projects/203913d69590486f96944248d10475c5` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:26.429903 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7074af12-eb9e-4abb-897f-b51e6cf5d25b None admin] RBAC: Authorizing `identity:get_project(project_id=203913d69590486f96944248d10475c5)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:26.430968 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7074af12-eb9e-4abb-897f-b51e6cf5d25b None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:26.432920 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 84/176] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:29:26 2022] GET /identity/v3/projects/203913d69590486f96944248d10475c5 => generated 312 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:26.436972 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20677d8-a842-44e4-bc13-4cec74d4951a None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:26.437255 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20677d8-a842-44e4-bc13-4cec74d4951a None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:26.437536 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20677d8-a842-44e4-bc13-4cec74d4951a None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:26.440437 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 85/177] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:26.448098 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20677d8-a842-44e4-bc13-4cec74d4951a None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:26.453734 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:26.470971 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e4ef4c-6432-4479-af99-1af8e71f0809 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:26.472504 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e4ef4c-6432-4479-af99-1af8e71f0809 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:26.527634 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:26.601034 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20677d8-a842-44e4-bc13-4cec74d4951a None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:26.628753 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 93/178] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:29:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:29:26.639069 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08b2a7-87ef-4859-b95a-474e242a6d2b None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:26.639235 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3fef0-58f9-41c2-a435-be91cd6e991c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:26.639451 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08b2a7-87ef-4859-b95a-474e242a6d2b None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:26.639555 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3fef0-58f9-41c2-a435-be91cd6e991c None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:26.639703 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08b2a7-87ef-4859-b95a-474e242a6d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:26.639791 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3fef0-58f9-41c2-a435-be91cd6e991c None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:26.640043 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3fef0-58f9-41c2-a435-be91cd6e991c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:26.640850 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c3fef0-58f9-41c2-a435-be91cd6e991c None admin] RBAC: Adding query filter params (role.id=dd9e162a1a25432d871c4c2c0ab779a5, scope.project.id=203913d69590486f96944248d10475c5, user.id=ff4872f4d7ca4f069406cc8c9ff750f7) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:26.641163 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c3fef0-58f9-41c2-a435-be91cd6e991c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:26.642629 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c3fef0-58f9-41c2-a435-be91cd6e991c None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:26.649472 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 86/179] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:29:26 2022] GET /identity/v3/role_assignments?user.id=ff4872f4d7ca4f069406cc8c9ff750f7&scope.project.id=203913d69590486f96944248d10475c5&role.id=dd9e162a1a25432d871c4c2c0ab779a5 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:26.650769 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e53a6-1bec-4113-ae53-7637afc230c3 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:26.651090 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e53a6-1bec-4113-ae53-7637afc230c3 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:26.651372 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e53a6-1bec-4113-ae53-7637afc230c3 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:26.652604 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 87/180] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:26.653606 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e53a6-1bec-4113-ae53-7637afc230c3 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:26.661559 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-af08b2a7-87ef-4859-b95a-474e242a6d2b None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:26.662863 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-af08b2a7-87ef-4859-b95a-474e242a6d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:26.775101 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e53a6-1bec-4113-ae53-7637afc230c3 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:26.778012 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:26.814541 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7766bee-fe99-413c-91d1-53669dff19ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:26.814541 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7766bee-fe99-413c-91d1-53669dff19ed None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:26.814541 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7766bee-fe99-413c-91d1-53669dff19ed None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:26.814987 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7766bee-fe99-413c-91d1-53669dff19ed None admin] PATH_INFO: `/v3/projects/4e2cf55519e4431b85bdc27977f9165d` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:26.816910 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7766bee-fe99-413c-91d1-53669dff19ed None admin] RBAC: Authorizing `identity:get_project(project_id=4e2cf55519e4431b85bdc27977f9165d)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:26.817462 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7766bee-fe99-413c-91d1-53669dff19ed None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:26.819607 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 88/181] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:29:26 2022] GET /identity/v3/projects/4e2cf55519e4431b85bdc27977f9165d => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:26.820853 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b0233-390d-4bf2-82b1-c41467ef4333 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:26.821139 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b0233-390d-4bf2-82b1-c41467ef4333 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:26.821416 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b0233-390d-4bf2-82b1-c41467ef4333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:26.849007 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-279b0233-390d-4bf2-82b1-c41467ef4333 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:26.850303 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-279b0233-390d-4bf2-82b1-c41467ef4333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:26.862582 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 94/182] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:29:26.863301 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08b2a7-87ef-4859-b95a-474e242a6d2b None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:26.899434 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:26.924329 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 89/183] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:29:26.925193 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b0233-390d-4bf2-82b1-c41467ef4333 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:27.001304 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08b2a7-87ef-4859-b95a-474e242a6d2b None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:27.045008 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a387bdc-05ce-4833-b701-ab590510e241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:27.045640 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a387bdc-05ce-4833-b701-ab590510e241 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:27.045922 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a387bdc-05ce-4833-b701-ab590510e241 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:27.046199 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a387bdc-05ce-4833-b701-ab590510e241 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:27.047025 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a387bdc-05ce-4833-b701-ab590510e241 None admin] RBAC: Adding query filter params (role.id=83afe883a303495b966480fb9b5bb7dd, scope.project.id=4e2cf55519e4431b85bdc27977f9165d, user.id=9858bbeee69c4062a3e73bac3fef2908) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:27.047338 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a387bdc-05ce-4833-b701-ab590510e241 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:27.048811 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a387bdc-05ce-4833-b701-ab590510e241 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:27.061733 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 95/184] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:29:26 2022] GET /identity/v3/role_assignments?user.id=9858bbeee69c4062a3e73bac3fef2908&scope.project.id=4e2cf55519e4431b85bdc27977f9165d&role.id=83afe883a303495b966480fb9b5bb7dd => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:27.062681 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a387bdc-05ce-4833-b701-ab590510e241 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:27.071250 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b0233-390d-4bf2-82b1-c41467ef4333 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:27.072902 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:27.118662 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e7d19-1f91-4fce-926c-4e82ab1bb279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:27.119531 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e7d19-1f91-4fce-926c-4e82ab1bb279 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:27.120210 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e7d19-1f91-4fce-926c-4e82ab1bb279 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:27.120508 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e7d19-1f91-4fce-926c-4e82ab1bb279 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:27.135776 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e7d19-1f91-4fce-926c-4e82ab1bb279 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:27.143048 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-169e7d19-1f91-4fce-926c-4e82ab1bb279 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:29:27.143048 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:27.143048 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:27.143048 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:27.143048 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:27.143048 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:27.143048 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:27.143048 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:27.143048 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:27.143048 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:27.143048 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:27.143048 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:27.143048 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:27.143048 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:27.143048 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:27.143048 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:27.144249 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:27.144249 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:27.144249 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:27.144249 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:27.144249 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:27.144249 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:27.144249 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:27.144249 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:27.144249 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:27.144249 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:27.144249 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:27.144249 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:27.144249 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:27.144249 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:27.144249 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:27.144249 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:27.145175 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:27.145175 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:27.145175 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:27.145175 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:27.145175 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:27.145175 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:27.145175 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:27.145175 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:27.145175 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:27.145175 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:27.145175 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:29:27.145175 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:29:27.145175 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 90/185] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 5 02:29:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:29:27.149079 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3cccc-a252-4a89-8a23-12ba6e0a7f97 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:27.154420 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3cccc-a252-4a89-8a23-12ba6e0a7f97 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:27.154420 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3cccc-a252-4a89-8a23-12ba6e0a7f97 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:27.154420 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 91/186] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:27.155998 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3cccc-a252-4a89-8a23-12ba6e0a7f97 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:27.192705 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:27.214375 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a387bdc-05ce-4833-b701-ab590510e241 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:27.258657 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc5c4fd-7993-472e-b139-a35b8155c948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:27.259553 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc5c4fd-7993-472e-b139-a35b8155c948 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:27.259835 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc5c4fd-7993-472e-b139-a35b8155c948 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:27.260111 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc5c4fd-7993-472e-b139-a35b8155c948 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:27.275571 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc5c4fd-7993-472e-b139-a35b8155c948 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:27.281559 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-efc5c4fd-7993-472e-b139-a35b8155c948 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:29:27.281559 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:27.281559 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:27.281559 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:27.281559 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:27.281559 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:27.281559 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:27.281559 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:27.281559 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:27.281559 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:27.281559 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:27.281559 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:27.281559 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:27.281559 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:27.281559 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:27.281559 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:27.282438 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:27.282438 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:27.282438 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:27.282438 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:27.282438 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:27.282438 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:27.282438 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:27.282438 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:27.282438 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:27.282438 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:27.282438 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:27.282438 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:27.282438 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:27.282438 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:27.282438 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:27.282438 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:27.283283 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:27.283283 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:27.283283 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:27.283283 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:27.283283 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:27.283283 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:27.283283 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:27.283283 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:27.283283 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:27.283283 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:27.283283 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:29:27.283283 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:29:27.283283 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 96/187] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 5 02:29:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:29:27.286566 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da569c19-745c-4a6e-ac2b-99e6280cb62c None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:27.286861 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da569c19-745c-4a6e-ac2b-99e6280cb62c None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:27.287180 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da569c19-745c-4a6e-ac2b-99e6280cb62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:27.304050 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3cccc-a252-4a89-8a23-12ba6e0a7f97 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:27.309682 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-da569c19-745c-4a6e-ac2b-99e6280cb62c None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:27.310887 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-da569c19-745c-4a6e-ac2b-99e6280cb62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:27.348997 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5d54f-3046-4cd2-81e8-2ba91bf823c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:27.349941 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5d54f-3046-4cd2-81e8-2ba91bf823c5 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:27.350400 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5d54f-3046-4cd2-81e8-2ba91bf823c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:27.351257 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5d54f-3046-4cd2-81e8-2ba91bf823c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:27.352203 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b5d54f-3046-4cd2-81e8-2ba91bf823c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:27.352696 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b5d54f-3046-4cd2-81e8-2ba91bf823c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:27.354280 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b5d54f-3046-4cd2-81e8-2ba91bf823c5 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:27.364674 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 92/188] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:29:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:27.365730 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5d54f-3046-4cd2-81e8-2ba91bf823c5 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:27.391527 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:27.392118 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 97/189] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:29:27.392942 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da569c19-745c-4a6e-ac2b-99e6280cb62c None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:27.468705 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:27.484347 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5d54f-3046-4cd2-81e8-2ba91bf823c5 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:27.498890 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da569c19-745c-4a6e-ac2b-99e6280cb62c None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:27.522061 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e679f-f7c8-48a4-8ae0-856e455f2c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:27.522917 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e679f-f7c8-48a4-8ae0-856e455f2c64 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:27.523398 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e679f-f7c8-48a4-8ae0-856e455f2c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:27.523699 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e679f-f7c8-48a4-8ae0-856e455f2c64 None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:27.524399 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e679f-f7c8-48a4-8ae0-856e455f2c64 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:27.524706 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e679f-f7c8-48a4-8ae0-856e455f2c64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:27.526102 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e679f-f7c8-48a4-8ae0-856e455f2c64 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:27.533819 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74362ac-095e-4ad7-a77a-5a91d825e1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:27.538843 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 93/190] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:29:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:27.538998 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74362ac-095e-4ad7-a77a-5a91d825e1b2 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:27.538998 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74362ac-095e-4ad7-a77a-5a91d825e1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:27.538998 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74362ac-095e-4ad7-a77a-5a91d825e1b2 None admin] PATH_INFO: `/v3/users/a0738a658b2b45c79656137b2b70f35c` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:27.539256 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e679f-f7c8-48a4-8ae0-856e455f2c64 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:27.552684 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74362ac-095e-4ad7-a77a-5a91d825e1b2 None admin] RBAC: Authorizing `identity:get_user(user_id=a0738a658b2b45c79656137b2b70f35c)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:27.554706 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74362ac-095e-4ad7-a77a-5a91d825e1b2 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:27.556564 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 98/191] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:29:27 2022] GET /identity/v3/users/a0738a658b2b45c79656137b2b70f35c => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:27.557184 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74362ac-095e-4ad7-a77a-5a91d825e1b2 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:27.636856 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:27.653029 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e679f-f7c8-48a4-8ae0-856e455f2c64 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:27.667499 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74362ac-095e-4ad7-a77a-5a91d825e1b2 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:27.691731 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c934e-dfee-479e-b052-dcc9e396d2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:27.692385 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c934e-dfee-479e-b052-dcc9e396d2a7 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:27.692668 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c934e-dfee-479e-b052-dcc9e396d2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:27.692948 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c934e-dfee-479e-b052-dcc9e396d2a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:27.694140 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c934e-dfee-479e-b052-dcc9e396d2a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:27.696224 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c934e-dfee-479e-b052-dcc9e396d2a7 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:27.702581 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 94/192] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:29:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:27.702581 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c934e-dfee-479e-b052-dcc9e396d2a7 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:27.703325 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:27.709051 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f469e-8f03-4ee5-88bf-684400079da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:27.713263 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f469e-8f03-4ee5-88bf-684400079da7 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:27.713263 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f469e-8f03-4ee5-88bf-684400079da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:27.713263 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f469e-8f03-4ee5-88bf-684400079da7 None admin] PATH_INFO: `/v3/users/a0738a658b2b45c79656137b2b70f35c` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:27.713263 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f469e-8f03-4ee5-88bf-684400079da7 None admin] RBAC: Authorizing `identity:get_user(user_id=a0738a658b2b45c79656137b2b70f35c)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:27.713263 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f469e-8f03-4ee5-88bf-684400079da7 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:27.719462 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 99/193] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:29:27 2022] GET /identity/v3/users/a0738a658b2b45c79656137b2b70f35c => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:27.719462 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f469e-8f03-4ee5-88bf-684400079da7 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:27.810084 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c934e-dfee-479e-b052-dcc9e396d2a7 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:27.823742 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f469e-8f03-4ee5-88bf-684400079da7 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:27.845856 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd5a52-452d-4687-85e7-5d37c01ef1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:27.846779 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd5a52-452d-4687-85e7-5d37c01ef1e0 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:27.847313 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd5a52-452d-4687-85e7-5d37c01ef1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:27.847878 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd5a52-452d-4687-85e7-5d37c01ef1e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:27.857269 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b1e55-8589-4bc3-8d6b-b4a37ceb6396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:27.857881 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b1e55-8589-4bc3-8d6b-b4a37ceb6396 None admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:27.858167 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b1e55-8589-4bc3-8d6b-b4a37ceb6396 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:27.858444 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b1e55-8589-4bc3-8d6b-b4a37ceb6396 None admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:27.859155 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896b1e55-8589-4bc3-8d6b-b4a37ceb6396 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:27.860612 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896b1e55-8589-4bc3-8d6b-b4a37ceb6396 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:27.875184 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:27.917727 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd5a52-452d-4687-85e7-5d37c01ef1e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:27.919251 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd5a52-452d-4687-85e7-5d37c01ef1e0 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:27.957822 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 100/194] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 5 02:29:27 2022] POST /identity/v3/users => generated 297 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:29:27.958814 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b1e55-8589-4bc3-8d6b-b4a37ceb6396 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:28.038684 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 95/195] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:29:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:29:28.044864 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd5a52-452d-4687-85e7-5d37c01ef1e0 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:28.046252 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:28.113621 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:28.114661 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b1e55-8589-4bc3-8d6b-b4a37ceb6396 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:28.152741 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee071d3-ff2c-45be-9fc4-6891c8920ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:28.153377 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee071d3-ff2c-45be-9fc4-6891c8920ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:28.153659 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee071d3-ff2c-45be-9fc4-6891c8920ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:28.153934 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee071d3-ff2c-45be-9fc4-6891c8920ec4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:28.171626 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd5a52-452d-4687-85e7-5d37c01ef1e0 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:28.219493 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a5c4e-c19e-48d8-ac35-3f2cf251c861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:28.220242 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a5c4e-c19e-48d8-ac35-3f2cf251c861 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:28.220957 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a5c4e-c19e-48d8-ac35-3f2cf251c861 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:28.221244 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a5c4e-c19e-48d8-ac35-3f2cf251c861 None admin] PATH_INFO: `/v3/projects/31cfb67162854a2b8231ce70ee068c46` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:28.222798 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a5c4e-c19e-48d8-ac35-3f2cf251c861 None admin] RBAC: Authorizing `identity:get_project(project_id=31cfb67162854a2b8231ce70ee068c46)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:28.224694 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a5c4e-c19e-48d8-ac35-3f2cf251c861 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:28.231710 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 96/196] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:29:28 2022] GET /identity/v3/projects/31cfb67162854a2b8231ce70ee068c46 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:29:28.233059 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a5c4e-c19e-48d8-ac35-3f2cf251c861 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:28.258276 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee071d3-ff2c-45be-9fc4-6891c8920ec4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:28.259791 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee071d3-ff2c-45be-9fc4-6891c8920ec4 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:28.335878 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:28.377816 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a5c4e-c19e-48d8-ac35-3f2cf251c861 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:28.393774 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 101/197] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:29:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:29:28.400340 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee071d3-ff2c-45be-9fc4-6891c8920ec4 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:28.414707 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:28.419679 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8fdd2-5938-4053-ad26-d4a74ce42f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:28.420562 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8fdd2-5938-4053-ad26-d4a74ce42f6b None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:28.421046 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8fdd2-5938-4053-ad26-d4a74ce42f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:28.421526 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8fdd2-5938-4053-ad26-d4a74ce42f6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:28.422758 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af8fdd2-5938-4053-ad26-d4a74ce42f6b None admin] RBAC: Adding query filter params (role.id=83afe883a303495b966480fb9b5bb7dd, scope.project.id=31cfb67162854a2b8231ce70ee068c46, user.id=a0738a658b2b45c79656137b2b70f35c) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:28.423721 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af8fdd2-5938-4053-ad26-d4a74ce42f6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:28.427948 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af8fdd2-5938-4053-ad26-d4a74ce42f6b None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:28.433391 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 97/198] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:29:28 2022] GET /identity/v3/role_assignments?user.id=a0738a658b2b45c79656137b2b70f35c&scope.project.id=31cfb67162854a2b8231ce70ee068c46&role.id=83afe883a303495b966480fb9b5bb7dd => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:28.538480 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee071d3-ff2c-45be-9fc4-6891c8920ec4 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:28.576635 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef633c-e5cd-4bab-aa87-0cc3fc45291b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:28.577312 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef633c-e5cd-4bab-aa87-0cc3fc45291b None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:28.577591 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef633c-e5cd-4bab-aa87-0cc3fc45291b None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:28.577931 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef633c-e5cd-4bab-aa87-0cc3fc45291b None admin] PATH_INFO: `/v3/projects/31cfb67162854a2b8231ce70ee068c46` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:28.579231 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef633c-e5cd-4bab-aa87-0cc3fc45291b None admin] RBAC: Authorizing `identity:get_project(project_id=31cfb67162854a2b8231ce70ee068c46)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:28.580710 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef633c-e5cd-4bab-aa87-0cc3fc45291b None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:28.582786 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 102/199] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:29:28 2022] GET /identity/v3/projects/31cfb67162854a2b8231ce70ee068c46 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:29:28.589390 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8fdd2-5938-4053-ad26-d4a74ce42f6b None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:28.598729 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176281fc-1a9e-4398-a0df-445b454db5d7 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:28.599075 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176281fc-1a9e-4398-a0df-445b454db5d7 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:28.599304 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176281fc-1a9e-4398-a0df-445b454db5d7 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:28.601531 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 103/200] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:28.608329 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015805b9-1bd2-4476-a89b-3845a0ff3138 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:28.608621 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015805b9-1bd2-4476-a89b-3845a0ff3138 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:28.608880 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015805b9-1bd2-4476-a89b-3845a0ff3138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:28.630137 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-015805b9-1bd2-4476-a89b-3845a0ff3138 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:28.631403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-015805b9-1bd2-4476-a89b-3845a0ff3138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:28.659892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:28.718102 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 104/201] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:29:28.744105 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015805b9-1bd2-4476-a89b-3845a0ff3138 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:28.753268 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8fdd2-5938-4053-ad26-d4a74ce42f6b None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:28.798612 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215d889-a449-4097-baa3-8033e34284e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:28.799616 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215d889-a449-4097-baa3-8033e34284e9 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:28.800113 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215d889-a449-4097-baa3-8033e34284e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:28.800728 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215d889-a449-4097-baa3-8033e34284e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:28.801791 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f215d889-a449-4097-baa3-8033e34284e9 None admin] RBAC: Adding query filter params (role.id=428314713da6487e8047a1f333265cda, scope.project.id=31cfb67162854a2b8231ce70ee068c46, user.id=a0738a658b2b45c79656137b2b70f35c) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:28.802317 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f215d889-a449-4097-baa3-8033e34284e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:28.804053 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f215d889-a449-4097-baa3-8033e34284e9 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:28.810653 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 98/202] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:29:28 2022] GET /identity/v3/role_assignments?user.id=a0738a658b2b45c79656137b2b70f35c&scope.project.id=31cfb67162854a2b8231ce70ee068c46&role.id=428314713da6487e8047a1f333265cda => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:28.858430 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015805b9-1bd2-4476-a89b-3845a0ff3138 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:28.894083 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f8751-ba5a-4834-9ef9-74d01ec3d5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:28.894748 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f8751-ba5a-4834-9ef9-74d01ec3d5d8 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:28.895061 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f8751-ba5a-4834-9ef9-74d01ec3d5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:28.895338 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f8751-ba5a-4834-9ef9-74d01ec3d5d8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:28.907462 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f8751-ba5a-4834-9ef9-74d01ec3d5d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:28.912410 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-d72f8751-ba5a-4834-9ef9-74d01ec3d5d8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 02:29:28.912410 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:28.912410 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:28.912410 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:28.912410 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:28.912410 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:28.912410 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:28.912410 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:28.912410 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:28.912410 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:28.912410 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:28.912410 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:28.912410 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:28.912410 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:28.912410 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:28.912410 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:28.913333 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:28.913333 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:28.913333 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:28.913333 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:28.913333 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:28.913333 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:28.913333 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:28.913333 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:28.913333 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:28.913333 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:28.913333 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:28.913333 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:28.913333 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:28.913333 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:28.913333 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:28.913333 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:28.914793 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:28.914793 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:28.914793 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:28.914793 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:28.914793 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:28.914793 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:28.914793 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:28.914793 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:28.914793 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:28.914793 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:28.914793 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 02:29:28.914793 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:29:28.914793 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 105/203] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:29:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:29:28.919906 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215d889-a449-4097-baa3-8033e34284e9 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:29.018697 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:29.084651 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215d889-a449-4097-baa3-8033e34284e9 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:29.118596 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e4de4-e0f2-42d9-a44f-e9b858d1917d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:29.119168 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e4de4-e0f2-42d9-a44f-e9b858d1917d None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:29.119457 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e4de4-e0f2-42d9-a44f-e9b858d1917d None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:29.119742 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e4de4-e0f2-42d9-a44f-e9b858d1917d None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:29.120462 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e4de4-e0f2-42d9-a44f-e9b858d1917d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:29.120766 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e4de4-e0f2-42d9-a44f-e9b858d1917d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:29.122220 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e4de4-e0f2-42d9-a44f-e9b858d1917d None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:29.130970 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 99/204] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 5 02:29:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:29.136548 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f8751-ba5a-4834-9ef9-74d01ec3d5d8 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:29.152908 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:29.250253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f8751-ba5a-4834-9ef9-74d01ec3d5d8 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:29.285613 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4365e327-3973-4726-a892-9cc28f47e70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:29.286249 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365e327-3973-4726-a892-9cc28f47e70a None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:29.286538 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365e327-3973-4726-a892-9cc28f47e70a None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:29.286810 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365e327-3973-4726-a892-9cc28f47e70a None admin] PATH_INFO: `/v3/users/753cfdaad96942258c292c2bc5904853` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:29.288583 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4365e327-3973-4726-a892-9cc28f47e70a None admin] RBAC: Authorizing `identity:get_user(user_id=753cfdaad96942258c292c2bc5904853)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:29.290259 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4365e327-3973-4726-a892-9cc28f47e70a None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:29.291887 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 106/205] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:29:29 2022] GET /identity/v3/users/753cfdaad96942258c292c2bc5904853 => generated 289 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:29.297462 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e4de4-e0f2-42d9-a44f-e9b858d1917d None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:29.458250 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e4de4-e0f2-42d9-a44f-e9b858d1917d None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:29.484846 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:29.525998 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee1bab1-3893-4ecc-9f9f-6f58e41c8cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:29.527021 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1bab1-3893-4ecc-9f9f-6f58e41c8cba None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:29.527525 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1bab1-3893-4ecc-9f9f-6f58e41c8cba None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:29.528016 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1bab1-3893-4ecc-9f9f-6f58e41c8cba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:29.630358 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee1bab1-3893-4ecc-9f9f-6f58e41c8cba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:29.632756 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee1bab1-3893-4ecc-9f9f-6f58e41c8cba None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:29.771759 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 100/206] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:29:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:29:29.777576 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4365e327-3973-4726-a892-9cc28f47e70a None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:29.913774 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:29.940045 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4365e327-3973-4726-a892-9cc28f47e70a None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:29.988344 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b10934-807f-4af2-9160-64c7ab7a56a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:29.988993 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b10934-807f-4af2-9160-64c7ab7a56a5 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:29.989272 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b10934-807f-4af2-9160-64c7ab7a56a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:29.989544 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b10934-807f-4af2-9160-64c7ab7a56a5 None admin] PATH_INFO: `/v3/projects/4e2cf55519e4431b85bdc27977f9165d` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:29.992983 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b10934-807f-4af2-9160-64c7ab7a56a5 None admin] RBAC: Authorizing `identity:get_project(project_id=4e2cf55519e4431b85bdc27977f9165d)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:29.994549 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b10934-807f-4af2-9160-64c7ab7a56a5 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:29.996341 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 107/207] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:29:29 2022] GET /identity/v3/projects/4e2cf55519e4431b85bdc27977f9165d => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:30.002302 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee1bab1-3893-4ecc-9f9f-6f58e41c8cba None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:30.025926 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:30.124460 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee1bab1-3893-4ecc-9f9f-6f58e41c8cba None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:30.169721 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3767402e-a757-4d63-a5d2-82a6d219ee84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:30.170698 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767402e-a757-4d63-a5d2-82a6d219ee84 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:30.171214 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767402e-a757-4d63-a5d2-82a6d219ee84 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:30.171707 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767402e-a757-4d63-a5d2-82a6d219ee84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:30.172715 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3767402e-a757-4d63-a5d2-82a6d219ee84 None admin] RBAC: Adding query filter params (role.id=d1d918bf6fa5478e8535ec7f1efa8e0c, scope.project.id=4e2cf55519e4431b85bdc27977f9165d, user.id=753cfdaad96942258c292c2bc5904853) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:30.173308 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3767402e-a757-4d63-a5d2-82a6d219ee84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:30.175071 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3767402e-a757-4d63-a5d2-82a6d219ee84 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:30.186207 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 101/208] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:29:30 2022] GET /identity/v3/role_assignments?user.id=753cfdaad96942258c292c2bc5904853&scope.project.id=4e2cf55519e4431b85bdc27977f9165d&role.id=d1d918bf6fa5478e8535ec7f1efa8e0c => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:30.356739 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252af036-a6d8-4a35-be99-82344bc23e14 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:30.357250 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252af036-a6d8-4a35-be99-82344bc23e14 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:30.357250 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252af036-a6d8-4a35-be99-82344bc23e14 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:30.358784 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 108/209] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:30.364801 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa400a-902d-4466-96e5-d778c1aaec81 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:30.365420 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa400a-902d-4466-96e5-d778c1aaec81 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:30.365931 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa400a-902d-4466-96e5-d778c1aaec81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:30.393746 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-eefa400a-902d-4466-96e5-d778c1aaec81 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:30.395327 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-eefa400a-902d-4466-96e5-d778c1aaec81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:30.490422 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 102/210] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:29:30.521033 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252af036-a6d8-4a35-be99-82344bc23e14 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:30.632338 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252af036-a6d8-4a35-be99-82344bc23e14 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:30.667367 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2304cb2-8b3d-46cb-8186-ac4e0a0c8aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:30.668345 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2304cb2-8b3d-46cb-8186-ac4e0a0c8aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:30.668827 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2304cb2-8b3d-46cb-8186-ac4e0a0c8aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:30.669327 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2304cb2-8b3d-46cb-8186-ac4e0a0c8aa9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:30.680608 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2304cb2-8b3d-46cb-8186-ac4e0a0c8aa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:30.685822 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-f2304cb2-8b3d-46cb-8186-ac4e0a0c8aa9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:29:30.685822 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:30.685822 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:30.685822 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:30.685822 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:30.685822 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:30.685822 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:30.685822 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:30.685822 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:30.685822 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:30.685822 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:30.685822 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:30.685822 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:30.685822 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:30.685822 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:30.685822 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:30.686708 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:30.686708 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:30.686708 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:30.686708 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:30.686708 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:30.686708 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:30.686708 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:30.686708 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:30.686708 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:30.686708 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:30.686708 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:30.686708 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:30.686708 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:30.686708 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:30.686708 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:30.686708 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:30.687539 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:30.687539 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:30.687539 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:30.687539 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:30.687539 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:30.687539 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:30.687539 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:30.687539 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:30.687539 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:30.687539 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:30.687539 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:29:30.687539 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:29:30.690194 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 109/211] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:29:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:29:30.698663 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa400a-902d-4466-96e5-d778c1aaec81 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:30.707063 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:30.817784 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa400a-902d-4466-96e5-d778c1aaec81 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:30.858196 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7aef39-0c6c-4aaa-98a3-f150d66d54ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:30.858940 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7aef39-0c6c-4aaa-98a3-f150d66d54ef None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:30.859254 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7aef39-0c6c-4aaa-98a3-f150d66d54ef None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:30.859572 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7aef39-0c6c-4aaa-98a3-f150d66d54ef None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:30.860292 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7aef39-0c6c-4aaa-98a3-f150d66d54ef None admin] RBAC: Adding query filter params (name=member) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:30.860595 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7aef39-0c6c-4aaa-98a3-f150d66d54ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:30.861976 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7aef39-0c6c-4aaa-98a3-f150d66d54ef None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:30.871740 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 103/212] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 5 02:29:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:30.877631 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2304cb2-8b3d-46cb-8186-ac4e0a0c8aa9 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:30.895119 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:30.936380 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74981b2-b729-45a7-b460-6aea02be9b3e None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:30.936702 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74981b2-b729-45a7-b460-6aea02be9b3e None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:30.936948 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74981b2-b729-45a7-b460-6aea02be9b3e None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:30.938430 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 104/213] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:29:30.943705 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc197e-e62e-4a2d-ad73-2c5d717a5391 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:30.943985 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc197e-e62e-4a2d-ad73-2c5d717a5391 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:30.944316 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc197e-e62e-4a2d-ad73-2c5d717a5391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:30.966547 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-25cc197e-e62e-4a2d-ad73-2c5d717a5391 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:30.967769 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-25cc197e-e62e-4a2d-ad73-2c5d717a5391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:30.987925 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2304cb2-8b3d-46cb-8186-ac4e0a0c8aa9 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:31.026224 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c639ba-528b-4f31-9aeb-624c59b0d075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:31.026869 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c639ba-528b-4f31-9aeb-624c59b0d075 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:31.027172 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c639ba-528b-4f31-9aeb-624c59b0d075 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:31.027448 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c639ba-528b-4f31-9aeb-624c59b0d075 None admin] PATH_INFO: `/v3/users/8c67c24c6f2a486981602d539e1887f7` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:31.034208 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:31.042039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 105/214] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:29:31.042543 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c639ba-528b-4f31-9aeb-624c59b0d075 None admin] RBAC: Authorizing `identity:get_user(user_id=8c67c24c6f2a486981602d539e1887f7)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:31.047071 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbef5f2-2773-46a1-b1d8-b82e25e6c73e None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:31.047071 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbef5f2-2773-46a1-b1d8-b82e25e6c73e None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:31.047071 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbef5f2-2773-46a1-b1d8-b82e25e6c73e None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:31.047424 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c639ba-528b-4f31-9aeb-624c59b0d075 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:31.047424 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 110/215] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:29:30 2022] GET /identity/v3/users/8c67c24c6f2a486981602d539e1887f7 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:31.054190 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 106/216] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:31.054306 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993366f-c5bf-4885-8aa6-d6554405f3dc None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:31.054306 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993366f-c5bf-4885-8aa6-d6554405f3dc None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:31.054306 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993366f-c5bf-4885-8aa6-d6554405f3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:31.055925 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbef5f2-2773-46a1-b1d8-b82e25e6c73e None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:31.073067 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-6993366f-c5bf-4885-8aa6-d6554405f3dc None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:31.074253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-6993366f-c5bf-4885-8aa6-d6554405f3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:31.137969 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:31.153053 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 111/217] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:29:31.153053 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6993366f-c5bf-4885-8aa6-d6554405f3dc None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:31.173123 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbef5f2-2773-46a1-b1d8-b82e25e6c73e None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:31.248157 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6e76e-104b-4f37-99e4-2c28cdba558e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:31.248781 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6e76e-104b-4f37-99e4-2c28cdba558e None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:31.249058 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6e76e-104b-4f37-99e4-2c28cdba558e None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:31.249328 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6e76e-104b-4f37-99e4-2c28cdba558e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:31.289504 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6993366f-c5bf-4885-8aa6-d6554405f3dc None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:31.321040 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:31.324665 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6e76e-104b-4f37-99e4-2c28cdba558e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:31.325674 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988ec40-94c7-4fa1-a64d-7af66e1a4843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:31.326137 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6e76e-104b-4f37-99e4-2c28cdba558e None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:31.326321 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988ec40-94c7-4fa1-a64d-7af66e1a4843 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:31.326601 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988ec40-94c7-4fa1-a64d-7af66e1a4843 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:31.332572 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988ec40-94c7-4fa1-a64d-7af66e1a4843 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:31.332572 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988ec40-94c7-4fa1-a64d-7af66e1a4843 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:31.332572 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988ec40-94c7-4fa1-a64d-7af66e1a4843 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:31.332572 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 112/218] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:29:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:31.332572 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988ec40-94c7-4fa1-a64d-7af66e1a4843 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:31.394278 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:31.432299 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 107/219] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:29:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 05 02:29:31.432299 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6e76e-104b-4f37-99e4-2c28cdba558e None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:31.432531 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988ec40-94c7-4fa1-a64d-7af66e1a4843 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:31.464603 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714cd0f-4e35-495d-8af2-f9fcc8ad45f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:31.465242 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714cd0f-4e35-495d-8af2-f9fcc8ad45f2 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:31.465524 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714cd0f-4e35-495d-8af2-f9fcc8ad45f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:31.465798 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714cd0f-4e35-495d-8af2-f9fcc8ad45f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:31.476510 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f714cd0f-4e35-495d-8af2-f9fcc8ad45f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:31.481400 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-f714cd0f-4e35-495d-8af2-f9fcc8ad45f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:29:31.481400 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:31.481400 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:31.481400 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:31.481400 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:31.481400 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:31.481400 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:31.481400 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:31.481400 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:31.481400 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:31.481400 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:31.481400 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:31.481400 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:31.481400 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:31.481400 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:31.481400 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:31.482439 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:31.482439 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:31.482439 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:31.482439 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:31.482439 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:31.482439 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:31.482439 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:31.482439 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:31.482439 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:31.482439 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:31.482439 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:31.482439 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:31.482439 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:31.482439 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:31.482439 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:31.482439 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:31.483309 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:31.483309 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:31.483309 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:31.483309 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:31.483309 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:31.483309 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:31.483309 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:31.483309 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:31.483309 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:31.483309 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:31.483309 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:29:31.483309 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:29:31.483309 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 113/220] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 5 02:29:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:29:31.483950 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefb61f-b3c6-4af6-8753-ca74ea87c3a9 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:31.483950 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefb61f-b3c6-4af6-8753-ca74ea87c3a9 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:31.484226 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefb61f-b3c6-4af6-8753-ca74ea87c3a9 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:31.485462 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 114/221] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:31.487175 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eefb61f-b3c6-4af6-8753-ca74ea87c3a9 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:31.526866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:31.530676 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6e76e-104b-4f37-99e4-2c28cdba558e None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:31.563855 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb66f5f-7670-4957-9473-c84e51eecb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:31.564471 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb66f5f-7670-4957-9473-c84e51eecb49 None admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:31.564753 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb66f5f-7670-4957-9473-c84e51eecb49 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:31.565039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb66f5f-7670-4957-9473-c84e51eecb49 None admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:31.565721 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb66f5f-7670-4957-9473-c84e51eecb49 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:31.567258 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb66f5f-7670-4957-9473-c84e51eecb49 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:31.585382 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eefb61f-b3c6-4af6-8753-ca74ea87c3a9 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:31.609325 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:31.619645 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c17959-72b9-4b6f-926b-d4bf1dac81d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:31.620275 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c17959-72b9-4b6f-926b-d4bf1dac81d6 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:31.620555 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c17959-72b9-4b6f-926b-d4bf1dac81d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:31.620827 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c17959-72b9-4b6f-926b-d4bf1dac81d6 None admin] PATH_INFO: `/v3/projects/31cfb67162854a2b8231ce70ee068c46` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:31.621983 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c17959-72b9-4b6f-926b-d4bf1dac81d6 None admin] RBAC: Authorizing `identity:get_project(project_id=31cfb67162854a2b8231ce70ee068c46)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:31.623528 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c17959-72b9-4b6f-926b-d4bf1dac81d6 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:31.625181 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 115/222] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:29:31 2022] GET /identity/v3/projects/31cfb67162854a2b8231ce70ee068c46 => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:31.626051 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c17959-72b9-4b6f-926b-d4bf1dac81d6 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:31.649480 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 108/223] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 5 02:29:31 2022] POST /identity/v3/users => generated 297 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:29:31.650788 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917d0e2-89dd-441a-ad20-07e680aec43d None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:31.651112 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917d0e2-89dd-441a-ad20-07e680aec43d None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:31.651395 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917d0e2-89dd-441a-ad20-07e680aec43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:31.690472 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-c917d0e2-89dd-441a-ad20-07e680aec43d None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:31.692368 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-c917d0e2-89dd-441a-ad20-07e680aec43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:31.737227 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c17959-72b9-4b6f-926b-d4bf1dac81d6 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:31.776975 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd82ed-1f69-444f-9986-33a3daa517d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:31.777681 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd82ed-1f69-444f-9986-33a3daa517d9 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:31.777971 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd82ed-1f69-444f-9986-33a3daa517d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:31.778251 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd82ed-1f69-444f-9986-33a3daa517d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:31.779010 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd82ed-1f69-444f-9986-33a3daa517d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:31.779323 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd82ed-1f69-444f-9986-33a3daa517d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:31.780750 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd82ed-1f69-444f-9986-33a3daa517d9 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:31.787227 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 109/224] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:29:31.787227 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917d0e2-89dd-441a-ad20-07e680aec43d None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:31.796483 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 116/225] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:29:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:31.801968 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd82ed-1f69-444f-9986-33a3daa517d9 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:31.866873 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:31.887232 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:31.906344 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917d0e2-89dd-441a-ad20-07e680aec43d None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:31.932168 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd82ed-1f69-444f-9986-33a3daa517d9 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:31.967503 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360c76a-5093-4e5e-8bdd-fd343c409e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:31.968059 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360c76a-5093-4e5e-8bdd-fd343c409e32 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:31.968339 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360c76a-5093-4e5e-8bdd-fd343c409e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:31.968611 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360c76a-5093-4e5e-8bdd-fd343c409e32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:31.969404 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360c76a-5093-4e5e-8bdd-fd343c409e32 None admin] RBAC: Adding query filter params (role.id=dd9e162a1a25432d871c4c2c0ab779a5, scope.project.id=31cfb67162854a2b8231ce70ee068c46, user.id=8c67c24c6f2a486981602d539e1887f7) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:31.969714 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360c76a-5093-4e5e-8bdd-fd343c409e32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:31.972082 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360c76a-5093-4e5e-8bdd-fd343c409e32 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:31.973755 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b6fe5-9b37-429f-856a-4d941c543d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:31.974712 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b6fe5-9b37-429f-856a-4d941c543d5a None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:31.975201 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b6fe5-9b37-429f-856a-4d941c543d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:31.975960 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b6fe5-9b37-429f-856a-4d941c543d5a None admin] PATH_INFO: `/v3/users/a0738a658b2b45c79656137b2b70f35c` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:31.977334 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b6fe5-9b37-429f-856a-4d941c543d5a None admin] RBAC: Authorizing `identity:get_user(user_id=a0738a658b2b45c79656137b2b70f35c)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:31.979037 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b6fe5-9b37-429f-856a-4d941c543d5a None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:31.979746 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 110/226] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:29:31 2022] GET /identity/v3/role_assignments?user.id=8c67c24c6f2a486981602d539e1887f7&scope.project.id=31cfb67162854a2b8231ce70ee068c46&role.id=dd9e162a1a25432d871c4c2c0ab779a5 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:31.980687 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360c76a-5093-4e5e-8bdd-fd343c409e32 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:31.981700 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 117/227] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:29:31 2022] GET /identity/v3/users/a0738a658b2b45c79656137b2b70f35c => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:29:31.992504 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b6fe5-9b37-429f-856a-4d941c543d5a None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:32.152236 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360c76a-5093-4e5e-8bdd-fd343c409e32 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:32.166545 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b6fe5-9b37-429f-856a-4d941c543d5a None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:32.189410 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145dd03-1cb6-4589-9da6-41fa2a4f6644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:32.190063 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145dd03-1cb6-4589-9da6-41fa2a4f6644 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:32.190343 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145dd03-1cb6-4589-9da6-41fa2a4f6644 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:32.190619 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145dd03-1cb6-4589-9da6-41fa2a4f6644 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:32.195377 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:32.202481 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145dd03-1cb6-4589-9da6-41fa2a4f6644 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:32.207548 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-6145dd03-1cb6-4589-9da6-41fa2a4f6644 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:29:32.207548 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:32.207548 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:32.207548 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:32.207548 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:32.207548 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:32.207548 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:32.207548 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:32.207548 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:32.207548 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:32.207548 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:32.207548 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:32.207548 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:32.207548 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:32.207548 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:32.207548 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:32.208439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:32.208439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:32.208439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:32.208439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:32.208439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:32.208439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:32.208439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:32.208439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:32.208439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:32.208439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:32.208439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:32.208439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:32.208439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:32.208439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:32.208439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:32.208439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:32.209386 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:32.209386 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:32.209386 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:32.209386 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:32.209386 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:32.209386 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:32.209386 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:32.209386 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:32.209386 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:32.209386 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:32.209386 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:29:32.209386 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:29:32.209386 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 111/228] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 5 02:29:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:29:32.211326 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747cb263-4bc8-481d-91f9-cb9811ff59f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:32.212021 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cb263-4bc8-481d-91f9-cb9811ff59f2 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:32.212315 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cb263-4bc8-481d-91f9-cb9811ff59f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:32.212597 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cb263-4bc8-481d-91f9-cb9811ff59f2 None admin] PATH_INFO: `/v3/projects/31cfb67162854a2b8231ce70ee068c46` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:32.215032 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747cb263-4bc8-481d-91f9-cb9811ff59f2 None admin] RBAC: Authorizing `identity:get_project(project_id=31cfb67162854a2b8231ce70ee068c46)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:32.219172 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145dd03-1cb6-4589-9da6-41fa2a4f6644 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:32.219284 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747cb263-4bc8-481d-91f9-cb9811ff59f2 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:32.219284 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 118/229] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:29:31 2022] GET /identity/v3/projects/31cfb67162854a2b8231ce70ee068c46 => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:32.227125 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747cb263-4bc8-481d-91f9-cb9811ff59f2 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:32.228876 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:32.328719 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145dd03-1cb6-4589-9da6-41fa2a4f6644 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:32.354566 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747cb263-4bc8-481d-91f9-cb9811ff59f2 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:32.378366 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5375593-b39e-47a6-ab6f-cd9d4a8df6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:32.379043 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5375593-b39e-47a6-ab6f-cd9d4a8df6e4 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:32.379329 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5375593-b39e-47a6-ab6f-cd9d4a8df6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:32.379605 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5375593-b39e-47a6-ab6f-cd9d4a8df6e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:32.380347 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5375593-b39e-47a6-ab6f-cd9d4a8df6e4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:32.380671 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5375593-b39e-47a6-ab6f-cd9d4a8df6e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:32.382611 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5375593-b39e-47a6-ab6f-cd9d4a8df6e4 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:32.396060 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 112/230] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:29:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:32.397068 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598d2b5-5e6d-4d6c-ac55-3f65a242fac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:32.400426 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598d2b5-5e6d-4d6c-ac55-3f65a242fac9 None admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:32.400894 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598d2b5-5e6d-4d6c-ac55-3f65a242fac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:32.401449 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598d2b5-5e6d-4d6c-ac55-3f65a242fac9 None admin] PATH_INFO: `/v3/projects/31cfb67162854a2b8231ce70ee068c46/users/a0738a658b2b45c79656137b2b70f35c/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:32.404346 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5375593-b39e-47a6-ab6f-cd9d4a8df6e4 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:32.407396 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0598d2b5-5e6d-4d6c-ac55-3f65a242fac9 None admin] RBAC: Authorizing `identity:create_grant(project_id=31cfb67162854a2b8231ce70ee068c46, user_id=a0738a658b2b45c79656137b2b70f35c, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:32.410613 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0598d2b5-5e6d-4d6c-ac55-3f65a242fac9 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:32.491578 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 119/231] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 5 02:29:32 2022] PUT /identity/v3/projects/31cfb67162854a2b8231ce70ee068c46/users/a0738a658b2b45c79656137b2b70f35c/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:29:32.501069 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:32.549359 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5375593-b39e-47a6-ab6f-cd9d4a8df6e4 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:32.608023 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109b02a-7491-4367-ae11-67b757e4d6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:32.608696 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109b02a-7491-4367-ae11-67b757e4d6a9 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:32.608968 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109b02a-7491-4367-ae11-67b757e4d6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:32.609250 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109b02a-7491-4367-ae11-67b757e4d6a9 None admin] PATH_INFO: `/v3/users/a0738a658b2b45c79656137b2b70f35c` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:32.610466 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5109b02a-7491-4367-ae11-67b757e4d6a9 None admin] RBAC: Authorizing `identity:get_user(user_id=a0738a658b2b45c79656137b2b70f35c)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:32.612073 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5109b02a-7491-4367-ae11-67b757e4d6a9 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:32.613846 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 113/232] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:29:32 2022] GET /identity/v3/users/a0738a658b2b45c79656137b2b70f35c => generated 283 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:32.619514 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598d2b5-5e6d-4d6c-ac55-3f65a242fac9 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:32.691924 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:32.745607 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598d2b5-5e6d-4d6c-ac55-3f65a242fac9 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:32.785293 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc0b38-7d95-4892-8486-1804f09803d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:32.785949 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc0b38-7d95-4892-8486-1804f09803d0 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:32.786231 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc0b38-7d95-4892-8486-1804f09803d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:32.786505 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc0b38-7d95-4892-8486-1804f09803d0 None admin] PATH_INFO: `/v3/projects/31cfb67162854a2b8231ce70ee068c46` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:32.791685 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc0b38-7d95-4892-8486-1804f09803d0 None admin] RBAC: Authorizing `identity:get_project(project_id=31cfb67162854a2b8231ce70ee068c46)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:32.793154 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc0b38-7d95-4892-8486-1804f09803d0 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:32.795341 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 120/233] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:29:32 2022] GET /identity/v3/projects/31cfb67162854a2b8231ce70ee068c46 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:32.800962 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109b02a-7491-4367-ae11-67b757e4d6a9 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:32.908628 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109b02a-7491-4367-ae11-67b757e4d6a9 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:32.949526 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb77e904-755d-4097-ad2d-5df533601e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:32.950209 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77e904-755d-4097-ad2d-5df533601e92 None admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:32.950495 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77e904-755d-4097-ad2d-5df533601e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:32.950774 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77e904-755d-4097-ad2d-5df533601e92 None admin] PATH_INFO: `/v3/projects/31cfb67162854a2b8231ce70ee068c46/users/a0738a658b2b45c79656137b2b70f35c/roles/428314713da6487e8047a1f333265cda` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:32.953032 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb77e904-755d-4097-ad2d-5df533601e92 None admin] RBAC: Authorizing `identity:create_grant(project_id=31cfb67162854a2b8231ce70ee068c46, user_id=a0738a658b2b45c79656137b2b70f35c, role_id=428314713da6487e8047a1f333265cda)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:32.954509 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb77e904-755d-4097-ad2d-5df533601e92 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:33.052125 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:33.057917 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 114/234] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 5 02:29:32 2022] PUT /identity/v3/projects/31cfb67162854a2b8231ce70ee068c46/users/a0738a658b2b45c79656137b2b70f35c/roles/428314713da6487e8047a1f333265cda => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:29:34.336544 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878f1a9-adba-49de-964c-d168e6b887b7 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:34.337057 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878f1a9-adba-49de-964c-d168e6b887b7 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:34.337130 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878f1a9-adba-49de-964c-d168e6b887b7 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:34.338707 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 121/235] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:34.343975 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff696b84-b49f-4295-b8c3-f9457162f00a None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:34.344481 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff696b84-b49f-4295-b8c3-f9457162f00a None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:34.344634 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff696b84-b49f-4295-b8c3-f9457162f00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:34.372489 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-ff696b84-b49f-4295-b8c3-f9457162f00a None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:34.373680 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-ff696b84-b49f-4295-b8c3-f9457162f00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:34.417874 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af3b79-3704-494b-8a6f-fb4b94988fc6 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:34.418194 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af3b79-3704-494b-8a6f-fb4b94988fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:34.418431 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af3b79-3704-494b-8a6f-fb4b94988fc6 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:34.419838 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 122/236] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:29:34.427114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd755298-ade8-496a-93d3-c551533f7a0f None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:34.427402 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd755298-ade8-496a-93d3-c551533f7a0f None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:34.427673 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd755298-ade8-496a-93d3-c551533f7a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:34.458389 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-bd755298-ade8-496a-93d3-c551533f7a0f None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:34.460207 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-bd755298-ade8-496a-93d3-c551533f7a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:34.496936 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 115/237] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:29:34.541812 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff696b84-b49f-4295-b8c3-f9457162f00a None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:34.558997 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 123/238] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:29:34.581070 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd755298-ade8-496a-93d3-c551533f7a0f None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:34.653433 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:34.699865 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff696b84-b49f-4295-b8c3-f9457162f00a None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:34.720983 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd755298-ade8-496a-93d3-c551533f7a0f None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:34.734924 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:34.743892 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e297e56a-2af9-4193-add3-35a34636e7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:34.744537 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297e56a-2af9-4193-add3-35a34636e7d2 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:34.744823 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297e56a-2af9-4193-add3-35a34636e7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:34.745099 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297e56a-2af9-4193-add3-35a34636e7d2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:34.755553 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e297e56a-2af9-4193-add3-35a34636e7d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:34.761309 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-e297e56a-2af9-4193-add3-35a34636e7d2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 02:29:34.761309 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:34.761309 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:34.761309 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:34.761309 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:34.761309 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:34.761309 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:34.761309 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:34.761309 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:34.761309 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:34.761309 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:34.761309 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:34.761309 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:34.761309 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:34.761309 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:34.761309 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:34.762181 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:34.762181 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:34.762181 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:34.762181 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:34.762181 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:34.762181 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:34.762181 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:34.762181 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:34.762181 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:34.762181 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:34.762181 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:34.762181 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:34.762181 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:34.762181 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:34.762181 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:34.762181 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:34.763002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:34.763002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:34.763002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:34.763002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:34.763002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:34.763002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:34.763002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:34.763002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:34.763002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:34.763002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:34.763002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 02:29:34.763002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:29:34.763002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 116/239] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:29:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:29:34.766025 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5aa1c-c352-4c49-a250-dddd90add5a3 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:34.766393 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5aa1c-c352-4c49-a250-dddd90add5a3 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:34.766749 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5aa1c-c352-4c49-a250-dddd90add5a3 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:34.767559 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b6abbb-8343-45ef-a05b-615a631a5168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:34.768401 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6abbb-8343-45ef-a05b-615a631a5168 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:34.768551 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 117/240] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:34.769013 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6abbb-8343-45ef-a05b-615a631a5168 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:34.769463 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f5aa1c-c352-4c49-a250-dddd90add5a3 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:34.769568 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6abbb-8343-45ef-a05b-615a631a5168 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:34.770902 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b6abbb-8343-45ef-a05b-615a631a5168 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:34.773133 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b6abbb-8343-45ef-a05b-615a631a5168 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:34.775270 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 124/241] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:29:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:34.776688 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede0308-d292-4920-b61a-b6b4459af242 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:34.777145 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede0308-d292-4920-b61a-b6b4459af242 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:34.777580 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede0308-d292-4920-b61a-b6b4459af242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:34.796187 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-aede0308-d292-4920-b61a-b6b4459af242 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:34.797642 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-aede0308-d292-4920-b61a-b6b4459af242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:34.877047 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 125/242] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:29:34.878378 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede0308-d292-4920-b61a-b6b4459af242 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:34.890930 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f5aa1c-c352-4c49-a250-dddd90add5a3 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:34.929785 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98356d57-f03f-4337-8afb-1c738728ddaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:34.930827 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98356d57-f03f-4337-8afb-1c738728ddaa None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:34.931324 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98356d57-f03f-4337-8afb-1c738728ddaa None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:34.931779 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98356d57-f03f-4337-8afb-1c738728ddaa None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:34.932732 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98356d57-f03f-4337-8afb-1c738728ddaa None admin] RBAC: Adding query filter params (name=reader) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:34.933217 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98356d57-f03f-4337-8afb-1c738728ddaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:34.934940 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98356d57-f03f-4337-8afb-1c738728ddaa None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:34.937641 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:34.946311 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 118/243] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 5 02:29:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:34.947418 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98356d57-f03f-4337-8afb-1c738728ddaa None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:35.005232 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:35.009822 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede0308-d292-4920-b61a-b6b4459af242 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:35.057011 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abd545-f4fd-4d4b-9d9b-ebc296e0cca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:35.057559 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abd545-f4fd-4d4b-9d9b-ebc296e0cca1 None admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:35.057888 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abd545-f4fd-4d4b-9d9b-ebc296e0cca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:35.058403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abd545-f4fd-4d4b-9d9b-ebc296e0cca1 None admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:35.059123 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57abd545-f4fd-4d4b-9d9b-ebc296e0cca1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:35.061292 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57abd545-f4fd-4d4b-9d9b-ebc296e0cca1 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:35.062653 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98356d57-f03f-4337-8afb-1c738728ddaa None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:35.099872 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118d568-857a-4769-b68b-62d5ca2bec8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:35.101543 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118d568-857a-4769-b68b-62d5ca2bec8b None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:35.101898 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118d568-857a-4769-b68b-62d5ca2bec8b None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:35.102249 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118d568-857a-4769-b68b-62d5ca2bec8b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:35.112853 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7118d568-857a-4769-b68b-62d5ca2bec8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:35.119052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-7118d568-857a-4769-b68b-62d5ca2bec8b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:29:35.119052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:35.119052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:35.119052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:35.119052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:35.119052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:35.119052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:35.119052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:35.119052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:35.119052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:35.119052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:35.119052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:35.119052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:35.119052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:35.119052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:35.119052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:35.119926 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:35.119926 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:35.119926 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:35.119926 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:35.119926 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:35.119926 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:35.119926 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:35.119926 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:35.119926 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:35.119926 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:35.119926 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:35.119926 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:35.119926 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:35.119926 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:35.119926 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:35.119926 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:35.121098 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:35.121098 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:35.121098 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:35.121098 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:35.121098 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:35.121098 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:35.121098 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:35.121098 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:35.121098 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:35.121098 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:35.121098 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:29:35.121098 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:29:35.121098 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 119/244] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:29:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:29:35.121098 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118d568-857a-4769-b68b-62d5ca2bec8b None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:35.151367 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 126/245] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 5 02:29:34 2022] POST /identity/v3/users => generated 293 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:29:35.152913 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abd545-f4fd-4d4b-9d9b-ebc296e0cca1 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:35.279154 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118d568-857a-4769-b68b-62d5ca2bec8b None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:35.280275 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abd545-f4fd-4d4b-9d9b-ebc296e0cca1 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:35.282120 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:35.295830 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:35.327771 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a70b0e-1701-445c-bc8c-76c6bc0d3436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:35.328632 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a70b0e-1701-445c-bc8c-76c6bc0d3436 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:35.329573 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a70b0e-1701-445c-bc8c-76c6bc0d3436 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:35.329859 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a70b0e-1701-445c-bc8c-76c6bc0d3436 None admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:35.330600 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a70b0e-1701-445c-bc8c-76c6bc0d3436 None admin] RBAC: Adding query filter params (name=member) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:35.330906 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a70b0e-1701-445c-bc8c-76c6bc0d3436 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:35.332329 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a70b0e-1701-445c-bc8c-76c6bc0d3436 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:35.337761 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89941c9-c113-4ed5-850e-5a1f00488cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:35.338426 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89941c9-c113-4ed5-850e-5a1f00488cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:35.338710 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89941c9-c113-4ed5-850e-5a1f00488cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:35.339042 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89941c9-c113-4ed5-850e-5a1f00488cf6 None admin] PATH_INFO: `/v3/users/8609c0a2396347b8a3fcd4558e78fffb` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:35.342798 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 127/246] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 5 02:29:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:35.344451 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327713e3-5396-45e4-b5fe-6a52891ac58b None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:35.344806 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327713e3-5396-45e4-b5fe-6a52891ac58b None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:35.345203 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327713e3-5396-45e4-b5fe-6a52891ac58b None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:35.346759 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 128/247] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:35.348300 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327713e3-5396-45e4-b5fe-6a52891ac58b None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:35.358985 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89941c9-c113-4ed5-850e-5a1f00488cf6 None admin] RBAC: Authorizing `identity:get_user(user_id=8609c0a2396347b8a3fcd4558e78fffb)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:35.361383 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89941c9-c113-4ed5-850e-5a1f00488cf6 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:35.363761 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 120/248] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:29:35 2022] GET /identity/v3/users/8609c0a2396347b8a3fcd4558e78fffb => generated 297 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:35.364822 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6277611-f828-4a87-bee5-f2a6432592f5 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:35.365293 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6277611-f828-4a87-bee5-f2a6432592f5 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:35.365775 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6277611-f828-4a87-bee5-f2a6432592f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:35.389195 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-f6277611-f828-4a87-bee5-f2a6432592f5 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:35.392564 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-f6277611-f828-4a87-bee5-f2a6432592f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:35.474506 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 121/249] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:29:35.476120 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6277611-f828-4a87-bee5-f2a6432592f5 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:35.485235 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327713e3-5396-45e4-b5fe-6a52891ac58b None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:35.538984 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c85554-8a73-49fe-adbc-2cd1ed5f86e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:35.539706 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c85554-8a73-49fe-adbc-2cd1ed5f86e5 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:35.539989 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c85554-8a73-49fe-adbc-2cd1ed5f86e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:35.540308 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c85554-8a73-49fe-adbc-2cd1ed5f86e5 None admin] PATH_INFO: `/v3/users/8c67c24c6f2a486981602d539e1887f7` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:35.541502 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c85554-8a73-49fe-adbc-2cd1ed5f86e5 None admin] RBAC: Authorizing `identity:get_user(user_id=8c67c24c6f2a486981602d539e1887f7)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:35.542992 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c85554-8a73-49fe-adbc-2cd1ed5f86e5 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:35.544630 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 129/250] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:29:35 2022] GET /identity/v3/users/8c67c24c6f2a486981602d539e1887f7 => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:35.545872 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1180c-964d-4547-a4ef-4b6b29c8cac3 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:35.546136 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1180c-964d-4547-a4ef-4b6b29c8cac3 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:35.546414 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1180c-964d-4547-a4ef-4b6b29c8cac3 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:35.547951 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 130/251] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:35.548662 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1180c-964d-4547-a4ef-4b6b29c8cac3 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:35.592850 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:35.594057 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:35.597981 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6277611-f828-4a87-bee5-f2a6432592f5 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:35.648211 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb0dd0-f129-461e-bc23-e2063e68c93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:35.648843 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb0dd0-f129-461e-bc23-e2063e68c93f None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:35.649127 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb0dd0-f129-461e-bc23-e2063e68c93f None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:35.649406 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb0dd0-f129-461e-bc23-e2063e68c93f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:35.679900 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1180c-964d-4547-a4ef-4b6b29c8cac3 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:35.720153 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b6a24-053e-47f5-86a5-c72076ed91cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:35.721073 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b6a24-053e-47f5-86a5-c72076ed91cb None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:35.721359 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b6a24-053e-47f5-86a5-c72076ed91cb None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:35.721637 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b6a24-053e-47f5-86a5-c72076ed91cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:35.732576 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb0dd0-f129-461e-bc23-e2063e68c93f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:35.734124 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb0dd0-f129-461e-bc23-e2063e68c93f None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:35.735735 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b6a24-053e-47f5-86a5-c72076ed91cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:35.743074 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-de0b6a24-053e-47f5-86a5-c72076ed91cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:29:35.743074 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:35.743074 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:35.743074 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:35.743074 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:35.743074 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:35.743074 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:35.743074 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:35.743074 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:35.743074 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:35.743074 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:35.743074 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:35.743074 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:35.743074 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:35.743074 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:35.743074 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:35.743953 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:35.743953 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:35.743953 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:35.743953 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:35.743953 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:35.743953 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:35.743953 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:35.743953 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:35.743953 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:35.743953 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:35.743953 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:35.743953 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:35.743953 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:35.743953 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:35.743953 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:35.743953 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:35.745277 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:35.745277 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:35.745277 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:35.745277 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:35.745277 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:35.745277 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:35.745277 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:35.745277 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:35.745277 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:35.745277 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:35.745277 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:29:35.745277 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:29:35.745277 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 131/252] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 5 02:29:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:29:35.750985 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b6a24-053e-47f5-86a5-c72076ed91cb None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:35.841811 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:35.857959 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 122/253] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:29:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:29:35.857959 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d57727-8b40-4c89-95dc-b242d30412d0 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:35.857959 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d57727-8b40-4c89-95dc-b242d30412d0 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:35.857959 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d57727-8b40-4c89-95dc-b242d30412d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:35.868966 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-07d57727-8b40-4c89-95dc-b242d30412d0 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:35.870252 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-07d57727-8b40-4c89-95dc-b242d30412d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:35.885098 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:35.897885 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b6a24-053e-47f5-86a5-c72076ed91cb None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:35.941714 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 123/254] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:29:35.943299 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c6357-8b45-4cb5-afe8-e30f5d50150a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:35.944682 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c6357-8b45-4cb5-afe8-e30f5d50150a None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:35.945166 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c6357-8b45-4cb5-afe8-e30f5d50150a None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:35.945600 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c6357-8b45-4cb5-afe8-e30f5d50150a None admin] PATH_INFO: `/v3/projects/31cfb67162854a2b8231ce70ee068c46` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:35.947000 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18c6357-8b45-4cb5-afe8-e30f5d50150a None admin] RBAC: Authorizing `identity:get_project(project_id=31cfb67162854a2b8231ce70ee068c46)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:35.947953 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d57727-8b40-4c89-95dc-b242d30412d0 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:35.948851 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18c6357-8b45-4cb5-afe8-e30f5d50150a None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:35.951400 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 132/255] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:29:35 2022] GET /identity/v3/projects/31cfb67162854a2b8231ce70ee068c46 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:35.953280 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c6357-8b45-4cb5-afe8-e30f5d50150a None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:36.075586 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c6357-8b45-4cb5-afe8-e30f5d50150a None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:36.095246 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d57727-8b40-4c89-95dc-b242d30412d0 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:36.120640 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1da62-dd52-451e-9848-c83348c51637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:36.121756 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1da62-dd52-451e-9848-c83348c51637 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:36.122520 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1da62-dd52-451e-9848-c83348c51637 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:36.123263 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1da62-dd52-451e-9848-c83348c51637 None admin] PATH_INFO: `/v3/projects/31cfb67162854a2b8231ce70ee068c46` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:36.124785 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c1da62-dd52-451e-9848-c83348c51637 None admin] RBAC: Authorizing `identity:get_project(project_id=31cfb67162854a2b8231ce70ee068c46)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:36.125252 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:36.127335 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c1da62-dd52-451e-9848-c83348c51637 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:36.130074 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 133/256] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:29:35 2022] GET /identity/v3/projects/31cfb67162854a2b8231ce70ee068c46 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:36.131015 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1da62-dd52-451e-9848-c83348c51637 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:36.138623 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a6f53-c268-45c2-820c-21f8caf6d86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:36.139338 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a6f53-c268-45c2-820c-21f8caf6d86a None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:36.145417 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a6f53-c268-45c2-820c-21f8caf6d86a None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:36.145417 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a6f53-c268-45c2-820c-21f8caf6d86a None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:36.145417 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a6f53-c268-45c2-820c-21f8caf6d86a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:36.145417 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a6f53-c268-45c2-820c-21f8caf6d86a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:36.145417 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a6f53-c268-45c2-820c-21f8caf6d86a None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:36.155394 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 124/257] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:29:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:36.156744 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a6f53-c268-45c2-820c-21f8caf6d86a None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:36.164996 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:36.255900 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1da62-dd52-451e-9848-c83348c51637 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:36.263181 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a6f53-c268-45c2-820c-21f8caf6d86a None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:36.304494 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27604471-6687-4884-b495-b376c8f96a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:36.305221 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27604471-6687-4884-b495-b376c8f96a8c None admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:36.305507 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27604471-6687-4884-b495-b376c8f96a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:36.305800 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27604471-6687-4884-b495-b376c8f96a8c None admin] PATH_INFO: `/v3/projects/31cfb67162854a2b8231ce70ee068c46/users/8c67c24c6f2a486981602d539e1887f7/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:36.306623 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7e34e-ed7c-45f2-8091-bcf3a67377ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:36.307409 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7e34e-ed7c-45f2-8091-bcf3a67377ae None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:36.307789 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7e34e-ed7c-45f2-8091-bcf3a67377ae None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:36.308160 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7e34e-ed7c-45f2-8091-bcf3a67377ae None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:36.308460 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27604471-6687-4884-b495-b376c8f96a8c None admin] RBAC: Authorizing `identity:create_grant(project_id=31cfb67162854a2b8231ce70ee068c46, user_id=8c67c24c6f2a486981602d539e1887f7, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:36.310512 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27604471-6687-4884-b495-b376c8f96a8c None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:36.319307 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e7e34e-ed7c-45f2-8091-bcf3a67377ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:36.324703 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-33e7e34e-ed7c-45f2-8091-bcf3a67377ae None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:29:36.324703 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:36.324703 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:36.324703 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:36.324703 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:36.324703 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:36.324703 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:36.324703 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:36.324703 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:36.324703 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:36.324703 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:36.324703 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:36.324703 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:36.324703 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:36.324703 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:36.324703 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:36.325566 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:36.325566 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:36.325566 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:36.325566 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:36.325566 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:36.325566 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:36.325566 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:36.325566 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:36.325566 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:36.325566 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:36.325566 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:36.325566 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:36.325566 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:36.325566 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:36.325566 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:36.325566 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:36.326350 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:36.326350 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:36.326350 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:36.326350 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:36.326350 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:36.326350 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:36.326350 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:36.326350 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:36.326350 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:36.326350 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:36.326350 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:29:36.326350 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:29:36.326350 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 125/258] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 5 02:29:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:29:36.329903 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7e34e-ed7c-45f2-8091-bcf3a67377ae None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:36.381615 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:36.402380 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 134/259] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 5 02:29:36 2022] PUT /identity/v3/projects/31cfb67162854a2b8231ce70ee068c46/users/8c67c24c6f2a486981602d539e1887f7/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:29:36.402380 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27604471-6687-4884-b495-b376c8f96a8c None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:36.491086 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7e34e-ed7c-45f2-8091-bcf3a67377ae None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:36.563007 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ab04b-7329-4e13-bef0-5b84a382a3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:36.563661 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ab04b-7329-4e13-bef0-5b84a382a3ef None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:36.563947 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ab04b-7329-4e13-bef0-5b84a382a3ef None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:36.564223 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ab04b-7329-4e13-bef0-5b84a382a3ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:36.565032 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ab04b-7329-4e13-bef0-5b84a382a3ef None admin] RBAC: Adding query filter params (role.id=d1d918bf6fa5478e8535ec7f1efa8e0c, scope.project.id=31cfb67162854a2b8231ce70ee068c46, user.id=8609c0a2396347b8a3fcd4558e78fffb) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:36.565341 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ab04b-7329-4e13-bef0-5b84a382a3ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:36.566908 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ab04b-7329-4e13-bef0-5b84a382a3ef None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:36.573276 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 126/260] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:29:36 2022] GET /identity/v3/role_assignments?user.id=8609c0a2396347b8a3fcd4558e78fffb&scope.project.id=31cfb67162854a2b8231ce70ee068c46&role.id=d1d918bf6fa5478e8535ec7f1efa8e0c => generated 259 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:36.574136 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ab04b-7329-4e13-bef0-5b84a382a3ef None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:36.587553 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:36.605693 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27604471-6687-4884-b495-b376c8f96a8c None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:36.645983 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ed8a5-1a78-47ba-90ad-d63a5462ec0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:36.646730 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ed8a5-1a78-47ba-90ad-d63a5462ec0d None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:36.647674 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ed8a5-1a78-47ba-90ad-d63a5462ec0d None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:36.648054 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ed8a5-1a78-47ba-90ad-d63a5462ec0d None admin] PATH_INFO: `/v3/users/a0738a658b2b45c79656137b2b70f35c` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:36.649379 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ed8a5-1a78-47ba-90ad-d63a5462ec0d None admin] RBAC: Authorizing `identity:get_user(user_id=a0738a658b2b45c79656137b2b70f35c)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:36.650855 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ed8a5-1a78-47ba-90ad-d63a5462ec0d None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:36.652723 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 135/261] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:29:36 2022] GET /identity/v3/users/a0738a658b2b45c79656137b2b70f35c => generated 283 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:36.658163 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ed8a5-1a78-47ba-90ad-d63a5462ec0d None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:36.690768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ab04b-7329-4e13-bef0-5b84a382a3ef None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:36.705756 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:36.729097 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a4e8a-ff26-4dd0-8bcf-668f43c66673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:36.729737 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a4e8a-ff26-4dd0-8bcf-668f43c66673 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:36.730019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a4e8a-ff26-4dd0-8bcf-668f43c66673 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:36.730360 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a4e8a-ff26-4dd0-8bcf-668f43c66673 None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:36.731129 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a4e8a-ff26-4dd0-8bcf-668f43c66673 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:36.731440 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a4e8a-ff26-4dd0-8bcf-668f43c66673 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:36.732930 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a4e8a-ff26-4dd0-8bcf-668f43c66673 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:36.744292 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 127/262] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:29:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:36.749915 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a4e8a-ff26-4dd0-8bcf-668f43c66673 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:36.765448 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ed8a5-1a78-47ba-90ad-d63a5462ec0d None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:36.802347 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff880f5c-e304-41ca-93c4-282c223bd168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:36.803028 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff880f5c-e304-41ca-93c4-282c223bd168 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:36.803370 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff880f5c-e304-41ca-93c4-282c223bd168 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:36.803788 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff880f5c-e304-41ca-93c4-282c223bd168 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:36.830256 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:36.864786 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a4e8a-ff26-4dd0-8bcf-668f43c66673 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:36.877087 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff880f5c-e304-41ca-93c4-282c223bd168 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:36.878580 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff880f5c-e304-41ca-93c4-282c223bd168 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:36.906224 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd021d6-c61b-487d-9f93-3a00e5c7dbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:36.906900 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd021d6-c61b-487d-9f93-3a00e5c7dbf2 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:36.907327 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd021d6-c61b-487d-9f93-3a00e5c7dbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:36.907607 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd021d6-c61b-487d-9f93-3a00e5c7dbf2 None admin] PATH_INFO: `/v3/users/a0738a658b2b45c79656137b2b70f35c` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:36.908800 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd021d6-c61b-487d-9f93-3a00e5c7dbf2 None admin] RBAC: Authorizing `identity:get_user(user_id=a0738a658b2b45c79656137b2b70f35c)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:36.910535 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd021d6-c61b-487d-9f93-3a00e5c7dbf2 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:36.917503 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 128/263] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:29:36 2022] GET /identity/v3/users/a0738a658b2b45c79656137b2b70f35c => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:36.918504 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd021d6-c61b-487d-9f93-3a00e5c7dbf2 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:36.968834 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:36.983611 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 136/264] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:29:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:29:36.989798 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff880f5c-e304-41ca-93c4-282c223bd168 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:37.032278 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd021d6-c61b-487d-9f93-3a00e5c7dbf2 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:37.048518 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:37.070526 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeef5f2-a456-4a29-9c19-513ae3d5a6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:37.071185 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeef5f2-a456-4a29-9c19-513ae3d5a6ba None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:37.071466 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeef5f2-a456-4a29-9c19-513ae3d5a6ba None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:37.071754 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeef5f2-a456-4a29-9c19-513ae3d5a6ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:37.094797 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff880f5c-e304-41ca-93c4-282c223bd168 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:37.130925 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1494b07-9e59-4f11-b10a-3148dbc1adc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:37.132158 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1494b07-9e59-4f11-b10a-3148dbc1adc5 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:37.132440 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1494b07-9e59-4f11-b10a-3148dbc1adc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:37.132715 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1494b07-9e59-4f11-b10a-3148dbc1adc5 None admin] PATH_INFO: `/v3/projects/31cfb67162854a2b8231ce70ee068c46` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:37.133895 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1494b07-9e59-4f11-b10a-3148dbc1adc5 None admin] RBAC: Authorizing `identity:get_project(project_id=31cfb67162854a2b8231ce70ee068c46)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:37.135405 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1494b07-9e59-4f11-b10a-3148dbc1adc5 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:37.137400 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 137/265] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:29:36 2022] GET /identity/v3/projects/31cfb67162854a2b8231ce70ee068c46 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:37.143063 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1494b07-9e59-4f11-b10a-3148dbc1adc5 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:37.148268 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeef5f2-a456-4a29-9c19-513ae3d5a6ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:37.149817 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeef5f2-a456-4a29-9c19-513ae3d5a6ba None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:37.198649 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:37.246939 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1494b07-9e59-4f11-b10a-3148dbc1adc5 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:37.265773 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 129/266] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:29:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:29:37.271403 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeef5f2-a456-4a29-9c19-513ae3d5a6ba None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:37.282286 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:37.293168 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8660bd3-939e-41ef-ab82-ec8c86337741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:37.293854 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8660bd3-939e-41ef-ab82-ec8c86337741 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:37.294075 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8660bd3-939e-41ef-ab82-ec8c86337741 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:37.294357 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8660bd3-939e-41ef-ab82-ec8c86337741 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:37.295179 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8660bd3-939e-41ef-ab82-ec8c86337741 None admin] RBAC: Adding query filter params (role.id=83afe883a303495b966480fb9b5bb7dd, scope.project.id=31cfb67162854a2b8231ce70ee068c46, user.id=a0738a658b2b45c79656137b2b70f35c) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:37.295489 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8660bd3-939e-41ef-ab82-ec8c86337741 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:37.296960 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8660bd3-939e-41ef-ab82-ec8c86337741 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:37.303867 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 138/267] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:29:37 2022] GET /identity/v3/role_assignments?user.id=a0738a658b2b45c79656137b2b70f35c&scope.project.id=31cfb67162854a2b8231ce70ee068c46&role.id=83afe883a303495b966480fb9b5bb7dd => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:29:37.412138 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeef5f2-a456-4a29-9c19-513ae3d5a6ba None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:37.449275 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f246514c-dff1-4346-9dda-4c77cbdad8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:37.449858 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246514c-dff1-4346-9dda-4c77cbdad8c7 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:37.450140 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246514c-dff1-4346-9dda-4c77cbdad8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:37.450417 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246514c-dff1-4346-9dda-4c77cbdad8c7 None admin] PATH_INFO: `/v3/projects/31cfb67162854a2b8231ce70ee068c46` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:37.451659 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f246514c-dff1-4346-9dda-4c77cbdad8c7 None admin] RBAC: Authorizing `identity:get_project(project_id=31cfb67162854a2b8231ce70ee068c46)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:37.453211 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f246514c-dff1-4346-9dda-4c77cbdad8c7 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:37.455288 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 130/268] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:29:37 2022] GET /identity/v3/projects/31cfb67162854a2b8231ce70ee068c46 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:29:37.461208 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8660bd3-939e-41ef-ab82-ec8c86337741 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:37.582466 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8660bd3-939e-41ef-ab82-ec8c86337741 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:37.618860 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc0625-1832-49c4-8216-2229657a2dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:37.619510 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc0625-1832-49c4-8216-2229657a2dfc None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:37.619799 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc0625-1832-49c4-8216-2229657a2dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:37.620071 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc0625-1832-49c4-8216-2229657a2dfc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:37.620857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dc0625-1832-49c4-8216-2229657a2dfc None admin] RBAC: Adding query filter params (role.id=428314713da6487e8047a1f333265cda, scope.project.id=31cfb67162854a2b8231ce70ee068c46, user.id=a0738a658b2b45c79656137b2b70f35c) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:37.621165 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dc0625-1832-49c4-8216-2229657a2dfc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:37.622616 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dc0625-1832-49c4-8216-2229657a2dfc None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:37.629234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 139/269] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:29:37 2022] GET /identity/v3/role_assignments?user.id=a0738a658b2b45c79656137b2b70f35c&scope.project.id=31cfb67162854a2b8231ce70ee068c46&role.id=428314713da6487e8047a1f333265cda => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:37.901522 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66def978-1471-40f8-86bb-2426bb076609 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:37.901910 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66def978-1471-40f8-86bb-2426bb076609 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:37.902096 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66def978-1471-40f8-86bb-2426bb076609 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:37.903654 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 131/270] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:37.908787 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629e3b7-a221-4cb3-8a7d-5ba2433f0def None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:37.909136 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629e3b7-a221-4cb3-8a7d-5ba2433f0def None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:37.909472 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629e3b7-a221-4cb3-8a7d-5ba2433f0def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:37.930251 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-6629e3b7-a221-4cb3-8a7d-5ba2433f0def None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:37.931481 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-6629e3b7-a221-4cb3-8a7d-5ba2433f0def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:37.963618 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bb36d-f98d-45ff-9be2-e158f362e144 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:37.963915 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bb36d-f98d-45ff-9be2-e158f362e144 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:37.964168 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bb36d-f98d-45ff-9be2-e158f362e144 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:37.965777 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 132/271] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:37.971457 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770c2a6-1c5c-4af2-8d60-6478f0acbe6c None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:37.972001 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770c2a6-1c5c-4af2-8d60-6478f0acbe6c None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:37.972485 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770c2a6-1c5c-4af2-8d60-6478f0acbe6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:37.999926 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:38.002573 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-1770c2a6-1c5c-4af2-8d60-6478f0acbe6c None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:38.004555 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-1770c2a6-1c5c-4af2-8d60-6478f0acbe6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:38.014372 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:38.021689 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 140/272] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:29:38.046373 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629e3b7-a221-4cb3-8a7d-5ba2433f0def None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:38.102984 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 133/273] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:29:38.125611 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770c2a6-1c5c-4af2-8d60-6478f0acbe6c None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:38.172169 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629e3b7-a221-4cb3-8a7d-5ba2433f0def None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:38.212228 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0643394b-0094-463e-9ff3-19ca0c4dd60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:38.213365 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643394b-0094-463e-9ff3-19ca0c4dd60d None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:38.213867 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643394b-0094-463e-9ff3-19ca0c4dd60d None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:38.214466 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643394b-0094-463e-9ff3-19ca0c4dd60d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:38.227016 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0643394b-0094-463e-9ff3-19ca0c4dd60d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:38.232603 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-0643394b-0094-463e-9ff3-19ca0c4dd60d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:29:38.232603 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:38.232603 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:38.232603 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:38.232603 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:38.232603 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:38.232603 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:38.232603 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:38.232603 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:38.232603 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:38.232603 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:38.232603 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:38.232603 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:38.232603 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:38.232603 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:38.232603 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:38.233500 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:38.233500 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:38.233500 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:38.233500 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:38.233500 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:38.233500 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:38.233500 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:38.233500 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:38.233500 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:38.233500 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:38.233500 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:38.233500 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:38.233500 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:38.233500 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:38.233500 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:38.233500 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:38.234309 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:38.234309 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:38.234309 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:38.234309 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:38.234309 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:38.234309 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:38.234309 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:38.234309 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:38.234309 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:38.234309 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:38.234309 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:29:38.234309 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:29:38.236890 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 141/274] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:29:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:29:38.242895 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0643394b-0094-463e-9ff3-19ca0c4dd60d None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:38.250060 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770c2a6-1c5c-4af2-8d60-6478f0acbe6c None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:38.301259 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e38a9-6408-41cf-b83f-17affecf1fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:38.302327 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e38a9-6408-41cf-b83f-17affecf1fba None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:38.302880 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e38a9-6408-41cf-b83f-17affecf1fba None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:38.303465 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e38a9-6408-41cf-b83f-17affecf1fba None admin] PATH_INFO: `/v3/domains/default` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:38.304892 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7e38a9-6408-41cf-b83f-17affecf1fba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:38.305877 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:38.306820 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7e38a9-6408-41cf-b83f-17affecf1fba None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:38.313421 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 134/275] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:29:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:29:38.314766 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e38a9-6408-41cf-b83f-17affecf1fba None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:38.338976 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:38.369387 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0643394b-0094-463e-9ff3-19ca0c4dd60d None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:38.406900 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5fde7-1a0c-4a50-9df8-73cda48a345a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:38.407605 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5fde7-1a0c-4a50-9df8-73cda48a345a None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:38.407887 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5fde7-1a0c-4a50-9df8-73cda48a345a None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:38.408161 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5fde7-1a0c-4a50-9df8-73cda48a345a None admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:38.408924 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5fde7-1a0c-4a50-9df8-73cda48a345a None admin] RBAC: Adding query filter params (name=member) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:38.409231 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5fde7-1a0c-4a50-9df8-73cda48a345a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:38.410615 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5fde7-1a0c-4a50-9df8-73cda48a345a None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:38.419642 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 142/276] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 5 02:29:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:29:38.425020 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5fde7-1a0c-4a50-9df8-73cda48a345a None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:38.433135 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e38a9-6408-41cf-b83f-17affecf1fba None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:38.471045 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d353588-aaa0-4d9c-a418-c754b2425f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:38.471978 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d353588-aaa0-4d9c-a418-c754b2425f0d None admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:38.472499 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d353588-aaa0-4d9c-a418-c754b2425f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:38.473003 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d353588-aaa0-4d9c-a418-c754b2425f0d None admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:38.473867 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d353588-aaa0-4d9c-a418-c754b2425f0d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:38.475950 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d353588-aaa0-4d9c-a418-c754b2425f0d None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:38.542854 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5fde7-1a0c-4a50-9df8-73cda48a345a None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:38.545997 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:38.576504 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165db56e-ab52-40c7-948d-c204f690361b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:38.577143 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165db56e-ab52-40c7-948d-c204f690361b None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:38.577425 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165db56e-ab52-40c7-948d-c204f690361b None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:38.577700 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165db56e-ab52-40c7-948d-c204f690361b None admin] PATH_INFO: `/v3/users/494b6fb4ec6243c58d47966cf1dee75a` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:38.591891 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165db56e-ab52-40c7-948d-c204f690361b None admin] RBAC: Authorizing `identity:get_user(user_id=494b6fb4ec6243c58d47966cf1dee75a)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:38.595499 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165db56e-ab52-40c7-948d-c204f690361b None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:38.595499 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 143/278] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:29:38 2022] GET /identity/v3/users/494b6fb4ec6243c58d47966cf1dee75a => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:29:38.595919 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 135/278] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 5 02:29:38 2022] POST /identity/v3/users => generated 293 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:29:38.601791 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165db56e-ab52-40c7-948d-c204f690361b None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:38.712857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165db56e-ab52-40c7-948d-c204f690361b None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:38.754582 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10494209-10a4-4a81-bd18-0ae7ddbf4f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:38.755618 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10494209-10a4-4a81-bd18-0ae7ddbf4f04 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:38.756115 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10494209-10a4-4a81-bd18-0ae7ddbf4f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:38.757197 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10494209-10a4-4a81-bd18-0ae7ddbf4f04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:38.758189 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10494209-10a4-4a81-bd18-0ae7ddbf4f04 None admin] RBAC: Adding query filter params (role.id=dd9e162a1a25432d871c4c2c0ab779a5, user.id=494b6fb4ec6243c58d47966cf1dee75a, scope.system=all) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:38.758697 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10494209-10a4-4a81-bd18-0ae7ddbf4f04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:38.760423 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10494209-10a4-4a81-bd18-0ae7ddbf4f04 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:38.767071 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 144/279] 10.222.0.42 () {56 vars in 1308 bytes} [Fri Aug 5 02:29:38 2022] GET /identity/v3/role_assignments?user.id=494b6fb4ec6243c58d47966cf1dee75a&scope.system=all&role.id=dd9e162a1a25432d871c4c2c0ab779a5 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:39.206871 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88f136-411c-4f1d-a0a6-2978fa7aa3bd None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:39.207438 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88f136-411c-4f1d-a0a6-2978fa7aa3bd None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:39.207944 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88f136-411c-4f1d-a0a6-2978fa7aa3bd None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:39.209507 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 136/280] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:39.215078 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6ee93-fc14-455d-9510-c816779e66f6 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:39.215375 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6ee93-fc14-455d-9510-c816779e66f6 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:39.215656 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6ee93-fc14-455d-9510-c816779e66f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:39.243630 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-1aa6ee93-fc14-455d-9510-c816779e66f6 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:39.244837 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-1aa6ee93-fc14-455d-9510-c816779e66f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:39.269815 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:39.337866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd93fe-17d0-4302-b2b4-3ede127a702f None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:39.338195 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd93fe-17d0-4302-b2b4-3ede127a702f None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:39.338429 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd93fe-17d0-4302-b2b4-3ede127a702f None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:39.339865 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 137/281] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:39.349439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb119b-479e-4448-a009-89ec7692fd86 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:39.349612 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 145/282] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:29:39.350604 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb119b-479e-4448-a009-89ec7692fd86 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:39.351352 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb119b-479e-4448-a009-89ec7692fd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:39.370482 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-f3fb119b-479e-4448-a009-89ec7692fd86 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:39.372004 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-f3fb119b-479e-4448-a009-89ec7692fd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:39.381223 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6ee93-fc14-455d-9510-c816779e66f6 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:39.472530 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:39.495037 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 138/283] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:29:39.544087 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb119b-479e-4448-a009-89ec7692fd86 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:39.559889 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6ee93-fc14-455d-9510-c816779e66f6 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:39.637106 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188d7ba-2232-4bfb-896d-ad68a07fbb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:39.637774 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188d7ba-2232-4bfb-896d-ad68a07fbb67 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:39.638429 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188d7ba-2232-4bfb-896d-ad68a07fbb67 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:39.638429 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188d7ba-2232-4bfb-896d-ad68a07fbb67 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:39.671851 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e188d7ba-2232-4bfb-896d-ad68a07fbb67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:39.676917 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-e188d7ba-2232-4bfb-896d-ad68a07fbb67 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:29:39.676917 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:39.676917 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:39.676917 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:39.676917 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:39.676917 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:39.676917 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:39.676917 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:39.676917 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:39.676917 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:39.676917 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:39.676917 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:39.676917 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:39.676917 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:39.676917 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:39.676917 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:39.677807 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:39.677807 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:39.677807 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:39.677807 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:39.677807 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:39.677807 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:39.677807 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:39.677807 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:39.677807 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:39.677807 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:39.677807 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:39.677807 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:39.677807 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:39.677807 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:39.677807 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:39.677807 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:39.678652 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:39.678652 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:39.678652 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:39.678652 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:39.678652 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:39.678652 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:39.678652 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:39.678652 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:39.678652 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:39.678652 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:39.678652 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:29:39.678652 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:29:39.682874 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 146/284] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:29:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:29:39.684506 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb119b-479e-4448-a009-89ec7692fd86 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:39.688990 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188d7ba-2232-4bfb-896d-ad68a07fbb67 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:39.721252 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:39.728484 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3526ce72-f3bd-4e4e-8f1d-175543891d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:39.728484 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526ce72-f3bd-4e4e-8f1d-175543891d74 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:39.728484 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526ce72-f3bd-4e4e-8f1d-175543891d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:39.728484 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526ce72-f3bd-4e4e-8f1d-175543891d74 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:39.741223 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3526ce72-f3bd-4e4e-8f1d-175543891d74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:39.747221 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-3526ce72-f3bd-4e4e-8f1d-175543891d74 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 02:29:39.747221 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:39.747221 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:39.747221 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:39.747221 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:39.747221 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:39.747221 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:39.747221 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:39.747221 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:39.747221 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:39.747221 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:39.747221 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:39.747221 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:39.747221 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:39.747221 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:39.747221 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:39.748090 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:39.748090 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:39.748090 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:39.748090 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:39.748090 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:39.748090 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:39.748090 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:39.748090 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:39.748090 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:39.748090 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:39.748090 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:39.748090 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:39.748090 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:39.748090 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:39.748090 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:39.748090 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:39.748883 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:39.748883 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:39.748883 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:39.748883 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:39.748883 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:39.748883 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:39.748883 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:39.748883 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:39.748883 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:39.748883 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:39.748883 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 02:29:39.748883 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:29:39.751740 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 139/285] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:29:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:29:39.758365 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3526ce72-f3bd-4e4e-8f1d-175543891d74 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:39.822701 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:39.873173 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3526ce72-f3bd-4e4e-8f1d-175543891d74 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:39.899302 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188d7ba-2232-4bfb-896d-ad68a07fbb67 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:39.914140 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9c42f-f6dc-4c28-a6bd-c1a58bd74a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:39.915160 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9c42f-f6dc-4c28-a6bd-c1a58bd74a36 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:39.915645 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9c42f-f6dc-4c28-a6bd-c1a58bd74a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:39.916118 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9c42f-f6dc-4c28-a6bd-c1a58bd74a36 None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:39.917037 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c9c42f-f6dc-4c28-a6bd-c1a58bd74a36 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:39.917540 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c9c42f-f6dc-4c28-a6bd-c1a58bd74a36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:39.919239 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c9c42f-f6dc-4c28-a6bd-c1a58bd74a36 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:39.929464 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 140/286] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 5 02:29:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:39.936302 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9c42f-f6dc-4c28-a6bd-c1a58bd74a36 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:40.000211 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b9a626-a383-4532-9d43-49882dd99d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:40.000850 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9a626-a383-4532-9d43-49882dd99d25 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:40.001136 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9a626-a383-4532-9d43-49882dd99d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:40.001418 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9a626-a383-4532-9d43-49882dd99d25 None admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:40.002148 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b9a626-a383-4532-9d43-49882dd99d25 None admin] RBAC: Adding query filter params (name=member) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:40.002459 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b9a626-a383-4532-9d43-49882dd99d25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:40.003906 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b9a626-a383-4532-9d43-49882dd99d25 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:40.022980 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 147/287] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 5 02:29:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:29:40.028437 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b9a626-a383-4532-9d43-49882dd99d25 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:40.057387 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9c42f-f6dc-4c28-a6bd-c1a58bd74a36 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:40.077496 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:40.096802 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285c9c5-9244-426d-b75a-7819dc32b47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:40.097717 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285c9c5-9244-426d-b75a-7819dc32b47e None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:40.100238 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285c9c5-9244-426d-b75a-7819dc32b47e None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:40.100238 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285c9c5-9244-426d-b75a-7819dc32b47e None admin] PATH_INFO: `/v3/users/8609c0a2396347b8a3fcd4558e78fffb` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:40.100238 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3285c9c5-9244-426d-b75a-7819dc32b47e None admin] RBAC: Authorizing `identity:get_user(user_id=8609c0a2396347b8a3fcd4558e78fffb)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:40.102234 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3285c9c5-9244-426d-b75a-7819dc32b47e None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:40.108272 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 141/288] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:29:39 2022] GET /identity/v3/users/8609c0a2396347b8a3fcd4558e78fffb => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:40.113955 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285c9c5-9244-426d-b75a-7819dc32b47e None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:40.159732 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:40.183267 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b9a626-a383-4532-9d43-49882dd99d25 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:40.236638 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72c933-1c12-46ac-94b3-8cc5cd3ef089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:40.237282 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72c933-1c12-46ac-94b3-8cc5cd3ef089 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:40.237560 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72c933-1c12-46ac-94b3-8cc5cd3ef089 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:40.237834 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72c933-1c12-46ac-94b3-8cc5cd3ef089 None admin] PATH_INFO: `/v3/users/8c67c24c6f2a486981602d539e1887f7` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:40.239878 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f72c933-1c12-46ac-94b3-8cc5cd3ef089 None admin] RBAC: Authorizing `identity:get_user(user_id=8c67c24c6f2a486981602d539e1887f7)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:40.241371 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f72c933-1c12-46ac-94b3-8cc5cd3ef089 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:40.247432 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 148/289] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:29:40 2022] GET /identity/v3/users/8c67c24c6f2a486981602d539e1887f7 => generated 297 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:29:40.249311 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72c933-1c12-46ac-94b3-8cc5cd3ef089 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:40.338386 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285c9c5-9244-426d-b75a-7819dc32b47e None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:40.396696 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d7252-18c9-4d60-96fc-45325a27a3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:40.397886 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d7252-18c9-4d60-96fc-45325a27a3ff None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:40.398165 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d7252-18c9-4d60-96fc-45325a27a3ff None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:40.398439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d7252-18c9-4d60-96fc-45325a27a3ff None admin] PATH_INFO: `/v3/projects/31cfb67162854a2b8231ce70ee068c46` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:40.400417 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3d7252-18c9-4d60-96fc-45325a27a3ff None admin] RBAC: Authorizing `identity:get_project(project_id=31cfb67162854a2b8231ce70ee068c46)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:40.401881 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3d7252-18c9-4d60-96fc-45325a27a3ff None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:40.405030 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 142/290] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:29:40 2022] GET /identity/v3/projects/31cfb67162854a2b8231ce70ee068c46 => generated 302 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:29:40.409473 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d7252-18c9-4d60-96fc-45325a27a3ff None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:40.436545 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72c933-1c12-46ac-94b3-8cc5cd3ef089 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:40.502211 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb6ab6-f839-475e-8f34-c12b1c036845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:40.502844 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb6ab6-f839-475e-8f34-c12b1c036845 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:40.503151 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb6ab6-f839-475e-8f34-c12b1c036845 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:40.503432 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb6ab6-f839-475e-8f34-c12b1c036845 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:40.516040 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:40.535374 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:40.603532 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d7252-18c9-4d60-96fc-45325a27a3ff None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:40.628324 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbb6ab6-f839-475e-8f34-c12b1c036845 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:40.629791 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbb6ab6-f839-475e-8f34-c12b1c036845 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:40.683192 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a1e90-9145-4334-81e6-5e74e88fa3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:40.683873 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a1e90-9145-4334-81e6-5e74e88fa3bb None admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:40.684156 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a1e90-9145-4334-81e6-5e74e88fa3bb None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:40.684428 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a1e90-9145-4334-81e6-5e74e88fa3bb None admin] PATH_INFO: `/v3/projects/31cfb67162854a2b8231ce70ee068c46/users/8609c0a2396347b8a3fcd4558e78fffb/roles/d1d918bf6fa5478e8535ec7f1efa8e0c` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:40.692449 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a1e90-9145-4334-81e6-5e74e88fa3bb None admin] RBAC: Authorizing `identity:create_grant(project_id=31cfb67162854a2b8231ce70ee068c46, user_id=8609c0a2396347b8a3fcd4558e78fffb, role_id=d1d918bf6fa5478e8535ec7f1efa8e0c)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:40.694453 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a1e90-9145-4334-81e6-5e74e88fa3bb None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:40.733285 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 149/291] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:29:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 05 02:29:40.738717 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb6ab6-f839-475e-8f34-c12b1c036845 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:40.770594 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 143/292] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 5 02:29:40 2022] PUT /identity/v3/projects/31cfb67162854a2b8231ce70ee068c46/users/8609c0a2396347b8a3fcd4558e78fffb/roles/d1d918bf6fa5478e8535ec7f1efa8e0c => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:29:40.805777 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:40.883352 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb6ab6-f839-475e-8f34-c12b1c036845 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:40.883699 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db182e01-aa4f-47a1-b02b-5ae26cfbf508 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:40.883869 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db182e01-aa4f-47a1-b02b-5ae26cfbf508 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:40.884136 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db182e01-aa4f-47a1-b02b-5ae26cfbf508 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:40.885757 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 144/293] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:40.891315 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa74d0-17cb-4e1d-b422-0c6970dccfaf None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:40.891596 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa74d0-17cb-4e1d-b422-0c6970dccfaf None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:40.891876 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa74d0-17cb-4e1d-b422-0c6970dccfaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:40.933194 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3351bc-c3db-4998-ba4e-5e557fba755f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:40.933845 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3351bc-c3db-4998-ba4e-5e557fba755f None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:40.934176 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3351bc-c3db-4998-ba4e-5e557fba755f None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:40.934453 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3351bc-c3db-4998-ba4e-5e557fba755f None admin] PATH_INFO: `/v3/projects/31cfb67162854a2b8231ce70ee068c46` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:40.935706 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-52fa74d0-17cb-4e1d-b422-0c6970dccfaf None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:40.936899 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-52fa74d0-17cb-4e1d-b422-0c6970dccfaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:40.939597 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3351bc-c3db-4998-ba4e-5e557fba755f None admin] RBAC: Authorizing `identity:get_project(project_id=31cfb67162854a2b8231ce70ee068c46)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:40.941052 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3351bc-c3db-4998-ba4e-5e557fba755f None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:40.947149 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 150/294] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:29:40 2022] GET /identity/v3/projects/31cfb67162854a2b8231ce70ee068c46 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:40.949528 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3351bc-c3db-4998-ba4e-5e557fba755f None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:41.022091 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 145/295] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:29:41.052654 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fa74d0-17cb-4e1d-b422-0c6970dccfaf None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:41.083187 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3351bc-c3db-4998-ba4e-5e557fba755f None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:41.112021 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:41.128699 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:41.141762 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61adf62f-1fdd-45d9-a484-22f2c2a165b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:41.142376 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61adf62f-1fdd-45d9-a484-22f2c2a165b0 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:41.142651 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61adf62f-1fdd-45d9-a484-22f2c2a165b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:41.142918 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61adf62f-1fdd-45d9-a484-22f2c2a165b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:41.143736 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61adf62f-1fdd-45d9-a484-22f2c2a165b0 None admin] RBAC: Adding query filter params (role.id=dd9e162a1a25432d871c4c2c0ab779a5, scope.project.id=31cfb67162854a2b8231ce70ee068c46, user.id=8c67c24c6f2a486981602d539e1887f7) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:41.144043 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61adf62f-1fdd-45d9-a484-22f2c2a165b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:41.145484 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61adf62f-1fdd-45d9-a484-22f2c2a165b0 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:41.152935 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 151/296] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:29:40 2022] GET /identity/v3/role_assignments?user.id=8c67c24c6f2a486981602d539e1887f7&scope.project.id=31cfb67162854a2b8231ce70ee068c46&role.id=dd9e162a1a25432d871c4c2c0ab779a5 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:41.290911 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1fe9b-5469-4cb0-9b87-131edfa2c576 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:41.291246 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1fe9b-5469-4cb0-9b87-131edfa2c576 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:41.291501 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1fe9b-5469-4cb0-9b87-131edfa2c576 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:41.293266 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 152/297] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:29:41.298433 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf82474-2111-4ecc-9eec-3c0fc0aa1603 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:41.298714 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf82474-2111-4ecc-9eec-3c0fc0aa1603 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:41.299006 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf82474-2111-4ecc-9eec-3c0fc0aa1603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:41.329354 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-6bf82474-2111-4ecc-9eec-3c0fc0aa1603 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:41.330546 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-6bf82474-2111-4ecc-9eec-3c0fc0aa1603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:41.351750 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fa74d0-17cb-4e1d-b422-0c6970dccfaf None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:41.395992 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623e867-9469-4288-91bc-4dabd48f8fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:41.396647 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623e867-9469-4288-91bc-4dabd48f8fff None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:41.397492 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623e867-9469-4288-91bc-4dabd48f8fff None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:41.397770 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623e867-9469-4288-91bc-4dabd48f8fff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:41.410039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2623e867-9469-4288-91bc-4dabd48f8fff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:41.416570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-2623e867-9469-4288-91bc-4dabd48f8fff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 02:29:41.416570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:41.416570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:41.416570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:41.416570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:41.416570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:41.416570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:41.416570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:41.416570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:41.416570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:41.416570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:41.416570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:41.416570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:41.416570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:41.416570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:41.416570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:41.417465 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:41.417465 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:41.417465 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:41.417465 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:41.417465 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:41.417465 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:41.417465 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:41.417465 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:41.417465 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:41.417465 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:41.417465 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:41.417465 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:41.417465 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:41.417465 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:41.417465 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:41.417465 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:41.418257 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:41.418257 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:41.418257 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:41.418257 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:41.418257 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:41.418257 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:41.418257 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:41.418257 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:41.418257 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:41.418257 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:41.418257 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 02:29:41.418257 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:29:41.418257 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 146/298] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:29:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:29:41.423918 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623e867-9469-4288-91bc-4dabd48f8fff None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:41.428730 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 153/299] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 05 02:29:41.452389 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf82474-2111-4ecc-9eec-3c0fc0aa1603 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:41.544509 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623e867-9469-4288-91bc-4dabd48f8fff None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:41.547060 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:41.576629 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf82474-2111-4ecc-9eec-3c0fc0aa1603 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:41.583735 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d5f2f-7fd6-4b1d-a4b0-3ce814732854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:41.584399 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d5f2f-7fd6-4b1d-a4b0-3ce814732854 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:41.584678 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d5f2f-7fd6-4b1d-a4b0-3ce814732854 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:41.584947 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d5f2f-7fd6-4b1d-a4b0-3ce814732854 None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:41.585661 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d5f2f-7fd6-4b1d-a4b0-3ce814732854 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:41.585963 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d5f2f-7fd6-4b1d-a4b0-3ce814732854 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:41.587832 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d5f2f-7fd6-4b1d-a4b0-3ce814732854 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:41.591668 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:41.603922 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 147/300] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 5 02:29:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:41.603922 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e46397-67b8-4801-995e-e7ccd3f256bc None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:41.603922 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e46397-67b8-4801-995e-e7ccd3f256bc None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:41.603922 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e46397-67b8-4801-995e-e7ccd3f256bc None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:41.604750 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 148/301] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:41.607862 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e46397-67b8-4801-995e-e7ccd3f256bc None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:41.624137 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68556a15-788b-4cfe-bbd3-81d41e6dc66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:41.624790 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68556a15-788b-4cfe-bbd3-81d41e6dc66c None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:41.625071 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68556a15-788b-4cfe-bbd3-81d41e6dc66c None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:41.625346 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68556a15-788b-4cfe-bbd3-81d41e6dc66c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:41.635886 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68556a15-788b-4cfe-bbd3-81d41e6dc66c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:41.640817 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-68556a15-788b-4cfe-bbd3-81d41e6dc66c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:29:41.640817 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:41.640817 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:41.640817 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:41.640817 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:41.640817 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:41.640817 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:41.640817 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:41.640817 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:41.640817 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:41.640817 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:41.640817 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:41.640817 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:41.640817 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:41.640817 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:41.640817 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:41.641872 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:41.641872 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:41.641872 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:41.641872 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:41.641872 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:41.641872 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:41.641872 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:41.641872 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:41.641872 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:41.641872 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:41.641872 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:41.641872 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:41.641872 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:41.641872 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:41.641872 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:41.641872 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:41.647384 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:41.647384 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:41.647384 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:41.647384 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:41.647384 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:41.647384 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:41.647384 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:41.647384 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:41.647384 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:41.647384 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:41.647384 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:29:41.647384 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:29:41.647384 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 154/302] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:29:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:29:41.647384 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521b184-228d-4c59-ae7b-563402bbc36c None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:41.648215 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521b184-228d-4c59-ae7b-563402bbc36c None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:41.648215 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521b184-228d-4c59-ae7b-563402bbc36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:41.661830 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-e521b184-228d-4c59-ae7b-563402bbc36c None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:41.663573 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-e521b184-228d-4c59-ae7b-563402bbc36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:41.725592 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e46397-67b8-4801-995e-e7ccd3f256bc None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:41.742980 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 155/303] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:29:41.742980 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521b184-228d-4c59-ae7b-563402bbc36c None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:41.767072 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5279f83-2231-47d1-8831-2641ecbdee6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:41.767720 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5279f83-2231-47d1-8831-2641ecbdee6f None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:41.767997 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5279f83-2231-47d1-8831-2641ecbdee6f None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:41.768271 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5279f83-2231-47d1-8831-2641ecbdee6f None admin] PATH_INFO: `/v3/users/f2c713e33ee04e6c991b2274b2609fb4` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:41.783193 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5279f83-2231-47d1-8831-2641ecbdee6f None admin] RBAC: Authorizing `identity:get_user(user_id=f2c713e33ee04e6c991b2274b2609fb4)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:41.784638 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5279f83-2231-47d1-8831-2641ecbdee6f None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:41.786265 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 149/304] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:29:41 2022] GET /identity/v3/users/f2c713e33ee04e6c991b2274b2609fb4 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:41.787037 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5279f83-2231-47d1-8831-2641ecbdee6f None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:41.816516 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:41.854172 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:41.858180 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521b184-228d-4c59-ae7b-563402bbc36c None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:41.897854 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5279f83-2231-47d1-8831-2641ecbdee6f None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:41.906439 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b001d62-eb4e-415f-bbf4-ed924b6c59cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:41.907084 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b001d62-eb4e-415f-bbf4-ed924b6c59cf None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:41.907392 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b001d62-eb4e-415f-bbf4-ed924b6c59cf None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:41.907673 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b001d62-eb4e-415f-bbf4-ed924b6c59cf None admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:41.908450 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b001d62-eb4e-415f-bbf4-ed924b6c59cf None admin] RBAC: Adding query filter params (name=member) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:41.908749 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b001d62-eb4e-415f-bbf4-ed924b6c59cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:41.910248 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b001d62-eb4e-415f-bbf4-ed924b6c59cf None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:41.922758 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 156/305] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 5 02:29:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:41.923593 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b001d62-eb4e-415f-bbf4-ed924b6c59cf None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:41.939827 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306afb3-afab-4b2c-923e-71111f207bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:41.940742 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306afb3-afab-4b2c-923e-71111f207bfb None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:41.941199 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306afb3-afab-4b2c-923e-71111f207bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:41.941687 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306afb3-afab-4b2c-923e-71111f207bfb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:41.943047 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5306afb3-afab-4b2c-923e-71111f207bfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:41.944690 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5306afb3-afab-4b2c-923e-71111f207bfb None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:41.946470 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 150/306] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:29:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:41.947416 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306afb3-afab-4b2c-923e-71111f207bfb None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:42.031588 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b001d62-eb4e-415f-bbf4-ed924b6c59cf None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:42.046928 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:42.057633 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306afb3-afab-4b2c-923e-71111f207bfb None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:42.068271 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a30bbd-b219-4bb9-9fc9-ed5ab7bcbb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:42.069390 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a30bbd-b219-4bb9-9fc9-ed5ab7bcbb71 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:42.069677 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a30bbd-b219-4bb9-9fc9-ed5ab7bcbb71 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:42.070186 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a30bbd-b219-4bb9-9fc9-ed5ab7bcbb71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:42.070732 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a30bbd-b219-4bb9-9fc9-ed5ab7bcbb71 None admin] RBAC: Adding query filter params (role.id=d1d918bf6fa5478e8535ec7f1efa8e0c, user.id=f2c713e33ee04e6c991b2274b2609fb4, scope.system=all) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:42.071087 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a30bbd-b219-4bb9-9fc9-ed5ab7bcbb71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:42.072553 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a30bbd-b219-4bb9-9fc9-ed5ab7bcbb71 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:42.077768 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 157/307] 10.222.0.42 () {56 vars in 1308 bytes} [Fri Aug 5 02:29:41 2022] GET /identity/v3/role_assignments?user.id=f2c713e33ee04e6c991b2274b2609fb4&scope.system=all&role.id=d1d918bf6fa5478e8535ec7f1efa8e0c => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:42.078415 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a30bbd-b219-4bb9-9fc9-ed5ab7bcbb71 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:42.109352 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:42.117413 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c1106-6d8a-4954-951e-22c5cdc08699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:42.118467 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c1106-6d8a-4954-951e-22c5cdc08699 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:42.118896 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c1106-6d8a-4954-951e-22c5cdc08699 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:42.119380 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c1106-6d8a-4954-951e-22c5cdc08699 None admin] PATH_INFO: `/v3/users/494b6fb4ec6243c58d47966cf1dee75a` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:42.120942 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525c1106-6d8a-4954-951e-22c5cdc08699 None admin] RBAC: Authorizing `identity:get_user(user_id=494b6fb4ec6243c58d47966cf1dee75a)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:42.123496 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525c1106-6d8a-4954-951e-22c5cdc08699 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:42.127332 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 151/308] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:29:41 2022] GET /identity/v3/users/494b6fb4ec6243c58d47966cf1dee75a => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:42.131792 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c1106-6d8a-4954-951e-22c5cdc08699 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:42.231457 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a30bbd-b219-4bb9-9fc9-ed5ab7bcbb71 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:42.265131 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c1106-6d8a-4954-951e-22c5cdc08699 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:42.279669 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf9592-1cb6-4b6e-b42c-85166ee5dea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:42.280503 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf9592-1cb6-4b6e-b42c-85166ee5dea0 None admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:42.280929 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf9592-1cb6-4b6e-b42c-85166ee5dea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:42.281349 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf9592-1cb6-4b6e-b42c-85166ee5dea0 None admin] PATH_INFO: `/v3/groups` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:42.282221 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcf9592-1cb6-4b6e-b42c-85166ee5dea0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:42.283931 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcf9592-1cb6-4b6e-b42c-85166ee5dea0 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:42.309422 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f2b1e-8b7e-42c0-862e-62a2026fc293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:42.310093 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f2b1e-8b7e-42c0-862e-62a2026fc293 None admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:42.310377 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f2b1e-8b7e-42c0-862e-62a2026fc293 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:42.310654 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f2b1e-8b7e-42c0-862e-62a2026fc293 None admin] PATH_INFO: `/v3/system/users/494b6fb4ec6243c58d47966cf1dee75a/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:42.312139 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f2b1e-8b7e-42c0-862e-62a2026fc293 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=494b6fb4ec6243c58d47966cf1dee75a, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:42.313520 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f2b1e-8b7e-42c0-862e-62a2026fc293 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:42.358799 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 158/309] 10.222.0.42 () {60 vars in 1134 bytes} [Fri Aug 5 02:29:42 2022] POST /identity/v3/groups => generated 229 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:29:42.382331 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 152/310] 10.222.0.42 () {58 vars in 1334 bytes} [Fri Aug 5 02:29:42 2022] PUT /identity/v3/system/users/494b6fb4ec6243c58d47966cf1dee75a/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:29:43.025209 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1abd307-406d-478a-b502-c17ca7fbb8fc None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:43.025735 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1abd307-406d-478a-b502-c17ca7fbb8fc None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:43.025810 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1abd307-406d-478a-b502-c17ca7fbb8fc None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:43.027419 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 159/311] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:43.032548 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bfe7cc-b608-4f7c-b787-7aeb0dc17e2d None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:43.032949 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bfe7cc-b608-4f7c-b787-7aeb0dc17e2d None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:43.033106 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bfe7cc-b608-4f7c-b787-7aeb0dc17e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:43.051608 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-18bfe7cc-b608-4f7c-b787-7aeb0dc17e2d None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:43.052845 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-18bfe7cc-b608-4f7c-b787-7aeb0dc17e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:43.070699 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:43.121217 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 153/312] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:29:43.144165 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1abd307-406d-478a-b502-c17ca7fbb8fc None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:43.279899 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:43.303157 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1abd307-406d-478a-b502-c17ca7fbb8fc None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:43.348056 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f27ecd-dfa7-4428-8e2e-32d4d286b8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:43.348056 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f27ecd-dfa7-4428-8e2e-32d4d286b8f7 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:43.348056 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f27ecd-dfa7-4428-8e2e-32d4d286b8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:43.348056 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f27ecd-dfa7-4428-8e2e-32d4d286b8f7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:43.365585 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f27ecd-dfa7-4428-8e2e-32d4d286b8f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:43.370747 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-45f27ecd-dfa7-4428-8e2e-32d4d286b8f7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 02:29:43.370747 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:43.370747 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:43.370747 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:43.370747 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:43.370747 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:43.370747 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:43.370747 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:43.370747 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:43.370747 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:43.370747 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:43.370747 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:43.370747 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:43.370747 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:43.370747 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:43.370747 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:43.371820 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:43.371820 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:43.371820 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:43.371820 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:43.371820 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:43.371820 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:43.371820 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:43.371820 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:43.371820 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:43.371820 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:43.371820 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:43.371820 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:43.371820 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:43.371820 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:43.371820 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:43.371820 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:43.372617 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:43.372617 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:43.372617 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:43.372617 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:43.372617 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:43.372617 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:43.372617 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:43.372617 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:43.372617 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:43.372617 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:43.372617 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 02:29:43.372617 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:29:43.374735 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 160/313] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:29:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:29:43.380265 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bfe7cc-b608-4f7c-b787-7aeb0dc17e2d None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:43.545074 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bfe7cc-b608-4f7c-b787-7aeb0dc17e2d None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:43.589573 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398955bc-572d-4ce8-8278-83318a9ee45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:43.590488 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398955bc-572d-4ce8-8278-83318a9ee45d None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:43.591069 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398955bc-572d-4ce8-8278-83318a9ee45d None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:43.591851 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398955bc-572d-4ce8-8278-83318a9ee45d None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:43.593029 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398955bc-572d-4ce8-8278-83318a9ee45d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:43.593732 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398955bc-572d-4ce8-8278-83318a9ee45d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:43.595477 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398955bc-572d-4ce8-8278-83318a9ee45d None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:43.610208 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 154/314] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 5 02:29:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:43.615857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f27ecd-dfa7-4428-8e2e-32d4d286b8f7 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:43.808207 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f27ecd-dfa7-4428-8e2e-32d4d286b8f7 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:43.846499 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd633d3-b2eb-40fc-8a0a-e734f88202db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:43.847172 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd633d3-b2eb-40fc-8a0a-e734f88202db None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:43.847457 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd633d3-b2eb-40fc-8a0a-e734f88202db None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:43.847735 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd633d3-b2eb-40fc-8a0a-e734f88202db None admin] PATH_INFO: `/v3/users/8609c0a2396347b8a3fcd4558e78fffb` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:43.848909 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd633d3-b2eb-40fc-8a0a-e734f88202db None admin] RBAC: Authorizing `identity:get_user(user_id=8609c0a2396347b8a3fcd4558e78fffb)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:43.850413 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd633d3-b2eb-40fc-8a0a-e734f88202db None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:43.852610 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 161/315] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:29:43 2022] GET /identity/v3/users/8609c0a2396347b8a3fcd4558e78fffb => generated 297 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:43.858177 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398955bc-572d-4ce8-8278-83318a9ee45d None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:43.876764 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:43.962836 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398955bc-572d-4ce8-8278-83318a9ee45d None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:43.996283 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7558900-73cf-45c2-8a09-eba1e2c6d885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:43.996901 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7558900-73cf-45c2-8a09-eba1e2c6d885 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:43.997183 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7558900-73cf-45c2-8a09-eba1e2c6d885 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:43.997452 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7558900-73cf-45c2-8a09-eba1e2c6d885 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:44.070351 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7558900-73cf-45c2-8a09-eba1e2c6d885 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:44.071792 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7558900-73cf-45c2-8a09-eba1e2c6d885 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:44.089217 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:44.174663 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 155/316] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:29:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:29:44.181040 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd633d3-b2eb-40fc-8a0a-e734f88202db None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:44.197010 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:44.288859 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd633d3-b2eb-40fc-8a0a-e734f88202db None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:44.298125 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fa920-afea-479e-b75b-6ec660529ed7 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:44.298416 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fa920-afea-479e-b75b-6ec660529ed7 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:44.298695 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fa920-afea-479e-b75b-6ec660529ed7 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:44.300389 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 156/317] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:29:44.307007 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c299bc-a9d3-43ea-8918-c9487df6a676 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:44.307303 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c299bc-a9d3-43ea-8918-c9487df6a676 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:44.307905 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c299bc-a9d3-43ea-8918-c9487df6a676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:44.324840 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f2105-c19f-4ca6-b55e-a039a7d6326f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:44.325410 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f2105-c19f-4ca6-b55e-a039a7d6326f None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:44.325739 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f2105-c19f-4ca6-b55e-a039a7d6326f None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:44.326016 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f2105-c19f-4ca6-b55e-a039a7d6326f None admin] PATH_INFO: `/v3/projects/31cfb67162854a2b8231ce70ee068c46` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:44.327195 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f2105-c19f-4ca6-b55e-a039a7d6326f None admin] RBAC: Authorizing `identity:get_project(project_id=31cfb67162854a2b8231ce70ee068c46)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:44.328639 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f2105-c19f-4ca6-b55e-a039a7d6326f None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:44.328955 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-a9c299bc-a9d3-43ea-8918-c9487df6a676 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:44.330156 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-a9c299bc-a9d3-43ea-8918-c9487df6a676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:44.330599 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 162/318] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:29:44 2022] GET /identity/v3/projects/31cfb67162854a2b8231ce70ee068c46 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:44.339917 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f2105-c19f-4ca6-b55e-a039a7d6326f None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:44.419051 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 157/319] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:29:44.435869 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:44.441020 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c299bc-a9d3-43ea-8918-c9487df6a676 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:44.456463 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f2105-c19f-4ca6-b55e-a039a7d6326f None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:44.494887 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab44ba-59cb-40e9-8d19-6e635cf8833f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:44.495663 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab44ba-59cb-40e9-8d19-6e635cf8833f None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:44.495950 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab44ba-59cb-40e9-8d19-6e635cf8833f None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:44.496230 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab44ba-59cb-40e9-8d19-6e635cf8833f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:44.497015 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab44ba-59cb-40e9-8d19-6e635cf8833f None admin] RBAC: Adding query filter params (role.id=d1d918bf6fa5478e8535ec7f1efa8e0c, scope.project.id=31cfb67162854a2b8231ce70ee068c46, user.id=8609c0a2396347b8a3fcd4558e78fffb) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:44.497326 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab44ba-59cb-40e9-8d19-6e635cf8833f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:44.498897 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab44ba-59cb-40e9-8d19-6e635cf8833f None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:44.499202 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:44.514993 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 163/320] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:29:44 2022] GET /identity/v3/role_assignments?user.id=8609c0a2396347b8a3fcd4558e78fffb&scope.project.id=31cfb67162854a2b8231ce70ee068c46&role.id=d1d918bf6fa5478e8535ec7f1efa8e0c => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:44.532913 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4132ca-130e-4da4-befc-35bff2ed8c0a None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:44.533457 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4132ca-130e-4da4-befc-35bff2ed8c0a None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:44.533914 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4132ca-130e-4da4-befc-35bff2ed8c0a None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:44.535848 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 164/321] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:29:44.543046 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35941c-1ac3-4031-98b9-dc07ae9248f3 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:44.543369 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35941c-1ac3-4031-98b9-dc07ae9248f3 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:44.543875 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35941c-1ac3-4031-98b9-dc07ae9248f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:44.561633 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c299bc-a9d3-43ea-8918-c9487df6a676 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:44.568835 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-5d35941c-1ac3-4031-98b9-dc07ae9248f3 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:44.571201 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-5d35941c-1ac3-4031-98b9-dc07ae9248f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:44.600494 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5093c7-34fa-4197-9eef-81c114c893b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:44.601319 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5093c7-34fa-4197-9eef-81c114c893b2 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:44.601602 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5093c7-34fa-4197-9eef-81c114c893b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:44.601876 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5093c7-34fa-4197-9eef-81c114c893b2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:44.614027 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5093c7-34fa-4197-9eef-81c114c893b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:44.619737 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-ef5093c7-34fa-4197-9eef-81c114c893b2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 02:29:44.619737 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:44.619737 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:44.619737 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:44.619737 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:44.619737 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:44.619737 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:44.619737 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:44.619737 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:44.619737 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:44.619737 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:44.619737 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:44.619737 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:44.619737 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:44.619737 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:44.619737 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:44.620691 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:44.620691 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:44.620691 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:44.620691 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:44.620691 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:44.620691 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:44.620691 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:44.620691 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:44.620691 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:44.620691 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:44.620691 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:44.620691 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:44.620691 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:44.620691 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:44.620691 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:44.620691 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:44.627539 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:44.627539 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:44.627539 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:44.627539 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:44.627539 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:44.627539 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:44.627539 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:44.627539 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:44.627539 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:44.627539 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:44.627539 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 02:29:44.627539 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:29:44.627539 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 158/322] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:29:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:29:44.627539 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7fbcb-8fa2-42ef-a956-9e84a9ed5f09 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:44.628269 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7fbcb-8fa2-42ef-a956-9e84a9ed5f09 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:44.628269 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7fbcb-8fa2-42ef-a956-9e84a9ed5f09 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:44.628269 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 159/323] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:44.630579 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2188d4-a1a2-4dc4-85d9-0a7b91d4a0af None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:44.630865 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2188d4-a1a2-4dc4-85d9-0a7b91d4a0af None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:44.631356 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2188d4-a1a2-4dc4-85d9-0a7b91d4a0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:44.650679 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-bb2188d4-a1a2-4dc4-85d9-0a7b91d4a0af None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:44.652099 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-bb2188d4-a1a2-4dc4-85d9-0a7b91d4a0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:44.657244 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 165/324] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:29:44.658401 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35941c-1ac3-4031-98b9-dc07ae9248f3 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:44.731388 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 160/325] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:29:44.732245 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2188d4-a1a2-4dc4-85d9-0a7b91d4a0af None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:44.764315 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:44.768069 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:44.785708 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35941c-1ac3-4031-98b9-dc07ae9248f3 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:44.819762 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4772465-a5ef-41c5-8946-1be6bd004a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:44.820435 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4772465-a5ef-41c5-8946-1be6bd004a27 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:44.820718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4772465-a5ef-41c5-8946-1be6bd004a27 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:44.820991 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4772465-a5ef-41c5-8946-1be6bd004a27 None admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:44.821727 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4772465-a5ef-41c5-8946-1be6bd004a27 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:44.822029 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4772465-a5ef-41c5-8946-1be6bd004a27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:44.823488 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4772465-a5ef-41c5-8946-1be6bd004a27 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:44.830634 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2188d4-a1a2-4dc4-85d9-0a7b91d4a0af None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:44.831673 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 166/326] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 5 02:29:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:44.832453 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4772465-a5ef-41c5-8946-1be6bd004a27 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:44.870201 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a6cf1-5446-4f27-ad54-ea215ee308fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:44.870768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a6cf1-5446-4f27-ad54-ea215ee308fc None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:44.871104 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a6cf1-5446-4f27-ad54-ea215ee308fc None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:44.871382 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a6cf1-5446-4f27-ad54-ea215ee308fc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:44.872521 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a6cf1-5446-4f27-ad54-ea215ee308fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:44.873975 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a6cf1-5446-4f27-ad54-ea215ee308fc None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:44.875591 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 161/327] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:29:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:44.876348 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a6cf1-5446-4f27-ad54-ea215ee308fc None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:44.934406 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4772465-a5ef-41c5-8946-1be6bd004a27 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:44.968392 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea5dca-817d-479c-a88c-72adcd86f02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:44.969024 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea5dca-817d-479c-a88c-72adcd86f02b None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:44.969301 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea5dca-817d-479c-a88c-72adcd86f02b None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:44.969574 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea5dca-817d-479c-a88c-72adcd86f02b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:44.971406 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a6cf1-5446-4f27-ad54-ea215ee308fc None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:44.972191 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:44.974736 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:44.980467 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea5dca-817d-479c-a88c-72adcd86f02b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:44.985358 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-a8ea5dca-817d-479c-a88c-72adcd86f02b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:29:44.985358 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:44.985358 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:44.985358 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:44.985358 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:44.985358 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:44.985358 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:44.985358 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:44.985358 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:44.985358 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:44.985358 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:44.985358 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:44.985358 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:44.985358 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:44.985358 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:44.985358 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:44.986420 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:44.986420 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:44.986420 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:44.986420 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:44.986420 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:44.986420 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:44.986420 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:44.986420 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:44.986420 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:44.986420 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:44.986420 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:44.986420 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:44.986420 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:44.986420 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:44.986420 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:44.986420 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:44.987488 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:44.987488 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:44.987488 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:44.987488 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:44.987488 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:44.987488 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:44.987488 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:44.987488 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:44.987488 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:44.987488 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:44.987488 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:29:44.987488 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:29:44.987488 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 167/328] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:29:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:29:44.989262 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea5dca-817d-479c-a88c-72adcd86f02b None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:45.005882 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c8cc6-891c-4b0b-806d-e50ab379b6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:45.007178 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c8cc6-891c-4b0b-806d-e50ab379b6d1 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:45.007460 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c8cc6-891c-4b0b-806d-e50ab379b6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:45.007736 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c8cc6-891c-4b0b-806d-e50ab379b6d1 None admin] PATH_INFO: `/v3/users/f2c713e33ee04e6c991b2274b2609fb4` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:45.017462 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471c8cc6-891c-4b0b-806d-e50ab379b6d1 None admin] RBAC: Authorizing `identity:get_user(user_id=f2c713e33ee04e6c991b2274b2609fb4)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:45.017462 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471c8cc6-891c-4b0b-806d-e50ab379b6d1 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:45.017462 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 162/329] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:29:44 2022] GET /identity/v3/users/f2c713e33ee04e6c991b2274b2609fb4 => generated 293 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:45.017462 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c8cc6-891c-4b0b-806d-e50ab379b6d1 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:45.086683 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea5dca-817d-479c-a88c-72adcd86f02b None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:45.113837 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c8cc6-891c-4b0b-806d-e50ab379b6d1 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:45.120427 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c71fbd-c48a-47c4-8ebe-bdf2b3dea3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:45.120984 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c71fbd-c48a-47c4-8ebe-bdf2b3dea3b2 None admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:45.121269 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c71fbd-c48a-47c4-8ebe-bdf2b3dea3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:45.121550 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c71fbd-c48a-47c4-8ebe-bdf2b3dea3b2 None admin] PATH_INFO: `/v3/groups` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:45.122203 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c71fbd-c48a-47c4-8ebe-bdf2b3dea3b2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:45.123692 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c71fbd-c48a-47c4-8ebe-bdf2b3dea3b2 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:45.146576 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a8d63-3db0-4c96-b141-96416dab1d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:45.147215 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a8d63-3db0-4c96-b141-96416dab1d4c None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:45.147494 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a8d63-3db0-4c96-b141-96416dab1d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:45.147763 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a8d63-3db0-4c96-b141-96416dab1d4c None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:45.148473 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a8d63-3db0-4c96-b141-96416dab1d4c None admin] RBAC: Adding query filter params (name=member) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:45.148770 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a8d63-3db0-4c96-b141-96416dab1d4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:45.150119 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a8d63-3db0-4c96-b141-96416dab1d4c None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:45.157720 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 163/330] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 5 02:29:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:45.159611 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a8d63-3db0-4c96-b141-96416dab1d4c None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:45.193434 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:45.209692 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 168/331] 10.222.0.42 () {60 vars in 1134 bytes} [Fri Aug 5 02:29:44 2022] POST /identity/v3/groups => generated 226 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:29:45.210511 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c71fbd-c48a-47c4-8ebe-bdf2b3dea3b2 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:45.264056 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a8d63-3db0-4c96-b141-96416dab1d4c None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:45.293419 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:45.308192 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a70550-c62d-462d-a9ca-44a233105a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:45.308876 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a70550-c62d-462d-a9ca-44a233105a88 None admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:45.309164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a70550-c62d-462d-a9ca-44a233105a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:45.310675 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a70550-c62d-462d-a9ca-44a233105a88 None admin] PATH_INFO: `/v3/system/users/f2c713e33ee04e6c991b2274b2609fb4/roles/d1d918bf6fa5478e8535ec7f1efa8e0c` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:45.314995 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a70550-c62d-462d-a9ca-44a233105a88 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f2c713e33ee04e6c991b2274b2609fb4, role_id=d1d918bf6fa5478e8535ec7f1efa8e0c)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:45.316520 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a70550-c62d-462d-a9ca-44a233105a88 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:45.341270 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c71fbd-c48a-47c4-8ebe-bdf2b3dea3b2 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:45.376830 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1d44b-ad61-41ca-8cff-95aa65dbc514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:45.377029 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 164/332] 10.222.0.42 () {58 vars in 1334 bytes} [Fri Aug 5 02:29:45 2022] PUT /identity/v3/system/users/f2c713e33ee04e6c991b2274b2609fb4/roles/d1d918bf6fa5478e8535ec7f1efa8e0c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:29:45.377468 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1d44b-ad61-41ca-8cff-95aa65dbc514 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:45.377815 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1d44b-ad61-41ca-8cff-95aa65dbc514 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:45.378102 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1d44b-ad61-41ca-8cff-95aa65dbc514 None admin] PATH_INFO: `/v3/users/494b6fb4ec6243c58d47966cf1dee75a` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:45.379499 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c1d44b-ad61-41ca-8cff-95aa65dbc514 None admin] RBAC: Authorizing `identity:get_user(user_id=494b6fb4ec6243c58d47966cf1dee75a)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:45.381038 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c1d44b-ad61-41ca-8cff-95aa65dbc514 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:45.383242 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 169/333] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:29:45 2022] GET /identity/v3/users/494b6fb4ec6243c58d47966cf1dee75a => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:45.389637 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a70550-c62d-462d-a9ca-44a233105a88 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:45.501157 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:45.506017 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a70550-c62d-462d-a9ca-44a233105a88 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:45.547059 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23555507-d834-4621-b2b8-eeff6b1a638c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:45.547720 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23555507-d834-4621-b2b8-eeff6b1a638c None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:45.547968 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23555507-d834-4621-b2b8-eeff6b1a638c None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:45.548240 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23555507-d834-4621-b2b8-eeff6b1a638c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:45.549040 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23555507-d834-4621-b2b8-eeff6b1a638c None admin] RBAC: Adding query filter params (role.id=dd9e162a1a25432d871c4c2c0ab779a5, user.id=494b6fb4ec6243c58d47966cf1dee75a, scope.system=all) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:45.549384 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23555507-d834-4621-b2b8-eeff6b1a638c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:45.550777 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23555507-d834-4621-b2b8-eeff6b1a638c None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:45.564364 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 165/334] 10.222.0.42 () {56 vars in 1308 bytes} [Fri Aug 5 02:29:45 2022] GET /identity/v3/role_assignments?user.id=494b6fb4ec6243c58d47966cf1dee75a&scope.system=all&role.id=dd9e162a1a25432d871c4c2c0ab779a5 => generated 510 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:47.485008 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b58398-cbdf-4dba-aca3-5c97bd67bb1d None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:47.485527 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b58398-cbdf-4dba-aca3-5c97bd67bb1d None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:47.485598 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b58398-cbdf-4dba-aca3-5c97bd67bb1d None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:47.487161 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 170/335] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:47.493565 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ffe52-80b8-48e8-855b-bab83634eda0 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:47.494013 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ffe52-80b8-48e8-855b-bab83634eda0 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:47.494118 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ffe52-80b8-48e8-855b-bab83634eda0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:47.514733 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-ab6ffe52-80b8-48e8-855b-bab83634eda0 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:47.516007 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-ab6ffe52-80b8-48e8-855b-bab83634eda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:47.590750 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 166/336] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:29:47.614664 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b58398-cbdf-4dba-aca3-5c97bd67bb1d None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:47.733631 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b58398-cbdf-4dba-aca3-5c97bd67bb1d None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:47.758346 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:47.768845 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5334489c-4f39-4ad3-8283-8ace421b5b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:47.769494 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334489c-4f39-4ad3-8283-8ace421b5b47 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:47.769777 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334489c-4f39-4ad3-8283-8ace421b5b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:47.770052 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334489c-4f39-4ad3-8283-8ace421b5b47 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:47.781203 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5334489c-4f39-4ad3-8283-8ace421b5b47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:47.786231 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-5334489c-4f39-4ad3-8283-8ace421b5b47 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 02:29:47.786231 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:47.786231 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:47.786231 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:47.786231 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:47.786231 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:47.786231 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:47.786231 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:47.786231 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:47.786231 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:47.786231 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:47.786231 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:47.786231 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:47.786231 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:47.786231 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:47.786231 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:47.791805 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:47.791805 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:47.791805 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:47.791805 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:47.791805 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:47.791805 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:47.791805 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:47.791805 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:47.791805 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:47.791805 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:47.791805 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:47.791805 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:47.791805 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:47.791805 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:47.791805 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:47.791805 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:47.792919 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:47.792919 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:47.792919 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:47.792919 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:47.792919 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:47.792919 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:47.792919 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:47.792919 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:47.792919 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:47.792919 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:47.792919 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 02:29:47.792919 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:29:47.792919 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 171/337] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:29:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:29:47.793817 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ffe52-80b8-48e8-855b-bab83634eda0 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:47.885063 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:47.900296 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ffe52-80b8-48e8-855b-bab83634eda0 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:47.942422 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae7c93-366c-43ab-b909-5f4d3af52ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:47.943077 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae7c93-366c-43ab-b909-5f4d3af52ebf None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:47.943477 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae7c93-366c-43ab-b909-5f4d3af52ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:47.944210 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae7c93-366c-43ab-b909-5f4d3af52ebf None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:47.944944 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae7c93-366c-43ab-b909-5f4d3af52ebf None admin] RBAC: Adding query filter params (name=reader) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:47.945248 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae7c93-366c-43ab-b909-5f4d3af52ebf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:47.946636 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae7c93-366c-43ab-b909-5f4d3af52ebf None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:47.955459 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 167/338] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 5 02:29:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:29:47.960978 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5334489c-4f39-4ad3-8283-8ace421b5b47 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:48.044542 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86e92e-22e6-4d80-b219-03cf1e030b36 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:48.044863 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86e92e-22e6-4d80-b219-03cf1e030b36 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:48.045082 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86e92e-22e6-4d80-b219-03cf1e030b36 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:48.046704 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 168/339] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:48.072451 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f598dc7-8637-452e-a59c-b91530348d09 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:48.072750 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f598dc7-8637-452e-a59c-b91530348d09 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:48.072995 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f598dc7-8637-452e-a59c-b91530348d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:48.102847 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5334489c-4f39-4ad3-8283-8ace421b5b47 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:48.105990 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-7f598dc7-8637-452e-a59c-b91530348d09 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:48.107177 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-7f598dc7-8637-452e-a59c-b91530348d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:48.149738 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948343a2-9da1-43ff-935c-cf271f1e5f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:48.150315 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948343a2-9da1-43ff-935c-cf271f1e5f54 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:48.150598 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948343a2-9da1-43ff-935c-cf271f1e5f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:48.150872 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948343a2-9da1-43ff-935c-cf271f1e5f54 None admin] PATH_INFO: `/v3/users/f2c713e33ee04e6c991b2274b2609fb4` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:48.153380 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948343a2-9da1-43ff-935c-cf271f1e5f54 None admin] RBAC: Authorizing `identity:get_user(user_id=f2c713e33ee04e6c991b2274b2609fb4)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:48.154853 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948343a2-9da1-43ff-935c-cf271f1e5f54 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:48.156540 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 172/340] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:29:47 2022] GET /identity/v3/users/f2c713e33ee04e6c991b2274b2609fb4 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:48.162978 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948343a2-9da1-43ff-935c-cf271f1e5f54 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:48.217352 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 169/341] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:29:48.218668 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660bcc17-f1c6-4eea-a9d7-3eb6b9cae9b7 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:48.218982 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660bcc17-f1c6-4eea-a9d7-3eb6b9cae9b7 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:48.223326 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660bcc17-f1c6-4eea-a9d7-3eb6b9cae9b7 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:48.225214 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 170/342] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:48.231281 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feab46d-6e16-4aa9-8ea2-41ac837e47c3 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:48.231570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feab46d-6e16-4aa9-8ea2-41ac837e47c3 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:48.231852 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feab46d-6e16-4aa9-8ea2-41ac837e47c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:48.244016 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:48.253285 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-4feab46d-6e16-4aa9-8ea2-41ac837e47c3 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:48.254485 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-4feab46d-6e16-4aa9-8ea2-41ac837e47c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:48.312051 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948343a2-9da1-43ff-935c-cf271f1e5f54 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:48.342982 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 171/343] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:29:48.343940 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feab46d-6e16-4aa9-8ea2-41ac837e47c3 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:48.355393 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:48.373760 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39ef3a-ea92-4faa-8ed0-10d72d1ee847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:48.374714 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39ef3a-ea92-4faa-8ed0-10d72d1ee847 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:48.375230 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39ef3a-ea92-4faa-8ed0-10d72d1ee847 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:48.375693 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39ef3a-ea92-4faa-8ed0-10d72d1ee847 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:48.376678 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef39ef3a-ea92-4faa-8ed0-10d72d1ee847 None admin] RBAC: Adding query filter params (role.id=d1d918bf6fa5478e8535ec7f1efa8e0c, user.id=f2c713e33ee04e6c991b2274b2609fb4, scope.system=all) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:48.377171 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef39ef3a-ea92-4faa-8ed0-10d72d1ee847 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:48.378828 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef39ef3a-ea92-4faa-8ed0-10d72d1ee847 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:48.408035 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 173/344] 10.222.0.42 () {56 vars in 1308 bytes} [Fri Aug 5 02:29:48 2022] GET /identity/v3/role_assignments?user.id=f2c713e33ee04e6c991b2274b2609fb4&scope.system=all&role.id=d1d918bf6fa5478e8535ec7f1efa8e0c => generated 510 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:48.408935 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39ef3a-ea92-4faa-8ed0-10d72d1ee847 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:48.582827 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feab46d-6e16-4aa9-8ea2-41ac837e47c3 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:48.624347 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39ef3a-ea92-4faa-8ed0-10d72d1ee847 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:48.630520 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64f814-b7d0-4c0a-b073-7667661f69fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:48.631361 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64f814-b7d0-4c0a-b073-7667661f69fc None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:48.631671 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64f814-b7d0-4c0a-b073-7667661f69fc None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:48.631916 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64f814-b7d0-4c0a-b073-7667661f69fc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:48.639721 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:48.648772 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64f814-b7d0-4c0a-b073-7667661f69fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:48.653842 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-ad64f814-b7d0-4c0a-b073-7667661f69fc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:29:48.653842 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:48.653842 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:48.653842 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:48.653842 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:48.653842 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:48.653842 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:48.653842 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:48.653842 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:48.653842 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:48.653842 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:48.653842 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:48.653842 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:48.653842 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:48.653842 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:48.653842 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:48.654703 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:48.654703 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:48.654703 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:48.654703 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:48.654703 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:48.654703 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:48.654703 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:48.654703 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:48.654703 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:48.654703 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:48.654703 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:48.654703 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:48.654703 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:48.654703 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:48.654703 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:48.654703 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:48.656036 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:48.656036 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:48.656036 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:48.656036 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:48.656036 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:48.656036 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:48.656036 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:48.656036 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:48.656036 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:48.656036 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:48.656036 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:29:48.656036 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:29:48.656036 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 172/345] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:29:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:29:48.656986 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c39fef-48ed-4c0e-9fb8-e5e05c1d6f5e None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:48.657148 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c39fef-48ed-4c0e-9fb8-e5e05c1d6f5e None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:48.657429 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c39fef-48ed-4c0e-9fb8-e5e05c1d6f5e None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:48.660617 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 173/346] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:48.663939 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c39fef-48ed-4c0e-9fb8-e5e05c1d6f5e None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:48.676465 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f91c48-df00-445c-941b-10fdeef6a440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:48.678616 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f91c48-df00-445c-941b-10fdeef6a440 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:48.679178 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f91c48-df00-445c-941b-10fdeef6a440 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:48.679647 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f91c48-df00-445c-941b-10fdeef6a440 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:48.691787 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f91c48-df00-445c-941b-10fdeef6a440 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:48.698008 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-f6f91c48-df00-445c-941b-10fdeef6a440 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:29:48.698008 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:48.698008 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:48.698008 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:48.698008 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:48.698008 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:48.698008 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:48.698008 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:48.698008 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:48.698008 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:48.698008 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:48.698008 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:48.698008 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:48.698008 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:48.698008 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:48.698008 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:48.699054 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:48.699054 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:48.699054 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:48.699054 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:48.699054 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:48.699054 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:48.699054 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:48.699054 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:48.699054 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:48.699054 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:48.699054 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:48.699054 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:48.699054 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:48.699054 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:48.699054 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:48.699054 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:48.699866 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:48.699866 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:48.699866 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:48.699866 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:48.699866 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:48.699866 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:48.699866 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:48.699866 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:48.699866 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:48.699866 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:48.699866 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:29:48.699866 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:29:48.705882 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 174/347] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:29:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:29:48.707574 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc566b-bd9e-4c03-bbf2-b4b5ccd0d4cf None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:48.708236 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc566b-bd9e-4c03-bbf2-b4b5ccd0d4cf None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:48.708702 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc566b-bd9e-4c03-bbf2-b4b5ccd0d4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:48.731502 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-9ebc566b-bd9e-4c03-bbf2-b4b5ccd0d4cf None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:48.733088 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-9ebc566b-bd9e-4c03-bbf2-b4b5ccd0d4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:48.745692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:48.785748 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c39fef-48ed-4c0e-9fb8-e5e05c1d6f5e None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:48.816257 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 175/348] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:29:48.817121 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc566b-bd9e-4c03-bbf2-b4b5ccd0d4cf None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:48.833320 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bbac5e-820d-484e-bb3d-d1622dcaf794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:48.834574 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbac5e-820d-484e-bb3d-d1622dcaf794 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:48.834801 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbac5e-820d-484e-bb3d-d1622dcaf794 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:48.835111 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbac5e-820d-484e-bb3d-d1622dcaf794 None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:48.835845 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bbac5e-820d-484e-bb3d-d1622dcaf794 None admin] RBAC: Adding query filter params (name=member) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:48.836152 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bbac5e-820d-484e-bb3d-d1622dcaf794 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:48.837557 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bbac5e-820d-484e-bb3d-d1622dcaf794 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:48.853853 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 174/349] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 5 02:29:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:48.854733 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bbac5e-820d-484e-bb3d-d1622dcaf794 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:48.946980 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:48.950223 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc566b-bd9e-4c03-bbf2-b4b5ccd0d4cf None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:48.972879 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bbac5e-820d-484e-bb3d-d1622dcaf794 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:48.993480 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea6833-b664-4a89-a88b-5b92257d5d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:48.994249 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea6833-b664-4a89-a88b-5b92257d5d83 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:48.994709 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea6833-b664-4a89-a88b-5b92257d5d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:48.995110 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea6833-b664-4a89-a88b-5b92257d5d83 None admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:48.995935 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea6833-b664-4a89-a88b-5b92257d5d83 None admin] RBAC: Adding query filter params (name=member) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:48.996776 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea6833-b664-4a89-a88b-5b92257d5d83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:48.998564 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea6833-b664-4a89-a88b-5b92257d5d83 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:49.009407 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:49.010411 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 176/350] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 5 02:29:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:49.011642 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea6833-b664-4a89-a88b-5b92257d5d83 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:49.013829 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c0724-d8bf-491e-807f-75898d8be320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:49.014757 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c0724-d8bf-491e-807f-75898d8be320 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:49.015193 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c0724-d8bf-491e-807f-75898d8be320 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:49.015479 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c0724-d8bf-491e-807f-75898d8be320 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:49.027988 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c0724-d8bf-491e-807f-75898d8be320 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:49.034808 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-589c0724-d8bf-491e-807f-75898d8be320 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:29:49.034808 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:49.034808 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:49.034808 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:49.034808 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:49.034808 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:49.034808 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:49.034808 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:49.034808 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:49.034808 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:49.034808 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:49.034808 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:49.034808 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:49.034808 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:49.034808 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:49.034808 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:49.039498 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:49.039498 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:49.039498 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:49.039498 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:49.039498 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:49.039498 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:49.039498 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:49.039498 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:49.039498 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:49.039498 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:49.039498 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:49.039498 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:49.039498 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:49.039498 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:49.039498 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:49.039498 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:49.040746 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:49.040746 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:49.040746 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:49.040746 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:49.040746 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:49.040746 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:49.040746 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:49.040746 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:49.040746 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:49.040746 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:49.040746 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:29:49.040746 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:29:49.040746 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 175/351] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 5 02:29:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:29:49.040746 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c0724-d8bf-491e-807f-75898d8be320 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:49.137408 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea6833-b664-4a89-a88b-5b92257d5d83 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:49.156773 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c0724-d8bf-491e-807f-75898d8be320 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:49.176691 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d411a-2173-4e08-89c5-7d1bcf8e2bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:49.177346 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d411a-2173-4e08-89c5-7d1bcf8e2bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:49.177657 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d411a-2173-4e08-89c5-7d1bcf8e2bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:49.178467 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d411a-2173-4e08-89c5-7d1bcf8e2bb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:49.197690 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d4997-5575-409d-94be-d4184190fe84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:49.198249 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d4997-5575-409d-94be-d4184190fe84 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:49.198636 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d4997-5575-409d-94be-d4184190fe84 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:49.198919 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d4997-5575-409d-94be-d4184190fe84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:49.214187 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:49.258015 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d411a-2173-4e08-89c5-7d1bcf8e2bb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:49.260576 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d411a-2173-4e08-89c5-7d1bcf8e2bb1 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:49.267311 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:49.275785 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d4997-5575-409d-94be-d4184190fe84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:49.277338 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d4997-5575-409d-94be-d4184190fe84 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:49.407144 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 177/352] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:29:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:29:49.408029 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d411a-2173-4e08-89c5-7d1bcf8e2bb1 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:49.418007 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 176/353] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:29:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:29:49.418920 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d4997-5575-409d-94be-d4184190fe84 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:49.489942 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:49.524997 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:49.541199 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d4997-5575-409d-94be-d4184190fe84 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:49.547270 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d411a-2173-4e08-89c5-7d1bcf8e2bb1 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:49.580744 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7aea88-d07b-4275-ba35-27b1c86f9819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:49.581413 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7aea88-d07b-4275-ba35-27b1c86f9819 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:49.581666 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7aea88-d07b-4275-ba35-27b1c86f9819 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:49.581941 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7aea88-d07b-4275-ba35-27b1c86f9819 None admin] PATH_INFO: `/v3/projects/31cfb67162854a2b8231ce70ee068c46` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:49.583151 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7aea88-d07b-4275-ba35-27b1c86f9819 None admin] RBAC: Authorizing `identity:get_project(project_id=31cfb67162854a2b8231ce70ee068c46)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:49.584659 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7aea88-d07b-4275-ba35-27b1c86f9819 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:49.585911 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f18ad2-d47c-4953-bb61-7b04530b8941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:49.586313 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 177/354] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:29:49 2022] GET /identity/v3/projects/31cfb67162854a2b8231ce70ee068c46 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:49.586980 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f18ad2-d47c-4953-bb61-7b04530b8941 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:49.587102 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7aea88-d07b-4275-ba35-27b1c86f9819 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:49.587580 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f18ad2-d47c-4953-bb61-7b04530b8941 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:49.588061 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f18ad2-d47c-4953-bb61-7b04530b8941 None admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:49.588974 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f18ad2-d47c-4953-bb61-7b04530b8941 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:49.589472 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f18ad2-d47c-4953-bb61-7b04530b8941 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:49.591071 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f18ad2-d47c-4953-bb61-7b04530b8941 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:49.602163 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 178/355] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:29:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:49.603257 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f55c06-8527-40e9-a91c-24d3d9ea588d None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:49.603567 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f55c06-8527-40e9-a91c-24d3d9ea588d None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:49.603980 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f55c06-8527-40e9-a91c-24d3d9ea588d None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:49.609043 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 179/356] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:49.609043 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f55c06-8527-40e9-a91c-24d3d9ea588d None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:49.731951 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7aea88-d07b-4275-ba35-27b1c86f9819 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:49.754532 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f55c06-8527-40e9-a91c-24d3d9ea588d None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:49.774106 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048cda18-ef9c-4c7c-9398-208bdf4f35a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:49.774766 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cda18-ef9c-4c7c-9398-208bdf4f35a6 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:49.775109 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cda18-ef9c-4c7c-9398-208bdf4f35a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:49.775764 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cda18-ef9c-4c7c-9398-208bdf4f35a6 None admin] PATH_INFO: `/v3/projects/4e2cf55519e4431b85bdc27977f9165d` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:49.776582 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048cda18-ef9c-4c7c-9398-208bdf4f35a6 None admin] RBAC: Authorizing `identity:get_project(project_id=4e2cf55519e4431b85bdc27977f9165d)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:49.778050 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048cda18-ef9c-4c7c-9398-208bdf4f35a6 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:49.779930 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 178/357] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:29:49 2022] GET /identity/v3/projects/4e2cf55519e4431b85bdc27977f9165d => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:49.780464 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:49.780572 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048cda18-ef9c-4c7c-9398-208bdf4f35a6 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:49.797761 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27409cb4-7416-4731-8d86-6d5e96f93aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:49.798410 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27409cb4-7416-4731-8d86-6d5e96f93aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:49.798693 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27409cb4-7416-4731-8d86-6d5e96f93aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:49.799003 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27409cb4-7416-4731-8d86-6d5e96f93aa0 None admin] PATH_INFO: `/v3/groups/b12a8762f5fa4389903f78f3b2d31e61` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:49.806787 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27409cb4-7416-4731-8d86-6d5e96f93aa0 None admin] RBAC: Authorizing `identity:get_group(group_id=b12a8762f5fa4389903f78f3b2d31e61)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:49.808157 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27409cb4-7416-4731-8d86-6d5e96f93aa0 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:49.810206 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 180/358] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Aug 5 02:29:49 2022] GET /identity/v3/groups/b12a8762f5fa4389903f78f3b2d31e61 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:49.811463 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c1845-875e-4284-867d-c40bb37c0885 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:49.812732 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c1845-875e-4284-867d-c40bb37c0885 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:49.813015 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c1845-875e-4284-867d-c40bb37c0885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:49.825320 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:49.839153 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-3d4c1845-875e-4284-867d-c40bb37c0885 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:49.840385 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-3d4c1845-875e-4284-867d-c40bb37c0885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:49.918922 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048cda18-ef9c-4c7c-9398-208bdf4f35a6 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:49.930997 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 181/359] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:29:49.930997 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c1845-875e-4284-867d-c40bb37c0885 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:49.965171 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac332a3a-082d-46d3-a12d-b720355af174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:49.965831 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac332a3a-082d-46d3-a12d-b720355af174 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:49.967091 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac332a3a-082d-46d3-a12d-b720355af174 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:49.967091 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac332a3a-082d-46d3-a12d-b720355af174 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:50.051562 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac332a3a-082d-46d3-a12d-b720355af174 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:50.053281 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac332a3a-082d-46d3-a12d-b720355af174 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:50.057097 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c1845-875e-4284-867d-c40bb37c0885 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:50.079375 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:50.081396 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:50.101839 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357ad21-5ca0-407f-bbf5-d30188ddeaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:50.102495 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357ad21-5ca0-407f-bbf5-d30188ddeaa3 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:50.102780 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357ad21-5ca0-407f-bbf5-d30188ddeaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:50.103120 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357ad21-5ca0-407f-bbf5-d30188ddeaa3 None admin] PATH_INFO: `/v3/groups/b12a8762f5fa4389903f78f3b2d31e61` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:50.104309 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4357ad21-5ca0-407f-bbf5-d30188ddeaa3 None admin] RBAC: Authorizing `identity:get_group(group_id=b12a8762f5fa4389903f78f3b2d31e61)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:50.105778 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4357ad21-5ca0-407f-bbf5-d30188ddeaa3 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:50.107473 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 182/360] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Aug 5 02:29:49 2022] GET /identity/v3/groups/b12a8762f5fa4389903f78f3b2d31e61 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:50.108233 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357ad21-5ca0-407f-bbf5-d30188ddeaa3 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:50.169682 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 179/361] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:29:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:29:50.171415 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ab447-80d8-468b-9bef-2f3bace82b22 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:50.171906 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ab447-80d8-468b-9bef-2f3bace82b22 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:50.172329 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ab447-80d8-468b-9bef-2f3bace82b22 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:50.177658 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 180/362] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:50.178691 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ab447-80d8-468b-9bef-2f3bace82b22 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:50.228114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357ad21-5ca0-407f-bbf5-d30188ddeaa3 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:50.266501 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ff066-a801-4047-9281-8387b8f9a35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:50.267163 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ff066-a801-4047-9281-8387b8f9a35c None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:50.267441 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ff066-a801-4047-9281-8387b8f9a35c None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:50.270287 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ff066-a801-4047-9281-8387b8f9a35c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:50.270287 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890ff066-a801-4047-9281-8387b8f9a35c None admin] RBAC: Adding query filter params (group.id=b12a8762f5fa4389903f78f3b2d31e61, role.id=dd9e162a1a25432d871c4c2c0ab779a5, scope.project.id=31cfb67162854a2b8231ce70ee068c46) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:50.270287 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890ff066-a801-4047-9281-8387b8f9a35c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:50.270287 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890ff066-a801-4047-9281-8387b8f9a35c None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:50.277261 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 183/363] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Aug 5 02:29:50 2022] GET /identity/v3/role_assignments?group.id=b12a8762f5fa4389903f78f3b2d31e61&scope.project.id=31cfb67162854a2b8231ce70ee068c46&role.id=dd9e162a1a25432d871c4c2c0ab779a5 => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:50.284860 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ff066-a801-4047-9281-8387b8f9a35c None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:50.316541 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ab447-80d8-468b-9bef-2f3bace82b22 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:50.353678 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:50.361073 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:50.366991 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808eaed8-9882-4635-88a4-8d653079e017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:50.368197 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808eaed8-9882-4635-88a4-8d653079e017 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:50.368478 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808eaed8-9882-4635-88a4-8d653079e017 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:50.368751 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808eaed8-9882-4635-88a4-8d653079e017 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:50.383543 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808eaed8-9882-4635-88a4-8d653079e017 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:50.388979 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-808eaed8-9882-4635-88a4-8d653079e017 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:29:50.388979 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:50.388979 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:50.388979 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:50.388979 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:50.388979 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:50.388979 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:50.388979 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:50.388979 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:50.388979 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:50.388979 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:50.388979 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:50.388979 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:50.388979 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:50.388979 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:50.388979 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:50.389909 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:50.389909 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:50.389909 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:50.389909 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:50.389909 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:50.389909 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:50.389909 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:50.389909 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:50.389909 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:50.389909 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:50.389909 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:50.389909 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:50.389909 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:50.389909 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:50.389909 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:50.389909 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:50.390704 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:50.390704 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:50.390704 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:50.390704 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:50.390704 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:50.390704 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:50.390704 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:50.390704 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:50.390704 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:50.390704 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:50.390704 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:29:50.390704 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:29:50.396127 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 181/364] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 5 02:29:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:29:50.396127 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808eaed8-9882-4635-88a4-8d653079e017 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:50.429260 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ff066-a801-4047-9281-8387b8f9a35c None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:50.476496 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb0dfe-151d-47d6-83d4-2d5d07960faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:50.476496 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb0dfe-151d-47d6-83d4-2d5d07960faf None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:50.476788 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb0dfe-151d-47d6-83d4-2d5d07960faf None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:50.476947 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb0dfe-151d-47d6-83d4-2d5d07960faf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:50.477896 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb0dfe-151d-47d6-83d4-2d5d07960faf None admin] RBAC: Adding query filter params (group.id=b12a8762f5fa4389903f78f3b2d31e61, role.id=dd9e162a1a25432d871c4c2c0ab779a5, scope.project.id=4e2cf55519e4431b85bdc27977f9165d) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:50.479527 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb0dfe-151d-47d6-83d4-2d5d07960faf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:50.480219 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb0dfe-151d-47d6-83d4-2d5d07960faf None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:50.490278 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 184/365] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Aug 5 02:29:50 2022] GET /identity/v3/role_assignments?group.id=b12a8762f5fa4389903f78f3b2d31e61&scope.project.id=4e2cf55519e4431b85bdc27977f9165d&role.id=dd9e162a1a25432d871c4c2c0ab779a5 => generated 260 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:50.491587 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee408796-b2e2-424b-9905-d3fa54d451d1 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:50.491878 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee408796-b2e2-424b-9905-d3fa54d451d1 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:50.492154 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee408796-b2e2-424b-9905-d3fa54d451d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:50.516914 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-ee408796-b2e2-424b-9905-d3fa54d451d1 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:50.518402 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-ee408796-b2e2-424b-9905-d3fa54d451d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:50.546583 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808eaed8-9882-4635-88a4-8d653079e017 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:50.594205 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f11bc9-b94e-4d80-8a51-5d8734b59405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:50.595678 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f11bc9-b94e-4d80-8a51-5d8734b59405 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:50.596157 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f11bc9-b94e-4d80-8a51-5d8734b59405 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:50.596664 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f11bc9-b94e-4d80-8a51-5d8734b59405 None admin] PATH_INFO: `/v3/projects/4e2cf55519e4431b85bdc27977f9165d` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:50.598311 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f11bc9-b94e-4d80-8a51-5d8734b59405 None admin] RBAC: Authorizing `identity:get_project(project_id=4e2cf55519e4431b85bdc27977f9165d)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:50.600117 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f11bc9-b94e-4d80-8a51-5d8734b59405 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:50.607773 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 182/366] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:29:50 2022] GET /identity/v3/projects/4e2cf55519e4431b85bdc27977f9165d => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:50.609099 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f11bc9-b94e-4d80-8a51-5d8734b59405 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:50.616663 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 185/367] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:29:50.617169 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee408796-b2e2-424b-9905-d3fa54d451d1 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:50.674703 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:50.675202 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:50.730860 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f11bc9-b94e-4d80-8a51-5d8734b59405 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:50.737682 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee408796-b2e2-424b-9905-d3fa54d451d1 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:50.777845 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ac686-1ef4-49f0-afd9-552932cb10ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:50.778786 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ac686-1ef4-49f0-afd9-552932cb10ce None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:50.779196 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ac686-1ef4-49f0-afd9-552932cb10ce None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:50.779571 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ac686-1ef4-49f0-afd9-552932cb10ce None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:50.779893 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868077b2-ee12-4c9a-a9dc-fc9a14dc5c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:50.780492 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ac686-1ef4-49f0-afd9-552932cb10ce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:50.780895 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ac686-1ef4-49f0-afd9-552932cb10ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:50.781333 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868077b2-ee12-4c9a-a9dc-fc9a14dc5c44 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:50.781771 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868077b2-ee12-4c9a-a9dc-fc9a14dc5c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:50.782189 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868077b2-ee12-4c9a-a9dc-fc9a14dc5c44 None admin] PATH_INFO: `/v3/groups/b12a8762f5fa4389903f78f3b2d31e61` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:50.782655 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ac686-1ef4-49f0-afd9-552932cb10ce None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:50.783702 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868077b2-ee12-4c9a-a9dc-fc9a14dc5c44 None admin] RBAC: Authorizing `identity:get_group(group_id=b12a8762f5fa4389903f78f3b2d31e61)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:50.785292 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868077b2-ee12-4c9a-a9dc-fc9a14dc5c44 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:50.790975 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 186/368] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Aug 5 02:29:50 2022] GET /identity/v3/groups/b12a8762f5fa4389903f78f3b2d31e61 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:50.790975 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868077b2-ee12-4c9a-a9dc-fc9a14dc5c44 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:50.797694 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 183/369] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:29:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:50.799862 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ac686-1ef4-49f0-afd9-552932cb10ce None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:50.906083 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868077b2-ee12-4c9a-a9dc-fc9a14dc5c44 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:50.920188 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:50.925000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ac686-1ef4-49f0-afd9-552932cb10ce None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:50.945236 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928f7f2-5265-415c-bce3-7cd8ce205c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:50.945888 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928f7f2-5265-415c-bce3-7cd8ce205c9c None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:50.946229 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928f7f2-5265-415c-bce3-7cd8ce205c9c None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:50.946510 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928f7f2-5265-415c-bce3-7cd8ce205c9c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:50.947301 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:50.957470 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928f7f2-5265-415c-bce3-7cd8ce205c9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:50.963048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-0928f7f2-5265-415c-bce3-7cd8ce205c9c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:29:50.963048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:50.963048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:50.963048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:50.963048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:50.963048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:50.963048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:50.963048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:50.963048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:50.963048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:50.963048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:50.963048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:50.963048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:50.963048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:50.963048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:50.963048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:50.970388 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:50.970388 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:50.970388 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:50.970388 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:50.970388 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:50.970388 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:50.970388 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:50.970388 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:50.970388 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:50.970388 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:50.970388 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:50.970388 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:50.970388 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:50.970388 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:50.970388 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:50.970388 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:50.971206 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:50.971206 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:50.971206 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:50.971206 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:50.971206 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:50.971206 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:50.971206 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:50.971206 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:50.971206 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:50.971206 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:50.971206 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:29:50.971206 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:29:50.971206 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 187/370] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 5 02:29:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:29:50.971206 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928f7f2-5265-415c-bce3-7cd8ce205c9c None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:50.973457 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad236c8-f706-4401-bff9-987837e2f8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:50.974107 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad236c8-f706-4401-bff9-987837e2f8a4 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:50.974395 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad236c8-f706-4401-bff9-987837e2f8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:50.974710 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad236c8-f706-4401-bff9-987837e2f8a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:50.975829 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad236c8-f706-4401-bff9-987837e2f8a4 None admin] RBAC: Adding query filter params (group.id=b12a8762f5fa4389903f78f3b2d31e61, role.id=428314713da6487e8047a1f333265cda, scope.project.id=4e2cf55519e4431b85bdc27977f9165d) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:50.976145 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad236c8-f706-4401-bff9-987837e2f8a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:50.977636 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad236c8-f706-4401-bff9-987837e2f8a4 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:50.993282 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 184/371] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Aug 5 02:29:50 2022] GET /identity/v3/role_assignments?group.id=b12a8762f5fa4389903f78f3b2d31e61&scope.project.id=4e2cf55519e4431b85bdc27977f9165d&role.id=428314713da6487e8047a1f333265cda => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:29:50.994763 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad236c8-f706-4401-bff9-987837e2f8a4 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:51.105785 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad236c8-f706-4401-bff9-987837e2f8a4 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:51.112299 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928f7f2-5265-415c-bce3-7cd8ce205c9c None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:51.174197 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902140d0-d0c3-43f8-87e0-22ec733fae38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:51.174758 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902140d0-d0c3-43f8-87e0-22ec733fae38 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:51.175069 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902140d0-d0c3-43f8-87e0-22ec733fae38 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:51.175353 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902140d0-d0c3-43f8-87e0-22ec733fae38 None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:51.176102 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902140d0-d0c3-43f8-87e0-22ec733fae38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:51.176414 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902140d0-d0c3-43f8-87e0-22ec733fae38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:51.178479 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902140d0-d0c3-43f8-87e0-22ec733fae38 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:51.183155 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6784e47-8d68-43d8-9278-6efaf1ad6d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:51.183795 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6784e47-8d68-43d8-9278-6efaf1ad6d76 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:51.184079 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6784e47-8d68-43d8-9278-6efaf1ad6d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:51.184373 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6784e47-8d68-43d8-9278-6efaf1ad6d76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:51.201486 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 185/372] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:29:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:51.207630 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902140d0-d0c3-43f8-87e0-22ec733fae38 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:51.251476 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:51.279015 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6784e47-8d68-43d8-9278-6efaf1ad6d76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:51.282097 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6784e47-8d68-43d8-9278-6efaf1ad6d76 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:51.323329 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:51.392746 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 188/373] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:29:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:29:51.404075 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6784e47-8d68-43d8-9278-6efaf1ad6d76 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:51.483338 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902140d0-d0c3-43f8-87e0-22ec733fae38 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:51.548454 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:51.550362 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107e434-7543-4132-9c7b-060fbbf42f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:51.551033 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107e434-7543-4132-9c7b-060fbbf42f1b None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:51.551321 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107e434-7543-4132-9c7b-060fbbf42f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:51.551602 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107e434-7543-4132-9c7b-060fbbf42f1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:51.587472 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6784e47-8d68-43d8-9278-6efaf1ad6d76 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:51.629143 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d7439-9bbe-4f64-be8b-0cb4bdc666bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:51.630080 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d7439-9bbe-4f64-be8b-0cb4bdc666bd None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:51.630556 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d7439-9bbe-4f64-be8b-0cb4bdc666bd None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:51.631152 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d7439-9bbe-4f64-be8b-0cb4bdc666bd None admin] PATH_INFO: `/v3/projects/31cfb67162854a2b8231ce70ee068c46` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:51.632484 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d7439-9bbe-4f64-be8b-0cb4bdc666bd None admin] RBAC: Authorizing `identity:get_project(project_id=31cfb67162854a2b8231ce70ee068c46)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:51.634226 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d7439-9bbe-4f64-be8b-0cb4bdc666bd None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:51.636541 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 189/374] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:29:51 2022] GET /identity/v3/projects/31cfb67162854a2b8231ce70ee068c46 => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:51.643683 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d7439-9bbe-4f64-be8b-0cb4bdc666bd None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:51.731966 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9107e434-7543-4132-9c7b-060fbbf42f1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:51.733582 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9107e434-7543-4132-9c7b-060fbbf42f1b None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:51.755997 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d7439-9bbe-4f64-be8b-0cb4bdc666bd None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:51.792332 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72636a09-04cc-494a-8874-120475a973c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:51.793777 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72636a09-04cc-494a-8874-120475a973c2 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:51.794326 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72636a09-04cc-494a-8874-120475a973c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:51.794771 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72636a09-04cc-494a-8874-120475a973c2 None admin] PATH_INFO: `/v3/groups/b12a8762f5fa4389903f78f3b2d31e61` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:51.796110 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72636a09-04cc-494a-8874-120475a973c2 None admin] RBAC: Authorizing `identity:get_group(group_id=b12a8762f5fa4389903f78f3b2d31e61)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:51.797827 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72636a09-04cc-494a-8874-120475a973c2 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:51.799977 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 190/375] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Aug 5 02:29:51 2022] GET /identity/v3/groups/b12a8762f5fa4389903f78f3b2d31e61 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:29:51.806036 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72636a09-04cc-494a-8874-120475a973c2 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:51.817164 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:51.818867 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:51.917686 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72636a09-04cc-494a-8874-120475a973c2 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:51.940848 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 186/376] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:29:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 733 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:29:51.946590 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107e434-7543-4132-9c7b-060fbbf42f1b None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:51.956854 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b8c03f-fef1-4e6f-9e12-383aa9fcc0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:51.957788 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8c03f-fef1-4e6f-9e12-383aa9fcc0ca None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:51.958240 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8c03f-fef1-4e6f-9e12-383aa9fcc0ca None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:51.958681 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8c03f-fef1-4e6f-9e12-383aa9fcc0ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:51.960227 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b8c03f-fef1-4e6f-9e12-383aa9fcc0ca None admin] RBAC: Adding query filter params (group.id=b12a8762f5fa4389903f78f3b2d31e61, role.id=428314713da6487e8047a1f333265cda, scope.project.id=31cfb67162854a2b8231ce70ee068c46) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:51.960769 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b8c03f-fef1-4e6f-9e12-383aa9fcc0ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:51.962417 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b8c03f-fef1-4e6f-9e12-383aa9fcc0ca None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:51.975116 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 191/377] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Aug 5 02:29:51 2022] GET /identity/v3/role_assignments?group.id=b12a8762f5fa4389903f78f3b2d31e61&scope.project.id=31cfb67162854a2b8231ce70ee068c46&role.id=428314713da6487e8047a1f333265cda => generated 260 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:29:52.078150 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107e434-7543-4132-9c7b-060fbbf42f1b None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:52.120962 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c02ab6-5eeb-49c4-8814-f563acf58c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:52.121627 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c02ab6-5eeb-49c4-8814-f563acf58c4e None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:52.121912 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c02ab6-5eeb-49c4-8814-f563acf58c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:52.122187 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c02ab6-5eeb-49c4-8814-f563acf58c4e None admin] PATH_INFO: `/v3/projects/7de4c8b74b3245d8bf8c7d1c57f4237e` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:52.124650 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c02ab6-5eeb-49c4-8814-f563acf58c4e None admin] RBAC: Authorizing `identity:get_project(project_id=7de4c8b74b3245d8bf8c7d1c57f4237e)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:52.126141 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c02ab6-5eeb-49c4-8814-f563acf58c4e None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:52.128098 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 187/378] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:29:51 2022] GET /identity/v3/projects/7de4c8b74b3245d8bf8c7d1c57f4237e => generated 344 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:29:52.133917 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b8c03f-fef1-4e6f-9e12-383aa9fcc0ca None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:52.255329 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:52.301098 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b8c03f-fef1-4e6f-9e12-383aa9fcc0ca None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:52.353247 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e1c39-355c-4b86-9c52-497c2fa49337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:52.353818 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e1c39-355c-4b86-9c52-497c2fa49337 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:52.354099 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e1c39-355c-4b86-9c52-497c2fa49337 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:52.354374 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e1c39-355c-4b86-9c52-497c2fa49337 None admin] PATH_INFO: `/v3/groups/efaee399504e4247af672daf23935b15` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:52.361704 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e1c39-355c-4b86-9c52-497c2fa49337 None admin] RBAC: Authorizing `identity:get_group(group_id=efaee399504e4247af672daf23935b15)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:52.363437 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e1c39-355c-4b86-9c52-497c2fa49337 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:52.365654 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 192/379] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Aug 5 02:29:52 2022] GET /identity/v3/groups/efaee399504e4247af672daf23935b15 => generated 229 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:52.371711 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c02ab6-5eeb-49c4-8814-f563acf58c4e None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:52.395506 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:52.509259 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c02ab6-5eeb-49c4-8814-f563acf58c4e None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:52.550348 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c114b-b34e-459d-89c5-3133511ca77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:52.550994 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c114b-b34e-459d-89c5-3133511ca77a None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:52.551284 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c114b-b34e-459d-89c5-3133511ca77a None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:52.551559 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c114b-b34e-459d-89c5-3133511ca77a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:52.552351 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c114b-b34e-459d-89c5-3133511ca77a None admin] RBAC: Adding query filter params (group.id=efaee399504e4247af672daf23935b15, role.id=83afe883a303495b966480fb9b5bb7dd, scope.project.id=7de4c8b74b3245d8bf8c7d1c57f4237e) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:52.553224 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c114b-b34e-459d-89c5-3133511ca77a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:52.554684 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c114b-b34e-459d-89c5-3133511ca77a None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:52.560916 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 188/380] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Aug 5 02:29:52 2022] GET /identity/v3/role_assignments?group.id=efaee399504e4247af672daf23935b15&scope.project.id=7de4c8b74b3245d8bf8c7d1c57f4237e&role.id=83afe883a303495b966480fb9b5bb7dd => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:52.946482 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe1c59-affb-4bde-b09a-7d5c4897a8f3 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:52.947034 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe1c59-affb-4bde-b09a-7d5c4897a8f3 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:52.947034 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe1c59-affb-4bde-b09a-7d5c4897a8f3 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:52.948514 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 193/381] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:52.953744 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2ab9e-f0a6-4f37-a18e-0686533cd61e None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:52.953987 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc887c-62c4-4875-be56-6a7ba209c899 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:52.954403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2ab9e-f0a6-4f37-a18e-0686533cd61e None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:52.954481 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc887c-62c4-4875-be56-6a7ba209c899 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:52.954548 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2ab9e-f0a6-4f37-a18e-0686533cd61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:52.954612 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc887c-62c4-4875-be56-6a7ba209c899 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:52.956175 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 189/382] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:52.961746 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47941204-b1da-4201-b84b-c35088ecd94f None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:52.962044 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47941204-b1da-4201-b84b-c35088ecd94f None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:52.962318 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47941204-b1da-4201-b84b-c35088ecd94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:52.976405 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-d3f2ab9e-f0a6-4f37-a18e-0686533cd61e None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:52.977717 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-d3f2ab9e-f0a6-4f37-a18e-0686533cd61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:52.995301 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-47941204-b1da-4201-b84b-c35088ecd94f None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:52.996501 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-47941204-b1da-4201-b84b-c35088ecd94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:53.076708 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 194/383] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:29:53.078483 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 190/384] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:29:53.104381 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2ab9e-f0a6-4f37-a18e-0686533cd61e None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:53.116707 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47941204-b1da-4201-b84b-c35088ecd94f None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:53.127298 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:53.239319 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:53.292850 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47941204-b1da-4201-b84b-c35088ecd94f None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:53.308312 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2ab9e-f0a6-4f37-a18e-0686533cd61e None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:53.359081 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b63db71-e69a-425f-a27f-0c09600dc856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:53.359739 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63db71-e69a-425f-a27f-0c09600dc856 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:53.360023 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63db71-e69a-425f-a27f-0c09600dc856 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:53.360294 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63db71-e69a-425f-a27f-0c09600dc856 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:53.371479 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b63db71-e69a-425f-a27f-0c09600dc856 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:53.377819 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-8b63db71-e69a-425f-a27f-0c09600dc856 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:29:53.377819 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:53.377819 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:53.377819 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:53.377819 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:53.377819 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:53.377819 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:53.377819 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:53.377819 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:53.377819 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:53.377819 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:53.377819 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:53.377819 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:53.377819 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:53.377819 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:53.377819 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:53.378692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:53.378692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:53.378692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:53.378692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:53.378692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:53.378692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:53.378692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:53.378692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:53.378692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:53.378692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:53.378692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:53.378692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:53.378692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:53.378692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:53.378692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:53.378692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:53.379539 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:53.379539 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:53.379539 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:53.379539 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:53.379539 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:53.379539 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:53.379539 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:53.379539 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:53.379539 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:53.379539 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:53.379539 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:29:53.379539 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:29:53.381138 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878583a-d1af-432b-a156-11c31842ea18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:53.381585 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878583a-d1af-432b-a156-11c31842ea18 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:53.384461 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878583a-d1af-432b-a156-11c31842ea18 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:53.384573 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 191/385] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:29:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:29:53.384663 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878583a-d1af-432b-a156-11c31842ea18 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:53.389864 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b63db71-e69a-425f-a27f-0c09600dc856 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:53.401191 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3878583a-d1af-432b-a156-11c31842ea18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:53.406662 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-3878583a-d1af-432b-a156-11c31842ea18 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:29:53.406662 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:53.406662 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:53.406662 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:53.406662 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:53.406662 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:53.406662 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:53.406662 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:53.406662 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:53.406662 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:53.406662 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:53.406662 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:53.406662 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:53.406662 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:53.406662 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:53.406662 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:53.407755 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:53.407755 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:53.407755 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:53.407755 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:53.407755 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:53.407755 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:53.407755 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:53.407755 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:53.407755 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:53.407755 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:53.407755 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:53.407755 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:53.407755 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:53.407755 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:53.407755 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:53.407755 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:53.408757 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:53.408757 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:53.408757 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:53.408757 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:53.408757 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:53.408757 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:53.408757 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:53.408757 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:53.408757 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:53.408757 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:53.408757 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:29:53.408757 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:29:53.410835 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 195/386] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:29:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:29:53.429536 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878583a-d1af-432b-a156-11c31842ea18 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:53.483045 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:53.551755 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b63db71-e69a-425f-a27f-0c09600dc856 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:53.582414 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878583a-d1af-432b-a156-11c31842ea18 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:53.588275 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c088a9-7283-45d1-8ebd-a2ae4f5faab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:53.588892 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c088a9-7283-45d1-8ebd-a2ae4f5faab1 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:53.589220 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c088a9-7283-45d1-8ebd-a2ae4f5faab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:53.589495 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c088a9-7283-45d1-8ebd-a2ae4f5faab1 None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:53.590202 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c088a9-7283-45d1-8ebd-a2ae4f5faab1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:53.590605 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c088a9-7283-45d1-8ebd-a2ae4f5faab1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:53.592070 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c088a9-7283-45d1-8ebd-a2ae4f5faab1 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:53.601358 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 192/387] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 5 02:29:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:53.602582 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446b6e1-61b2-40dd-b67d-bc93e8a3f420 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:53.602866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446b6e1-61b2-40dd-b67d-bc93e8a3f420 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:53.603202 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446b6e1-61b2-40dd-b67d-bc93e8a3f420 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:53.608730 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 193/388] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:53.609446 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:53.610250 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446b6e1-61b2-40dd-b67d-bc93e8a3f420 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:53.619090 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c27e5d3-4a39-45a6-96c9-e36b10b623d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:53.619724 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27e5d3-4a39-45a6-96c9-e36b10b623d0 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:53.621029 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27e5d3-4a39-45a6-96c9-e36b10b623d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:53.621029 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27e5d3-4a39-45a6-96c9-e36b10b623d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:53.621029 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c27e5d3-4a39-45a6-96c9-e36b10b623d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:53.621256 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c27e5d3-4a39-45a6-96c9-e36b10b623d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:53.622640 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c27e5d3-4a39-45a6-96c9-e36b10b623d0 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:53.631954 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 196/389] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 5 02:29:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:29:53.633143 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067c759-ccc0-4779-af90-e797d19da448 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:53.633432 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067c759-ccc0-4779-af90-e797d19da448 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:53.633707 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067c759-ccc0-4779-af90-e797d19da448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:53.657103 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-1067c759-ccc0-4779-af90-e797d19da448 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:53.658290 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-1067c759-ccc0-4779-af90-e797d19da448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:53.729439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446b6e1-61b2-40dd-b67d-bc93e8a3f420 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:53.751242 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 197/390] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:29:53.752360 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1067c759-ccc0-4779-af90-e797d19da448 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:53.766824 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:53.786057 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10b9fc-49f3-442e-a993-b53eb4519bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:53.787017 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10b9fc-49f3-442e-a993-b53eb4519bcb None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:53.787129 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10b9fc-49f3-442e-a993-b53eb4519bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:53.787393 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10b9fc-49f3-442e-a993-b53eb4519bcb None admin] PATH_INFO: `/v3/groups/b12a8762f5fa4389903f78f3b2d31e61` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:53.788671 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe10b9fc-49f3-442e-a993-b53eb4519bcb None admin] RBAC: Authorizing `identity:get_group(group_id=b12a8762f5fa4389903f78f3b2d31e61)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:53.790165 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe10b9fc-49f3-442e-a993-b53eb4519bcb None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:53.794310 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 194/391] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Aug 5 02:29:53 2022] GET /identity/v3/groups/b12a8762f5fa4389903f78f3b2d31e61 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:29:53.795670 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10b9fc-49f3-442e-a993-b53eb4519bcb None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:53.886233 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1067c759-ccc0-4779-af90-e797d19da448 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:53.905080 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:53.909753 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10b9fc-49f3-442e-a993-b53eb4519bcb None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:53.922698 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91bbcbf-701a-43c1-9d56-d22d96e3805b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:53.923374 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bbcbf-701a-43c1-9d56-d22d96e3805b None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:53.923655 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bbcbf-701a-43c1-9d56-d22d96e3805b None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:53.923929 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bbcbf-701a-43c1-9d56-d22d96e3805b None admin] PATH_INFO: `/v3/groups/b12a8762f5fa4389903f78f3b2d31e61` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:53.925078 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91bbcbf-701a-43c1-9d56-d22d96e3805b None admin] RBAC: Authorizing `identity:get_group(group_id=b12a8762f5fa4389903f78f3b2d31e61)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:53.926639 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91bbcbf-701a-43c1-9d56-d22d96e3805b None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:53.932979 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 198/392] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Aug 5 02:29:53 2022] GET /identity/v3/groups/b12a8762f5fa4389903f78f3b2d31e61 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:53.933793 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91bbcbf-701a-43c1-9d56-d22d96e3805b None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:53.953601 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d55df1-0d4e-43ad-9e4e-c43a2c00f13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:53.954531 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d55df1-0d4e-43ad-9e4e-c43a2c00f13f None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:53.955475 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d55df1-0d4e-43ad-9e4e-c43a2c00f13f None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:53.956361 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d55df1-0d4e-43ad-9e4e-c43a2c00f13f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:53.971165 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d55df1-0d4e-43ad-9e4e-c43a2c00f13f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:53.978521 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-c5d55df1-0d4e-43ad-9e4e-c43a2c00f13f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:29:53.978521 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:53.978521 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:53.978521 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:53.978521 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:53.978521 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:53.978521 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:53.978521 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:53.978521 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:53.978521 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:53.978521 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:53.978521 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:53.978521 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:53.978521 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:53.978521 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:53.978521 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:53.979464 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:53.979464 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:53.979464 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:53.979464 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:53.979464 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:53.979464 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:53.979464 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:53.979464 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:53.979464 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:53.979464 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:53.979464 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:53.979464 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:53.979464 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:53.979464 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:53.979464 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:53.979464 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:53.980280 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:53.980280 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:53.980280 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:53.980280 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:53.980280 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:53.980280 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:53.980280 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:53.980280 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:53.980280 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:53.980280 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:53.980280 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:29:53.980280 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:29:53.982820 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 195/393] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 5 02:29:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:29:53.983761 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d55df1-0d4e-43ad-9e4e-c43a2c00f13f None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:54.052527 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91bbcbf-701a-43c1-9d56-d22d96e3805b None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:54.060436 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:54.093249 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677ed8a-b1d6-431c-85fa-32ea7e882463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:54.094326 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677ed8a-b1d6-431c-85fa-32ea7e882463 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:54.095155 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677ed8a-b1d6-431c-85fa-32ea7e882463 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:54.095953 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677ed8a-b1d6-431c-85fa-32ea7e882463 None admin] PATH_INFO: `/v3/projects/4e2cf55519e4431b85bdc27977f9165d` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:54.097466 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2677ed8a-b1d6-431c-85fa-32ea7e882463 None admin] RBAC: Authorizing `identity:get_project(project_id=4e2cf55519e4431b85bdc27977f9165d)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:54.099465 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2677ed8a-b1d6-431c-85fa-32ea7e882463 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:54.103805 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 199/394] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:29:53 2022] GET /identity/v3/projects/4e2cf55519e4431b85bdc27977f9165d => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:54.105390 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677ed8a-b1d6-431c-85fa-32ea7e882463 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:54.118067 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d55df1-0d4e-43ad-9e4e-c43a2c00f13f None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:54.173381 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aebe26e-7ee6-4aea-baf3-96f7b5476aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:54.173987 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aebe26e-7ee6-4aea-baf3-96f7b5476aec None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:54.174327 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aebe26e-7ee6-4aea-baf3-96f7b5476aec None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:54.174613 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aebe26e-7ee6-4aea-baf3-96f7b5476aec None admin] PATH_INFO: `/v3/projects/31cfb67162854a2b8231ce70ee068c46` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:54.176210 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aebe26e-7ee6-4aea-baf3-96f7b5476aec None admin] RBAC: Authorizing `identity:get_project(project_id=31cfb67162854a2b8231ce70ee068c46)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:54.178915 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aebe26e-7ee6-4aea-baf3-96f7b5476aec None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:54.185594 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 196/395] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:29:53 2022] GET /identity/v3/projects/31cfb67162854a2b8231ce70ee068c46 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:54.185594 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aebe26e-7ee6-4aea-baf3-96f7b5476aec None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:54.186768 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:54.240493 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677ed8a-b1d6-431c-85fa-32ea7e882463 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:54.278483 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c179d9-87af-4fe0-be1a-e45bc7e80656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:54.279543 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c179d9-87af-4fe0-be1a-e45bc7e80656 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:54.280140 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c179d9-87af-4fe0-be1a-e45bc7e80656 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:54.280616 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c179d9-87af-4fe0-be1a-e45bc7e80656 None admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:54.282246 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c179d9-87af-4fe0-be1a-e45bc7e80656 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:54.282799 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c179d9-87af-4fe0-be1a-e45bc7e80656 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:54.284465 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c179d9-87af-4fe0-be1a-e45bc7e80656 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:54.298861 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 200/396] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:29:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:54.299989 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c179d9-87af-4fe0-be1a-e45bc7e80656 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:54.316381 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aebe26e-7ee6-4aea-baf3-96f7b5476aec None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:54.345901 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:54.359818 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a1a73-880d-474c-9034-86b23c2b8723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:54.360533 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a1a73-880d-474c-9034-86b23c2b8723 None admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:54.360820 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a1a73-880d-474c-9034-86b23c2b8723 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:54.361105 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a1a73-880d-474c-9034-86b23c2b8723 None admin] PATH_INFO: `/v3/projects/4e2cf55519e4431b85bdc27977f9165d/groups/b12a8762f5fa4389903f78f3b2d31e61/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:54.363676 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a1a73-880d-474c-9034-86b23c2b8723 None admin] RBAC: Authorizing `identity:create_grant(project_id=4e2cf55519e4431b85bdc27977f9165d, group_id=b12a8762f5fa4389903f78f3b2d31e61, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:54.365276 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a1a73-880d-474c-9034-86b23c2b8723 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:54.427061 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 197/397] 10.222.0.42 () {58 vars in 1442 bytes} [Fri Aug 5 02:29:54 2022] PUT /identity/v3/projects/4e2cf55519e4431b85bdc27977f9165d/groups/b12a8762f5fa4389903f78f3b2d31e61/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:29:54.427255 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c179d9-87af-4fe0-be1a-e45bc7e80656 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:54.427350 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a1a73-880d-474c-9034-86b23c2b8723 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:54.451026 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:54.481366 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917b913-5042-4652-848a-637b94e36a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:54.482571 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917b913-5042-4652-848a-637b94e36a4e None admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:54.483242 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917b913-5042-4652-848a-637b94e36a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:54.483844 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917b913-5042-4652-848a-637b94e36a4e None admin] PATH_INFO: `/v3/projects/31cfb67162854a2b8231ce70ee068c46/groups/b12a8762f5fa4389903f78f3b2d31e61/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:54.487469 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3917b913-5042-4652-848a-637b94e36a4e None admin] RBAC: Authorizing `identity:create_grant(project_id=31cfb67162854a2b8231ce70ee068c46, group_id=b12a8762f5fa4389903f78f3b2d31e61, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:54.489308 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3917b913-5042-4652-848a-637b94e36a4e None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:54.549579 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a1a73-880d-474c-9034-86b23c2b8723 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:54.593230 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7fba2-776d-4788-8509-a97d1d214226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:54.593899 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7fba2-776d-4788-8509-a97d1d214226 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:54.594233 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7fba2-776d-4788-8509-a97d1d214226 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:54.594515 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7fba2-776d-4788-8509-a97d1d214226 None admin] PATH_INFO: `/v3/groups/b12a8762f5fa4389903f78f3b2d31e61` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:54.595745 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec7fba2-776d-4788-8509-a97d1d214226 None admin] RBAC: Authorizing `identity:get_group(group_id=b12a8762f5fa4389903f78f3b2d31e61)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:54.597185 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec7fba2-776d-4788-8509-a97d1d214226 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:54.602790 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 201/398] 10.222.0.42 () {58 vars in 1442 bytes} [Fri Aug 5 02:29:54 2022] PUT /identity/v3/projects/31cfb67162854a2b8231ce70ee068c46/groups/b12a8762f5fa4389903f78f3b2d31e61/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:29:54.603027 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 198/399] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Aug 5 02:29:54 2022] GET /identity/v3/groups/b12a8762f5fa4389903f78f3b2d31e61 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:54.603109 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e4c7d-7b0c-454c-991d-1ad35a01f614 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:54.603109 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e4c7d-7b0c-454c-991d-1ad35a01f614 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:54.603109 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e4c7d-7b0c-454c-991d-1ad35a01f614 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:54.606973 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 202/400] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:54.608544 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b9be6-1d5b-44e4-8145-07c01f970917 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:54.608834 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b9be6-1d5b-44e4-8145-07c01f970917 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:54.609112 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b9be6-1d5b-44e4-8145-07c01f970917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:54.612081 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37e4c7d-7b0c-454c-991d-1ad35a01f614 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:54.631407 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-0c1b9be6-1d5b-44e4-8145-07c01f970917 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:54.632676 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-0c1b9be6-1d5b-44e4-8145-07c01f970917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:54.738334 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:54.781244 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 199/401] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:29:54.792859 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37e4c7d-7b0c-454c-991d-1ad35a01f614 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:54.813538 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1b9be6-1d5b-44e4-8145-07c01f970917 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:54.843698 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd028c4-71fe-423a-955b-4fde98fb1435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:54.845234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd028c4-71fe-423a-955b-4fde98fb1435 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:54.845983 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd028c4-71fe-423a-955b-4fde98fb1435 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:54.846533 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd028c4-71fe-423a-955b-4fde98fb1435 None admin] PATH_INFO: `/v3/projects/4e2cf55519e4431b85bdc27977f9165d` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:54.848518 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd028c4-71fe-423a-955b-4fde98fb1435 None admin] RBAC: Authorizing `identity:get_project(project_id=4e2cf55519e4431b85bdc27977f9165d)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:54.852050 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd028c4-71fe-423a-955b-4fde98fb1435 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:54.854755 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 203/402] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:29:54 2022] GET /identity/v3/projects/4e2cf55519e4431b85bdc27977f9165d => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:29:54.860060 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd028c4-71fe-423a-955b-4fde98fb1435 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:54.926110 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:54.961268 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1b9be6-1d5b-44e4-8145-07c01f970917 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:55.005795 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd028c4-71fe-423a-955b-4fde98fb1435 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:55.030509 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33964b16-6708-4adc-9087-bbbcf0db1950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:55.031193 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33964b16-6708-4adc-9087-bbbcf0db1950 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:55.031487 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33964b16-6708-4adc-9087-bbbcf0db1950 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:55.031768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33964b16-6708-4adc-9087-bbbcf0db1950 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:55.058093 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33964b16-6708-4adc-9087-bbbcf0db1950 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:55.064295 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-33964b16-6708-4adc-9087-bbbcf0db1950 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:29:55.064295 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:55.064295 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:55.064295 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:55.064295 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:55.064295 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:55.064295 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:55.064295 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:55.064295 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:55.064295 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:55.064295 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:55.064295 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:55.064295 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:55.064295 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:55.064295 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:55.064295 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:55.065159 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:55.065159 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:55.065159 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:55.065159 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:55.065159 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:55.065159 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:55.065159 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:55.065159 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:55.065159 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:55.065159 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:55.065159 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:55.065159 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:55.065159 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:55.065159 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:55.065159 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:55.065159 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:55.066037 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:55.066037 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:55.066037 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:55.066037 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:55.066037 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:55.066037 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:55.066037 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:55.066037 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:55.066037 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:55.066037 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:55.066037 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:29:55.066037 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:29:55.072332 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 200/403] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 5 02:29:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:29:55.078091 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33964b16-6708-4adc-9087-bbbcf0db1950 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:55.093164 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931547d2-9d19-4aaf-9603-06d5b6c840ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:55.094542 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931547d2-9d19-4aaf-9603-06d5b6c840ce None admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:55.095067 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931547d2-9d19-4aaf-9603-06d5b6c840ce None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:55.095545 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931547d2-9d19-4aaf-9603-06d5b6c840ce None admin] PATH_INFO: `/v3/projects/4e2cf55519e4431b85bdc27977f9165d/groups/b12a8762f5fa4389903f78f3b2d31e61/roles/428314713da6487e8047a1f333265cda` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:55.099085 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931547d2-9d19-4aaf-9603-06d5b6c840ce None admin] RBAC: Authorizing `identity:create_grant(project_id=4e2cf55519e4431b85bdc27977f9165d, group_id=b12a8762f5fa4389903f78f3b2d31e61, role_id=428314713da6487e8047a1f333265cda)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:55.101545 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931547d2-9d19-4aaf-9603-06d5b6c840ce None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:55.134866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:55.191255 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33964b16-6708-4adc-9087-bbbcf0db1950 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:55.225108 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 204/404] 10.222.0.42 () {58 vars in 1442 bytes} [Fri Aug 5 02:29:54 2022] PUT /identity/v3/projects/4e2cf55519e4431b85bdc27977f9165d/groups/b12a8762f5fa4389903f78f3b2d31e61/roles/428314713da6487e8047a1f333265cda => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:29:55.226654 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e96437-efe3-4190-9b0f-ffb9de5fdae6 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:55.226942 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e96437-efe3-4190-9b0f-ffb9de5fdae6 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:55.227242 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e96437-efe3-4190-9b0f-ffb9de5fdae6 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:55.232941 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 205/405] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:55.235325 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2688cf-456f-41c7-aba5-d889be207edc None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:55.235939 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2688cf-456f-41c7-aba5-d889be207edc None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:55.236245 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015506a1-001f-4990-a34d-8aee13d317e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:55.236685 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2688cf-456f-41c7-aba5-d889be207edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:55.236878 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015506a1-001f-4990-a34d-8aee13d317e7 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:55.237162 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015506a1-001f-4990-a34d-8aee13d317e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:55.237487 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015506a1-001f-4990-a34d-8aee13d317e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:55.238232 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015506a1-001f-4990-a34d-8aee13d317e7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:55.238532 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015506a1-001f-4990-a34d-8aee13d317e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:55.239997 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015506a1-001f-4990-a34d-8aee13d317e7 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:55.253584 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 201/406] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:29:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:29:55.264167 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015506a1-001f-4990-a34d-8aee13d317e7 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:55.265178 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-9d2688cf-456f-41c7-aba5-d889be207edc None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:55.280401 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-9d2688cf-456f-41c7-aba5-d889be207edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:55.384513 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 206/407] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:29:55.404598 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2688cf-456f-41c7-aba5-d889be207edc None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:55.441938 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:55.468051 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015506a1-001f-4990-a34d-8aee13d317e7 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:55.470727 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:55.514864 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c631d-bf9f-4fb8-a94b-715500d5cd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:55.516482 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c631d-bf9f-4fb8-a94b-715500d5cd85 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:55.517131 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c631d-bf9f-4fb8-a94b-715500d5cd85 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:55.517617 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c631d-bf9f-4fb8-a94b-715500d5cd85 None admin] PATH_INFO: `/v3/groups/b12a8762f5fa4389903f78f3b2d31e61` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:55.518209 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2688cf-456f-41c7-aba5-d889be207edc None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:55.519286 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327c631d-bf9f-4fb8-a94b-715500d5cd85 None admin] RBAC: Authorizing `identity:get_group(group_id=b12a8762f5fa4389903f78f3b2d31e61)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:55.522427 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327c631d-bf9f-4fb8-a94b-715500d5cd85 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:55.529597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 202/408] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Aug 5 02:29:55 2022] GET /identity/v3/groups/b12a8762f5fa4389903f78f3b2d31e61 => generated 226 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:55.531093 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c631d-bf9f-4fb8-a94b-715500d5cd85 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:55.559916 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ab3b3-b3a1-43e8-a2c3-e185528be853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:55.560547 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ab3b3-b3a1-43e8-a2c3-e185528be853 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:55.560828 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ab3b3-b3a1-43e8-a2c3-e185528be853 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:55.561103 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ab3b3-b3a1-43e8-a2c3-e185528be853 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:55.575552 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3ab3b3-b3a1-43e8-a2c3-e185528be853 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:55.580648 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-1d3ab3b3-b3a1-43e8-a2c3-e185528be853 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:29:55.580648 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:55.580648 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:55.580648 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:55.580648 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:55.580648 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:55.580648 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:55.580648 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:55.580648 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:55.580648 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:55.580648 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:55.580648 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:55.580648 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:55.580648 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:55.580648 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:55.580648 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:55.581537 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:55.581537 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:55.581537 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:55.581537 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:55.581537 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:55.581537 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:55.581537 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:55.581537 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:55.581537 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:55.581537 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:55.581537 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:55.581537 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:55.581537 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:55.581537 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:55.581537 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:55.581537 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:55.587814 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:55.587814 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:55.587814 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:55.587814 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:55.587814 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:55.587814 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:55.587814 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:55.587814 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:55.587814 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:55.587814 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:55.587814 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:29:55.587814 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:29:55.587814 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 207/409] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 5 02:29:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:29:55.590153 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ab3b3-b3a1-43e8-a2c3-e185528be853 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:55.688738 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c631d-bf9f-4fb8-a94b-715500d5cd85 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:55.711055 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:55.719287 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ab3b3-b3a1-43e8-a2c3-e185528be853 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:55.759320 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe9303-8ff3-45c5-9bc4-32eeed2c9a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:55.760870 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe9303-8ff3-45c5-9bc4-32eeed2c9a59 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:55.761668 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe9303-8ff3-45c5-9bc4-32eeed2c9a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:55.762176 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe9303-8ff3-45c5-9bc4-32eeed2c9a59 None admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:55.763311 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe9303-8ff3-45c5-9bc4-32eeed2c9a59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:55.763898 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe9303-8ff3-45c5-9bc4-32eeed2c9a59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:55.765555 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe9303-8ff3-45c5-9bc4-32eeed2c9a59 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:55.779808 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23529b0-96a3-4138-a23e-a38830125926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:55.780216 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 208/410] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:29:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:29:55.780690 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23529b0-96a3-4138-a23e-a38830125926 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:55.780989 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23529b0-96a3-4138-a23e-a38830125926 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:55.781304 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23529b0-96a3-4138-a23e-a38830125926 None admin] PATH_INFO: `/v3/projects/31cfb67162854a2b8231ce70ee068c46` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:55.782816 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23529b0-96a3-4138-a23e-a38830125926 None admin] RBAC: Authorizing `identity:get_project(project_id=31cfb67162854a2b8231ce70ee068c46)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:55.783764 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe9303-8ff3-45c5-9bc4-32eeed2c9a59 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:55.786416 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23529b0-96a3-4138-a23e-a38830125926 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:55.786677 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 203/411] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:29:55 2022] GET /identity/v3/projects/31cfb67162854a2b8231ce70ee068c46 => generated 302 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:29:55.812947 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23529b0-96a3-4138-a23e-a38830125926 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:55.888035 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:55.928385 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe9303-8ff3-45c5-9bc4-32eeed2c9a59 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:55.952869 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23529b0-96a3-4138-a23e-a38830125926 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:55.995798 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2427048-01a6-4df7-b6a7-9eb9091fba0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:55.996446 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2427048-01a6-4df7-b6a7-9eb9091fba0b None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:55.996726 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2427048-01a6-4df7-b6a7-9eb9091fba0b None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:55.996998 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2427048-01a6-4df7-b6a7-9eb9091fba0b None admin] PATH_INFO: `/v3/groups/efaee399504e4247af672daf23935b15` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:55.999187 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2427048-01a6-4df7-b6a7-9eb9091fba0b None admin] RBAC: Authorizing `identity:get_group(group_id=efaee399504e4247af672daf23935b15)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:56.000645 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2427048-01a6-4df7-b6a7-9eb9091fba0b None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:56.002239 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 209/412] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Aug 5 02:29:55 2022] GET /identity/v3/groups/efaee399504e4247af672daf23935b15 => generated 229 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:29:56.008490 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2427048-01a6-4df7-b6a7-9eb9091fba0b None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:56.009950 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5557e877-fb51-4a31-8a1d-f9e79147a29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:56.010682 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557e877-fb51-4a31-8a1d-f9e79147a29e None admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:56.011000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557e877-fb51-4a31-8a1d-f9e79147a29e None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:56.011285 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557e877-fb51-4a31-8a1d-f9e79147a29e None admin] PATH_INFO: `/v3/projects/31cfb67162854a2b8231ce70ee068c46/groups/b12a8762f5fa4389903f78f3b2d31e61/roles/428314713da6487e8047a1f333265cda` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:56.015667 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5557e877-fb51-4a31-8a1d-f9e79147a29e None admin] RBAC: Authorizing `identity:create_grant(project_id=31cfb67162854a2b8231ce70ee068c46, group_id=b12a8762f5fa4389903f78f3b2d31e61, role_id=428314713da6487e8047a1f333265cda)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:56.017042 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5557e877-fb51-4a31-8a1d-f9e79147a29e None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:56.049114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:56.095691 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 204/413] 10.222.0.42 () {58 vars in 1442 bytes} [Fri Aug 5 02:29:55 2022] PUT /identity/v3/projects/31cfb67162854a2b8231ce70ee068c46/groups/b12a8762f5fa4389903f78f3b2d31e61/roles/428314713da6487e8047a1f333265cda => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:29:56.128640 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2427048-01a6-4df7-b6a7-9eb9091fba0b None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:56.177954 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2694d70a-000c-4226-b59a-29159cbc310e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:56.178640 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694d70a-000c-4226-b59a-29159cbc310e None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:56.178946 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694d70a-000c-4226-b59a-29159cbc310e None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:56.179253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694d70a-000c-4226-b59a-29159cbc310e None admin] PATH_INFO: `/v3/projects/7de4c8b74b3245d8bf8c7d1c57f4237e` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:56.180555 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2694d70a-000c-4226-b59a-29159cbc310e None admin] RBAC: Authorizing `identity:get_project(project_id=7de4c8b74b3245d8bf8c7d1c57f4237e)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:56.182073 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2694d70a-000c-4226-b59a-29159cbc310e None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:56.185079 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 210/414] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:29:56 2022] GET /identity/v3/projects/7de4c8b74b3245d8bf8c7d1c57f4237e => generated 344 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:56.189861 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5557e877-fb51-4a31-8a1d-f9e79147a29e None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:56.339856 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:56.343883 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5557e877-fb51-4a31-8a1d-f9e79147a29e None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:56.393082 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a7df0-dd53-449d-9318-0dafdc266a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:56.394167 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a7df0-dd53-449d-9318-0dafdc266a4e None admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:56.394657 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a7df0-dd53-449d-9318-0dafdc266a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:56.395174 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a7df0-dd53-449d-9318-0dafdc266a4e None admin] PATH_INFO: `/v3/projects/7de4c8b74b3245d8bf8c7d1c57f4237e/groups/efaee399504e4247af672daf23935b15/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:56.397639 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a7df0-dd53-449d-9318-0dafdc266a4e None admin] RBAC: Authorizing `identity:create_grant(project_id=7de4c8b74b3245d8bf8c7d1c57f4237e, group_id=efaee399504e4247af672daf23935b15, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:56.399508 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a7df0-dd53-449d-9318-0dafdc266a4e None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:56.468280 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 205/415] 10.222.0.42 () {58 vars in 1442 bytes} [Fri Aug 5 02:29:56 2022] PUT /identity/v3/projects/7de4c8b74b3245d8bf8c7d1c57f4237e/groups/efaee399504e4247af672daf23935b15/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:29:56.761974 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3953121-807b-4130-997e-c8bcb921526b None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:56.762340 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3953121-807b-4130-997e-c8bcb921526b None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:56.762532 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3953121-807b-4130-997e-c8bcb921526b None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:56.764114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 211/416] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:56.769391 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097871e-ff0a-4196-90c6-c9f3e52132f8 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:56.769921 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097871e-ff0a-4196-90c6-c9f3e52132f8 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:56.770408 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097871e-ff0a-4196-90c6-c9f3e52132f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:56.792713 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-0097871e-ff0a-4196-90c6-c9f3e52132f8 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:56.794282 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-0097871e-ff0a-4196-90c6-c9f3e52132f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:56.879788 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 206/417] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:29:56.914999 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3953121-807b-4130-997e-c8bcb921526b None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:57.038255 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:57.047572 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3953121-807b-4130-997e-c8bcb921526b None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:57.081852 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829aa977-f852-41d6-b3ce-cdf2c8f52ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:57.082537 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829aa977-f852-41d6-b3ce-cdf2c8f52ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:57.082881 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829aa977-f852-41d6-b3ce-cdf2c8f52ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:57.083124 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829aa977-f852-41d6-b3ce-cdf2c8f52ec1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:57.094797 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829aa977-f852-41d6-b3ce-cdf2c8f52ec1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:57.099838 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-829aa977-f852-41d6-b3ce-cdf2c8f52ec1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:29:57.099838 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:57.099838 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:57.099838 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:57.099838 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:57.099838 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:57.099838 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:57.099838 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:57.099838 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:57.099838 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:57.099838 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:57.099838 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:57.099838 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:57.099838 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:57.099838 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:57.099838 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:57.101064 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:57.101064 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:57.101064 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:57.101064 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:57.101064 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:57.101064 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:57.101064 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:57.101064 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:57.101064 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:57.101064 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:57.101064 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:57.101064 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:57.101064 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:57.101064 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:57.101064 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:57.101064 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:57.102488 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:57.102488 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:57.102488 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:57.102488 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:57.102488 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:57.102488 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:57.102488 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:57.102488 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:57.102488 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:57.102488 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:57.102488 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:29:57.102488 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:29:57.102488 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 212/418] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:29:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:29:57.107143 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097871e-ff0a-4196-90c6-c9f3e52132f8 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:57.136965 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76894ae4-1710-49d7-a667-09d52f44c7e6 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:57.137460 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76894ae4-1710-49d7-a667-09d52f44c7e6 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:57.137566 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76894ae4-1710-49d7-a667-09d52f44c7e6 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:57.138839 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 213/419] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:29:57.153363 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c82e36-a338-4c16-bbfd-f90562a738a7 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:57.157115 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c82e36-a338-4c16-bbfd-f90562a738a7 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:57.157115 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c82e36-a338-4c16-bbfd-f90562a738a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:57.183965 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-21c82e36-a338-4c16-bbfd-f90562a738a7 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:57.185162 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-21c82e36-a338-4c16-bbfd-f90562a738a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:57.219373 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:57.236819 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097871e-ff0a-4196-90c6-c9f3e52132f8 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:57.308222 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b3445-ee80-4fd8-a9eb-d6bfa0d3eaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:57.308933 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b3445-ee80-4fd8-a9eb-d6bfa0d3eaf8 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:57.309221 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b3445-ee80-4fd8-a9eb-d6bfa0d3eaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:57.309499 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b3445-ee80-4fd8-a9eb-d6bfa0d3eaf8 None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:57.310231 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b3445-ee80-4fd8-a9eb-d6bfa0d3eaf8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:57.310539 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b3445-ee80-4fd8-a9eb-d6bfa0d3eaf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:57.312082 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b3445-ee80-4fd8-a9eb-d6bfa0d3eaf8 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:57.321082 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 214/420] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:29:57.327890 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 207/421] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 5 02:29:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:57.332832 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c82e36-a338-4c16-bbfd-f90562a738a7 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:57.346004 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b3445-ee80-4fd8-a9eb-d6bfa0d3eaf8 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:57.470224 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b3445-ee80-4fd8-a9eb-d6bfa0d3eaf8 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:57.475057 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:57.512990 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f7c28-a13c-4cc8-9722-07c3fd268544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:57.513689 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f7c28-a13c-4cc8-9722-07c3fd268544 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:57.513988 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f7c28-a13c-4cc8-9722-07c3fd268544 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:57.514452 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f7c28-a13c-4cc8-9722-07c3fd268544 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:57.515349 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c82e36-a338-4c16-bbfd-f90562a738a7 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:57.526190 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437f7c28-a13c-4cc8-9722-07c3fd268544 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:57.532140 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-437f7c28-a13c-4cc8-9722-07c3fd268544 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:29:57.532140 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:57.532140 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:57.532140 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:57.532140 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:57.532140 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:57.532140 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:57.532140 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:57.532140 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:57.532140 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:57.532140 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:57.532140 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:57.532140 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:57.532140 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:57.532140 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:57.532140 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:57.533095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:57.533095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:57.533095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:57.533095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:57.533095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:57.533095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:57.533095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:57.533095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:57.533095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:57.533095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:57.533095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:57.533095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:57.533095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:57.533095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:57.533095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:57.533095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:57.533927 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:57.533927 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:57.533927 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:57.533927 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:57.533927 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:57.533927 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:57.533927 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:57.533927 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:57.533927 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:57.533927 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:57.533927 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:29:57.533927 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:29:57.543004 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 208/422] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:29:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:29:57.543004 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f7c28-a13c-4cc8-9722-07c3fd268544 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:57.568571 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:57.591402 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f8454-e1e1-43f8-9fef-3f258a745a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:57.592041 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f8454-e1e1-43f8-9fef-3f258a745a35 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:57.592331 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f8454-e1e1-43f8-9fef-3f258a745a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:57.592613 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f8454-e1e1-43f8-9fef-3f258a745a35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:57.717280 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f8454-e1e1-43f8-9fef-3f258a745a35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:57.718758 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f8454-e1e1-43f8-9fef-3f258a745a35 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:57.772975 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f7c28-a13c-4cc8-9722-07c3fd268544 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:57.841467 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:57.853493 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603f7ce-67df-44a7-a8f3-a4d5ce8bf3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:57.854394 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603f7ce-67df-44a7-a8f3-a4d5ce8bf3a8 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:57.854743 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603f7ce-67df-44a7-a8f3-a4d5ce8bf3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:57.855032 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603f7ce-67df-44a7-a8f3-a4d5ce8bf3a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:57.871756 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603f7ce-67df-44a7-a8f3-a4d5ce8bf3a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:57.871756 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603f7ce-67df-44a7-a8f3-a4d5ce8bf3a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:57.871756 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603f7ce-67df-44a7-a8f3-a4d5ce8bf3a8 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:57.876367 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 209/423] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 5 02:29:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:29:57.879485 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 215/424] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:29:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:29:57.884699 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603f7ce-67df-44a7-a8f3-a4d5ce8bf3a8 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:57.892508 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f8454-e1e1-43f8-9fef-3f258a745a35 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:57.982912 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:58.015224 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603f7ce-67df-44a7-a8f3-a4d5ce8bf3a8 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:58.051816 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd479c-589a-412d-94fa-33d24e514b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:58.053134 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd479c-589a-412d-94fa-33d24e514b4a None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:58.053999 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd479c-589a-412d-94fa-33d24e514b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:58.054489 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd479c-589a-412d-94fa-33d24e514b4a None admin] PATH_INFO: `/v3/projects/4e2cf55519e4431b85bdc27977f9165d` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:58.056191 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd479c-589a-412d-94fa-33d24e514b4a None admin] RBAC: Authorizing `identity:get_project(project_id=4e2cf55519e4431b85bdc27977f9165d)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:58.057893 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd479c-589a-412d-94fa-33d24e514b4a None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:58.060180 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 210/425] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:29:57 2022] GET /identity/v3/projects/4e2cf55519e4431b85bdc27977f9165d => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:58.065001 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd479c-589a-412d-94fa-33d24e514b4a None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:58.080402 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f8454-e1e1-43f8-9fef-3f258a745a35 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:58.131232 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47218eb-41e2-49b3-bf6a-1220128b4970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:58.131778 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47218eb-41e2-49b3-bf6a-1220128b4970 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:58.132053 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47218eb-41e2-49b3-bf6a-1220128b4970 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:58.132326 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47218eb-41e2-49b3-bf6a-1220128b4970 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:58.188936 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:58.201125 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd479c-589a-412d-94fa-33d24e514b4a None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:58.211433 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47218eb-41e2-49b3-bf6a-1220128b4970 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:58.213824 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47218eb-41e2-49b3-bf6a-1220128b4970 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:58.242421 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6358d23-d0f0-40f4-9ea1-7568f5ed7bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:58.243400 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6358d23-d0f0-40f4-9ea1-7568f5ed7bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:58.243892 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6358d23-d0f0-40f4-9ea1-7568f5ed7bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:58.244322 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6358d23-d0f0-40f4-9ea1-7568f5ed7bf7 None admin] PATH_INFO: `/v3/groups/b12a8762f5fa4389903f78f3b2d31e61` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:58.245649 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6358d23-d0f0-40f4-9ea1-7568f5ed7bf7 None admin] RBAC: Authorizing `identity:get_group(group_id=b12a8762f5fa4389903f78f3b2d31e61)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:58.247262 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6358d23-d0f0-40f4-9ea1-7568f5ed7bf7 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:58.249386 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 211/426] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Aug 5 02:29:58 2022] GET /identity/v3/groups/b12a8762f5fa4389903f78f3b2d31e61 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:29:58.250828 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25b2ad-fb90-42f0-89c6-9fb6345c5365 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:58.251352 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25b2ad-fb90-42f0-89c6-9fb6345c5365 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:58.251848 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25b2ad-fb90-42f0-89c6-9fb6345c5365 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:58.253574 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 212/427] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:58.263043 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547bf5b-f57f-43e7-a190-1436cd757fee None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:58.263043 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547bf5b-f57f-43e7-a190-1436cd757fee None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:58.263043 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547bf5b-f57f-43e7-a190-1436cd757fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:58.290790 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-d547bf5b-f57f-43e7-a190-1436cd757fee None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:58.292731 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-d547bf5b-f57f-43e7-a190-1436cd757fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:58.296043 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:58.329393 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 216/428] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:29:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 05 02:29:58.330452 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47218eb-41e2-49b3-bf6a-1220128b4970 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:58.379466 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 213/429] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:29:58.380760 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547bf5b-f57f-43e7-a190-1436cd757fee None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:58.448927 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:58.467116 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47218eb-41e2-49b3-bf6a-1220128b4970 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:58.503134 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547bf5b-f57f-43e7-a190-1436cd757fee None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:58.504423 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa9cff-ddd2-48b5-9d31-cb1d4f3d6531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:58.506220 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa9cff-ddd2-48b5-9d31-cb1d4f3d6531 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:58.506738 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa9cff-ddd2-48b5-9d31-cb1d4f3d6531 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:58.507254 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa9cff-ddd2-48b5-9d31-cb1d4f3d6531 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:58.508253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa9cff-ddd2-48b5-9d31-cb1d4f3d6531 None admin] RBAC: Adding query filter params (group.id=b12a8762f5fa4389903f78f3b2d31e61, role.id=dd9e162a1a25432d871c4c2c0ab779a5, scope.project.id=4e2cf55519e4431b85bdc27977f9165d) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:58.508784 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa9cff-ddd2-48b5-9d31-cb1d4f3d6531 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:58.510938 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa9cff-ddd2-48b5-9d31-cb1d4f3d6531 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:58.518910 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 217/430] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Aug 5 02:29:58 2022] GET /identity/v3/role_assignments?group.id=b12a8762f5fa4389903f78f3b2d31e61&scope.project.id=4e2cf55519e4431b85bdc27977f9165d&role.id=dd9e162a1a25432d871c4c2c0ab779a5 => generated 611 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:58.520498 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa9cff-ddd2-48b5-9d31-cb1d4f3d6531 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:58.539200 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd5b1c-ff64-4c9f-ae7e-7c105e134ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:58.539873 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd5b1c-ff64-4c9f-ae7e-7c105e134ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:58.540153 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd5b1c-ff64-4c9f-ae7e-7c105e134ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:58.540424 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd5b1c-ff64-4c9f-ae7e-7c105e134ec7 None admin] PATH_INFO: `/v3/projects/31cfb67162854a2b8231ce70ee068c46` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:58.541669 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dd5b1c-ff64-4c9f-ae7e-7c105e134ec7 None admin] RBAC: Authorizing `identity:get_project(project_id=31cfb67162854a2b8231ce70ee068c46)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:58.543193 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dd5b1c-ff64-4c9f-ae7e-7c105e134ec7 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:58.545322 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 214/431] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:29:58 2022] GET /identity/v3/projects/31cfb67162854a2b8231ce70ee068c46 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:58.546627 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496f52d-7de5-4204-b7e4-13e590696016 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:58.546910 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496f52d-7de5-4204-b7e4-13e590696016 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:58.547207 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496f52d-7de5-4204-b7e4-13e590696016 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:58.548404 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 215/432] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:58.550878 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496f52d-7de5-4204-b7e4-13e590696016 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:58.560826 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:58.673175 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa9cff-ddd2-48b5-9d31-cb1d4f3d6531 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:58.687820 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496f52d-7de5-4204-b7e4-13e590696016 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:58.713409 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7562100-3603-416a-9195-63a392d41095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:58.713974 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7562100-3603-416a-9195-63a392d41095 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:58.714261 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7562100-3603-416a-9195-63a392d41095 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:58.714531 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7562100-3603-416a-9195-63a392d41095 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:58.728100 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7562100-3603-416a-9195-63a392d41095 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:58.730728 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b17e37-2e4d-400a-9618-09b5e5bf374d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:58.731733 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b17e37-2e4d-400a-9618-09b5e5bf374d None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:58.732182 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b17e37-2e4d-400a-9618-09b5e5bf374d None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:58.732645 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b17e37-2e4d-400a-9618-09b5e5bf374d None admin] PATH_INFO: `/v3/groups/b12a8762f5fa4389903f78f3b2d31e61` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:58.734267 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-c7562100-3603-416a-9195-63a392d41095 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:29:58.734267 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:58.734267 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:58.734267 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:58.734267 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:58.734267 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:58.734267 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:58.734267 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:58.734267 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:58.734267 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:58.734267 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:58.734267 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:58.734267 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:58.734267 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:58.734267 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:58.734267 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:58.735174 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:58.735174 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:58.735174 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:58.735174 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:58.735174 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:58.735174 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:58.735174 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:58.735174 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:58.735174 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:58.735174 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:58.735174 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:58.735174 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:58.735174 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:58.735174 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:58.735174 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:58.735174 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:58.735980 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:58.735980 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:58.735980 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:58.735980 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:58.735980 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:58.735980 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:58.735980 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:58.735980 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:58.735980 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:58.735980 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:58.735980 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:29:58.735980 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:29:58.736596 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b17e37-2e4d-400a-9618-09b5e5bf374d None admin] RBAC: Authorizing `identity:get_group(group_id=b12a8762f5fa4389903f78f3b2d31e61)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:58.736669 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 218/433] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 5 02:29:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:29:58.736669 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb43c4-05f0-4544-a263-d2fa2fddf678 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:58.737295 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb43c4-05f0-4544-a263-d2fa2fddf678 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:58.737387 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b17e37-2e4d-400a-9618-09b5e5bf374d None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:58.737455 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb43c4-05f0-4544-a263-d2fa2fddf678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:58.742480 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 216/434] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Aug 5 02:29:58 2022] GET /identity/v3/groups/b12a8762f5fa4389903f78f3b2d31e61 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:29:58.743627 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b17e37-2e4d-400a-9618-09b5e5bf374d None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:58.754023 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:58.760854 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-7ffb43c4-05f0-4544-a263-d2fa2fddf678 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:58.765720 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-7ffb43c4-05f0-4544-a263-d2fa2fddf678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:58.836073 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:58.848192 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 219/435] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:29:58.855165 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb43c4-05f0-4544-a263-d2fa2fddf678 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:58.870648 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b17e37-2e4d-400a-9618-09b5e5bf374d None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:58.921396 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be8db7-9848-4d45-9a9c-7842107ca942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:58.922392 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be8db7-9848-4d45-9a9c-7842107ca942 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:58.922941 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be8db7-9848-4d45-9a9c-7842107ca942 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:58.923659 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be8db7-9848-4d45-9a9c-7842107ca942 None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:58.924582 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7be8db7-9848-4d45-9a9c-7842107ca942 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:58.925041 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7be8db7-9848-4d45-9a9c-7842107ca942 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:58.926566 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7be8db7-9848-4d45-9a9c-7842107ca942 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:58.938722 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 217/436] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:29:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:58.939597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be8db7-9848-4d45-9a9c-7842107ca942 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:58.976749 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb43c4-05f0-4544-a263-d2fa2fddf678 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:59.016531 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671aab1-0418-4484-a8b7-190c26888997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:59.017158 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671aab1-0418-4484-a8b7-190c26888997 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:59.017443 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671aab1-0418-4484-a8b7-190c26888997 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:59.017722 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671aab1-0418-4484-a8b7-190c26888997 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:59.018512 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c671aab1-0418-4484-a8b7-190c26888997 None admin] RBAC: Adding query filter params (group.id=b12a8762f5fa4389903f78f3b2d31e61, role.id=dd9e162a1a25432d871c4c2c0ab779a5, scope.project.id=31cfb67162854a2b8231ce70ee068c46) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:59.018822 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c671aab1-0418-4484-a8b7-190c26888997 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:59.020317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c671aab1-0418-4484-a8b7-190c26888997 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:59.023354 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:59.026558 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 220/437] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Aug 5 02:29:58 2022] GET /identity/v3/role_assignments?group.id=b12a8762f5fa4389903f78f3b2d31e61&scope.project.id=31cfb67162854a2b8231ce70ee068c46&role.id=dd9e162a1a25432d871c4c2c0ab779a5 => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:59.033670 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ce89e-6ac0-49b8-8f9f-643a4a33eceb None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:59.033670 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ce89e-6ac0-49b8-8f9f-643a4a33eceb None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:59.033670 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ce89e-6ac0-49b8-8f9f-643a4a33eceb None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:59.033670 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 221/438] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:29:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:59.033670 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ce89e-6ac0-49b8-8f9f-643a4a33eceb None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:59.048478 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be8db7-9848-4d45-9a9c-7842107ca942 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:59.089024 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e5358-f012-43d1-bfcb-53c023468cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:59.090323 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e5358-f012-43d1-bfcb-53c023468cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:59.090613 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e5358-f012-43d1-bfcb-53c023468cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:59.091093 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e5358-f012-43d1-bfcb-53c023468cd5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:59.094803 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:59.105554 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e5358-f012-43d1-bfcb-53c023468cd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:59.121048 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-ab8e5358-f012-43d1-bfcb-53c023468cd5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:29:59.121048 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:59.121048 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:59.121048 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:59.121048 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:59.121048 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:59.121048 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:59.121048 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:59.121048 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:59.121048 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:59.121048 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:59.121048 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:59.121048 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:59.121048 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:59.121048 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:59.121048 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:59.122128 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:59.122128 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:59.122128 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:59.122128 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:59.122128 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:59.122128 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:59.122128 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:59.122128 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:59.122128 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:59.122128 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:59.122128 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:59.122128 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:59.122128 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:59.122128 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:59.122128 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:59.122128 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:59.122942 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:59.122942 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:59.122942 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:59.122942 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:59.122942 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:59.122942 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:59.122942 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:59.122942 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:59.122942 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:59.122942 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:59.122942 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:29:59.122942 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:29:59.122942 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 218/439] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 5 02:29:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:29:59.122942 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92e065-ef7d-4fe5-b0e3-9493a9482ede None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:59.123725 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92e065-ef7d-4fe5-b0e3-9493a9482ede None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:59.123725 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92e065-ef7d-4fe5-b0e3-9493a9482ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:59.134144 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-ad92e065-ef7d-4fe5-b0e3-9493a9482ede None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:59.135430 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-ad92e065-ef7d-4fe5-b0e3-9493a9482ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:59.150478 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ce89e-6ac0-49b8-8f9f-643a4a33eceb None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:59.188545 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7fead4-e822-4cc9-b777-64c1b17ea5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:59.189184 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fead4-e822-4cc9-b777-64c1b17ea5ad None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:59.189706 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fead4-e822-4cc9-b777-64c1b17ea5ad None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:59.189862 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fead4-e822-4cc9-b777-64c1b17ea5ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:59.218619 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 219/440] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:29:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:29:59.220588 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92e065-ef7d-4fe5-b0e3-9493a9482ede None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:59.269329 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:59.271797 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7fead4-e822-4cc9-b777-64c1b17ea5ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:59.273442 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7fead4-e822-4cc9-b777-64c1b17ea5ad None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:59.322775 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92e065-ef7d-4fe5-b0e3-9493a9482ede None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:59.348203 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:59.357379 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbd99b-15d2-408e-b5c8-29f29c353b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:59.357986 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbd99b-15d2-408e-b5c8-29f29c353b7d None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:59.358264 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbd99b-15d2-408e-b5c8-29f29c353b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:59.358533 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbd99b-15d2-408e-b5c8-29f29c353b7d None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:59.359270 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bbd99b-15d2-408e-b5c8-29f29c353b7d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:59.359574 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bbd99b-15d2-408e-b5c8-29f29c353b7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:59.360948 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bbd99b-15d2-408e-b5c8-29f29c353b7d None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:59.369547 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 220/441] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:29:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:59.370324 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbd99b-15d2-408e-b5c8-29f29c353b7d None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:59.372308 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 222/442] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:29:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:29:59.375812 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7fead4-e822-4cc9-b777-64c1b17ea5ad None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:59.465563 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbd99b-15d2-408e-b5c8-29f29c353b7d None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:59.471638 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:59.475022 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7fead4-e822-4cc9-b777-64c1b17ea5ad None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:59.498503 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2f830-008c-4f94-a82c-0d6271850919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:59.499161 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2f830-008c-4f94-a82c-0d6271850919 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:59.499440 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2f830-008c-4f94-a82c-0d6271850919 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:59.499712 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2f830-008c-4f94-a82c-0d6271850919 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:59.508457 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12030e39-ba46-4ce2-b176-d6084bc02565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:59.509069 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12030e39-ba46-4ce2-b176-d6084bc02565 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:59.509350 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12030e39-ba46-4ce2-b176-d6084bc02565 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:59.509451 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c2f830-008c-4f94-a82c-0d6271850919 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:29:59.509626 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12030e39-ba46-4ce2-b176-d6084bc02565 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:59.514683 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-08c2f830-008c-4f94-a82c-0d6271850919 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:29:59.514683 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:29:59.514683 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:29:59.514683 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:29:59.514683 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:29:59.514683 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:29:59.514683 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:29:59.514683 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:29:59.514683 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:29:59.514683 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:29:59.514683 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:29:59.514683 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:29:59.514683 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:29:59.514683 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:29:59.514683 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:29:59.514683 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:29:59.515619 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:29:59.515619 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:29:59.515619 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:29:59.515619 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:29:59.515619 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:29:59.515619 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:29:59.515619 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:29:59.515619 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:29:59.515619 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:29:59.515619 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:29:59.515619 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:29:59.515619 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:29:59.515619 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:29:59.515619 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:29:59.515619 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:29:59.515619 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:29:59.516423 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:29:59.516423 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:29:59.516423 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:29:59.516423 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:29:59.516423 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:29:59.516423 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:29:59.516423 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:29:59.516423 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:29:59.516423 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:29:59.516423 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:29:59.516423 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:29:59.516423 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:29:59.516423 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 221/443] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 5 02:29:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:29:59.517178 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2f830-008c-4f94-a82c-0d6271850919 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:59.568045 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:59.578216 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12030e39-ba46-4ce2-b176-d6084bc02565 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:59.579831 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12030e39-ba46-4ce2-b176-d6084bc02565 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:59.616599 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2f830-008c-4f94-a82c-0d6271850919 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:59.649440 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf8d9c3-dbb1-468a-a17f-25475b328e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:59.650473 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8d9c3-dbb1-468a-a17f-25475b328e65 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:59.650763 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8d9c3-dbb1-468a-a17f-25475b328e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:59.651079 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8d9c3-dbb1-468a-a17f-25475b328e65 None admin] PATH_INFO: `/v3/projects/4e2cf55519e4431b85bdc27977f9165d` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:59.652616 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf8d9c3-dbb1-468a-a17f-25475b328e65 None admin] RBAC: Authorizing `identity:get_project(project_id=4e2cf55519e4431b85bdc27977f9165d)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:59.654381 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf8d9c3-dbb1-468a-a17f-25475b328e65 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:59.656075 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 222/444] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:29:59 2022] GET /identity/v3/projects/4e2cf55519e4431b85bdc27977f9165d => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:59.656837 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf8d9c3-dbb1-468a-a17f-25475b328e65 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:59.671579 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:59.675132 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 223/445] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:29:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 05 02:29:59.675918 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12030e39-ba46-4ce2-b176-d6084bc02565 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:59.754145 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf8d9c3-dbb1-468a-a17f-25475b328e65 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:59.769807 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:59.770786 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12030e39-ba46-4ce2-b176-d6084bc02565 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:59.788213 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde0d3c-d387-4a92-8b63-9b2d35494615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:59.788822 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde0d3c-d387-4a92-8b63-9b2d35494615 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:59.789110 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde0d3c-d387-4a92-8b63-9b2d35494615 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:59.789387 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde0d3c-d387-4a92-8b63-9b2d35494615 None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:59.790099 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde0d3c-d387-4a92-8b63-9b2d35494615 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:29:59.790406 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde0d3c-d387-4a92-8b63-9b2d35494615 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:59.791869 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde0d3c-d387-4a92-8b63-9b2d35494615 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:59.800733 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 223/446] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:29:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:59.801409 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde0d3c-d387-4a92-8b63-9b2d35494615 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:59.808643 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b0436-d873-45c6-96eb-28597bb55e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:59.809295 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b0436-d873-45c6-96eb-28597bb55e5d None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:59.809575 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b0436-d873-45c6-96eb-28597bb55e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:59.809851 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b0436-d873-45c6-96eb-28597bb55e5d None admin] PATH_INFO: `/v3/groups/b12a8762f5fa4389903f78f3b2d31e61` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:59.811025 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512b0436-d873-45c6-96eb-28597bb55e5d None admin] RBAC: Authorizing `identity:get_group(group_id=b12a8762f5fa4389903f78f3b2d31e61)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:59.812897 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512b0436-d873-45c6-96eb-28597bb55e5d None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:59.814882 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 224/447] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Aug 5 02:29:59 2022] GET /identity/v3/groups/b12a8762f5fa4389903f78f3b2d31e61 => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:59.815965 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b0436-d873-45c6-96eb-28597bb55e5d None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:59.882329 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:59.902849 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde0d3c-d387-4a92-8b63-9b2d35494615 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:59.914881 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b0436-d873-45c6-96eb-28597bb55e5d None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:59.936898 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0489246-26a4-4c33-8b49-e06ed8a651e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:59.937571 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0489246-26a4-4c33-8b49-e06ed8a651e9 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:59.937847 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0489246-26a4-4c33-8b49-e06ed8a651e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:59.938119 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0489246-26a4-4c33-8b49-e06ed8a651e9 None admin] PATH_INFO: `/v3/projects/31cfb67162854a2b8231ce70ee068c46` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:59.939646 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0489246-26a4-4c33-8b49-e06ed8a651e9 None admin] RBAC: Authorizing `identity:get_project(project_id=31cfb67162854a2b8231ce70ee068c46)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:59.941070 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0489246-26a4-4c33-8b49-e06ed8a651e9 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:59.942878 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 224/448] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:29:59 2022] GET /identity/v3/projects/31cfb67162854a2b8231ce70ee068c46 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:29:59.943563 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0489246-26a4-4c33-8b49-e06ed8a651e9 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:59.950158 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c949d-0d0a-4cd6-a66e-7b11b7fdca7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:59.950778 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c949d-0d0a-4cd6-a66e-7b11b7fdca7e None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:59.951088 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c949d-0d0a-4cd6-a66e-7b11b7fdca7e None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:59.951366 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c949d-0d0a-4cd6-a66e-7b11b7fdca7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:59.992142 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:00.018108 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c949d-0d0a-4cd6-a66e-7b11b7fdca7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:00.019616 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c949d-0d0a-4cd6-a66e-7b11b7fdca7e None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:00.044580 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0489246-26a4-4c33-8b49-e06ed8a651e9 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:00.078538 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b29d8a-0e25-4ddb-b7f1-67bb1f420b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:00.079240 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b29d8a-0e25-4ddb-b7f1-67bb1f420b2c None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:00.079546 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b29d8a-0e25-4ddb-b7f1-67bb1f420b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:00.079833 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b29d8a-0e25-4ddb-b7f1-67bb1f420b2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:00.080618 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b29d8a-0e25-4ddb-b7f1-67bb1f420b2c None admin] RBAC: Adding query filter params (group.id=b12a8762f5fa4389903f78f3b2d31e61, role.id=428314713da6487e8047a1f333265cda, scope.project.id=4e2cf55519e4431b85bdc27977f9165d) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:00.080930 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b29d8a-0e25-4ddb-b7f1-67bb1f420b2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:00.082352 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b29d8a-0e25-4ddb-b7f1-67bb1f420b2c None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:00.084446 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:00.088665 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 225/449] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Aug 5 02:29:59 2022] GET /identity/v3/role_assignments?group.id=b12a8762f5fa4389903f78f3b2d31e61&scope.project.id=4e2cf55519e4431b85bdc27977f9165d&role.id=428314713da6487e8047a1f333265cda => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:00.094537 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b29d8a-0e25-4ddb-b7f1-67bb1f420b2c None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:00.125963 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 225/450] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:29:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:30:00.131846 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c949d-0d0a-4cd6-a66e-7b11b7fdca7e None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:00.202598 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b29d8a-0e25-4ddb-b7f1-67bb1f420b2c None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:00.217363 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:00.241581 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c949d-0d0a-4cd6-a66e-7b11b7fdca7e None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:00.243352 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f4a5d-063b-4d77-9e2e-9f4e701cf373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:00.244010 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f4a5d-063b-4d77-9e2e-9f4e701cf373 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:00.244293 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f4a5d-063b-4d77-9e2e-9f4e701cf373 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:00.244569 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f4a5d-063b-4d77-9e2e-9f4e701cf373 None admin] PATH_INFO: `/v3/groups/b12a8762f5fa4389903f78f3b2d31e61` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:00.245755 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f4a5d-063b-4d77-9e2e-9f4e701cf373 None admin] RBAC: Authorizing `identity:get_group(group_id=b12a8762f5fa4389903f78f3b2d31e61)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:00.247298 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f4a5d-063b-4d77-9e2e-9f4e701cf373 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:00.249304 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 226/451] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Aug 5 02:30:00 2022] GET /identity/v3/groups/b12a8762f5fa4389903f78f3b2d31e61 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:00.257229 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f4a5d-063b-4d77-9e2e-9f4e701cf373 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:00.283455 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773803e8-878d-48d0-9db7-4a2248ae2c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:00.284105 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773803e8-878d-48d0-9db7-4a2248ae2c77 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:00.285090 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773803e8-878d-48d0-9db7-4a2248ae2c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:00.285197 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773803e8-878d-48d0-9db7-4a2248ae2c77 None admin] PATH_INFO: `/v3/projects/7de4c8b74b3245d8bf8c7d1c57f4237e` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:00.286304 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773803e8-878d-48d0-9db7-4a2248ae2c77 None admin] RBAC: Authorizing `identity:get_project(project_id=7de4c8b74b3245d8bf8c7d1c57f4237e)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:00.287862 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773803e8-878d-48d0-9db7-4a2248ae2c77 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:00.289531 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 226/452] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:30:00 2022] GET /identity/v3/projects/7de4c8b74b3245d8bf8c7d1c57f4237e => generated 344 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:00.294912 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773803e8-878d-48d0-9db7-4a2248ae2c77 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:00.334867 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:00.374392 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f4a5d-063b-4d77-9e2e-9f4e701cf373 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:00.411931 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773803e8-878d-48d0-9db7-4a2248ae2c77 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:00.414892 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50446eb8-fe5d-4fe1-b034-cf2c9ec53129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:00.415069 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50446eb8-fe5d-4fe1-b034-cf2c9ec53129 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:00.415286 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50446eb8-fe5d-4fe1-b034-cf2c9ec53129 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:00.415570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50446eb8-fe5d-4fe1-b034-cf2c9ec53129 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:00.416363 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50446eb8-fe5d-4fe1-b034-cf2c9ec53129 None admin] RBAC: Adding query filter params (group.id=b12a8762f5fa4389903f78f3b2d31e61, role.id=428314713da6487e8047a1f333265cda, scope.project.id=31cfb67162854a2b8231ce70ee068c46) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:00.416675 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50446eb8-fe5d-4fe1-b034-cf2c9ec53129 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:00.418115 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50446eb8-fe5d-4fe1-b034-cf2c9ec53129 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:00.424631 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 227/453] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Aug 5 02:30:00 2022] GET /identity/v3/role_assignments?group.id=b12a8762f5fa4389903f78f3b2d31e61&scope.project.id=31cfb67162854a2b8231ce70ee068c46&role.id=428314713da6487e8047a1f333265cda => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:30:00.457793 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e6479-4c6b-430b-89d2-835d28277e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:00.458376 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e6479-4c6b-430b-89d2-835d28277e36 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:00.458656 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e6479-4c6b-430b-89d2-835d28277e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:00.458932 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e6479-4c6b-430b-89d2-835d28277e36 None admin] PATH_INFO: `/v3/groups/efaee399504e4247af672daf23935b15` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:00.460345 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3e6479-4c6b-430b-89d2-835d28277e36 None admin] RBAC: Authorizing `identity:get_group(group_id=efaee399504e4247af672daf23935b15)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:00.461847 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3e6479-4c6b-430b-89d2-835d28277e36 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:00.464074 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 227/454] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Aug 5 02:30:00 2022] GET /identity/v3/groups/efaee399504e4247af672daf23935b15 => generated 229 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:30:00.469982 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50446eb8-fe5d-4fe1-b034-cf2c9ec53129 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:00.523796 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:00.586337 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50446eb8-fe5d-4fe1-b034-cf2c9ec53129 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:00.621939 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2676958-8eb5-47c7-b31f-b7b67c911213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:00.622566 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2676958-8eb5-47c7-b31f-b7b67c911213 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:00.622850 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2676958-8eb5-47c7-b31f-b7b67c911213 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:00.623164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2676958-8eb5-47c7-b31f-b7b67c911213 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:00.623960 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2676958-8eb5-47c7-b31f-b7b67c911213 None admin] RBAC: Adding query filter params (group.id=efaee399504e4247af672daf23935b15, role.id=83afe883a303495b966480fb9b5bb7dd, scope.project.id=7de4c8b74b3245d8bf8c7d1c57f4237e) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:00.624279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2676958-8eb5-47c7-b31f-b7b67c911213 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:00.625723 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2676958-8eb5-47c7-b31f-b7b67c911213 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:00.635380 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 228/455] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Aug 5 02:30:00 2022] GET /identity/v3/role_assignments?group.id=efaee399504e4247af672daf23935b15&scope.project.id=7de4c8b74b3245d8bf8c7d1c57f4237e&role.id=83afe883a303495b966480fb9b5bb7dd => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:30:03.036049 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf75fe-3416-4032-bf3f-e45d0af7f0b0 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:03.037172 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf75fe-3416-4032-bf3f-e45d0af7f0b0 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:03.037172 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf75fe-3416-4032-bf3f-e45d0af7f0b0 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:03.038807 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 228/456] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:30:03.044679 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce377af-c6b8-49a3-a0f0-2ede072c7c53 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:03.045145 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce377af-c6b8-49a3-a0f0-2ede072c7c53 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:03.045220 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce377af-c6b8-49a3-a0f0-2ede072c7c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:03.073003 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-6ce377af-c6b8-49a3-a0f0-2ede072c7c53 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:03.074191 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-6ce377af-c6b8-49a3-a0f0-2ede072c7c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:03.149327 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 229/457] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:30:03.188655 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf75fe-3416-4032-bf3f-e45d0af7f0b0 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:03.282062 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de77485-f474-46c6-8554-800dbca0defd None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:03.282666 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de77485-f474-46c6-8554-800dbca0defd None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:03.283170 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de77485-f474-46c6-8554-800dbca0defd None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:03.285257 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 230/458] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:30:03.291118 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fee5c4-8aa2-4166-9915-ee096be402e5 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:03.291583 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fee5c4-8aa2-4166-9915-ee096be402e5 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:03.292261 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fee5c4-8aa2-4166-9915-ee096be402e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:03.313369 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-87fee5c4-8aa2-4166-9915-ee096be402e5 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:03.314889 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-87fee5c4-8aa2-4166-9915-ee096be402e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:03.360608 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:03.365234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf75fe-3416-4032-bf3f-e45d0af7f0b0 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:03.369855 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:03.407874 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 231/459] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:30:03.435373 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fee5c4-8aa2-4166-9915-ee096be402e5 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:03.452480 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161c40f-ba7e-4ac3-a750-322305850d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:03.453328 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161c40f-ba7e-4ac3-a750-322305850d3f None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:03.453747 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161c40f-ba7e-4ac3-a750-322305850d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:03.454184 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161c40f-ba7e-4ac3-a750-322305850d3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:03.476628 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7161c40f-ba7e-4ac3-a750-322305850d3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:03.480904 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7161c40f-ba7e-4ac3-a750-322305850d3f None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:03.517395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-7161c40f-ba7e-4ac3-a750-322305850d3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:03.517395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:03.517395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:03.517395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:03.517395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:03.517395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:03.517395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:03.517395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:03.517395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:03.517395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:03.517395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:03.517395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:03.517395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:03.517395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:03.517395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:03.518505 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:03.518505 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:03.518505 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:03.518505 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:03.518505 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:03.518505 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:03.518505 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:03.518505 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:03.518505 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:03.518505 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:03.518505 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:03.518505 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:03.518505 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:03.518505 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:03.518505 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:03.518505 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:03.518505 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:03.519907 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:03.519907 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:03.519907 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:03.519907 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:03.527067 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 229/460] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:03.527970 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161c40f-ba7e-4ac3-a750-322305850d3f None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:03.566872 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fee5c4-8aa2-4166-9915-ee096be402e5 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:03.610102 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f641913-3490-4d20-bbb4-15289fa2630f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:03.611306 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f641913-3490-4d20-bbb4-15289fa2630f None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:03.611730 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f641913-3490-4d20-bbb4-15289fa2630f None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:03.612415 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f641913-3490-4d20-bbb4-15289fa2630f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:03.627517 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f641913-3490-4d20-bbb4-15289fa2630f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:03.629786 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f641913-3490-4d20-bbb4-15289fa2630f None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:03.650795 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-4f641913-3490-4d20-bbb4-15289fa2630f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:03.650795 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:03.650795 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:03.650795 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:03.650795 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:03.650795 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:03.650795 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:03.650795 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:03.650795 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:03.650795 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:03.650795 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:03.650795 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:03.650795 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:03.650795 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:03.650795 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:03.651895 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:03.651895 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:03.651895 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:03.651895 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:03.651895 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:03.651895 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:03.651895 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:03.651895 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:03.651895 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:03.651895 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:03.651895 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:03.651895 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:03.651895 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:03.651895 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:03.651895 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:03.651895 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:03.651895 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:03.652928 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:03.652928 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:03.652928 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:03.652928 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:03.654705 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 232/461] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:03.660677 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d49e69-2be1-40a9-b656-d016f601deeb None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:03.661142 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d49e69-2be1-40a9-b656-d016f601deeb None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:03.661585 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d49e69-2be1-40a9-b656-d016f601deeb None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:03.663001 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 233/462] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:30:03.663837 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d49e69-2be1-40a9-b656-d016f601deeb None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:03.675486 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161c40f-ba7e-4ac3-a750-322305850d3f None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:03.684910 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:03.712571 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4518c-b2e9-4354-8f0e-543d926203ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:03.713194 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4518c-b2e9-4354-8f0e-543d926203ab None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:03.713476 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4518c-b2e9-4354-8f0e-543d926203ab None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:03.713751 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4518c-b2e9-4354-8f0e-543d926203ab None admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:03.714518 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4518c-b2e9-4354-8f0e-543d926203ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:03.714822 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4518c-b2e9-4354-8f0e-543d926203ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:03.716524 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4518c-b2e9-4354-8f0e-543d926203ab None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:03.734764 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 230/463] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:03.735954 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc64dd7d-d49f-466d-857d-8f748a961c80 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:03.736250 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc64dd7d-d49f-466d-857d-8f748a961c80 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:03.736526 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc64dd7d-d49f-466d-857d-8f748a961c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:03.757783 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-fc64dd7d-d49f-466d-857d-8f748a961c80 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:03.759109 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-fc64dd7d-d49f-466d-857d-8f748a961c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:03.770725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:03.787322 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d49e69-2be1-40a9-b656-d016f601deeb None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:03.834340 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d3f94-b3f1-4422-be42-4dd4f3ca4905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:03.834989 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d3f94-b3f1-4422-be42-4dd4f3ca4905 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:03.835346 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d3f94-b3f1-4422-be42-4dd4f3ca4905 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:03.835686 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d3f94-b3f1-4422-be42-4dd4f3ca4905 None admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:03.836452 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095d3f94-b3f1-4422-be42-4dd4f3ca4905 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:03.836824 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095d3f94-b3f1-4422-be42-4dd4f3ca4905 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:03.838353 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095d3f94-b3f1-4422-be42-4dd4f3ca4905 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:03.843240 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 231/464] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:30:03.844222 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc64dd7d-d49f-466d-857d-8f748a961c80 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:03.853308 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 234/465] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:03.858512 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d3f94-b3f1-4422-be42-4dd4f3ca4905 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:03.945272 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:03.967060 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d3f94-b3f1-4422-be42-4dd4f3ca4905 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:03.983802 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc64dd7d-d49f-466d-857d-8f748a961c80 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:04.004260 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9aef4d-0205-46ce-a55e-3b8726119d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:04.005503 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9aef4d-0205-46ce-a55e-3b8726119d0d None admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:04.006331 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9aef4d-0205-46ce-a55e-3b8726119d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:04.006823 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9aef4d-0205-46ce-a55e-3b8726119d0d None admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:04.007705 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9aef4d-0205-46ce-a55e-3b8726119d0d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:04.009864 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9aef4d-0205-46ce-a55e-3b8726119d0d None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:04.025063 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c7e312-e700-4995-8a57-2f0871268aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:04.025799 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7e312-e700-4995-8a57-2f0871268aa2 None admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:04.026178 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7e312-e700-4995-8a57-2f0871268aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:04.026522 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7e312-e700-4995-8a57-2f0871268aa2 None admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:04.027306 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c7e312-e700-4995-8a57-2f0871268aa2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:04.028857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c7e312-e700-4995-8a57-2f0871268aa2 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:04.117120 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 235/466] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 5 02:30:03 2022] POST /identity/v3/users => generated 248 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:30:04.117988 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9aef4d-0205-46ce-a55e-3b8726119d0d None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:04.151604 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 232/467] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 5 02:30:03 2022] POST /identity/v3/users => generated 246 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:30:04.154022 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd402f4-bf9f-4c7a-9b41-c773a3315d84 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:04.154658 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd402f4-bf9f-4c7a-9b41-c773a3315d84 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:04.155174 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd402f4-bf9f-4c7a-9b41-c773a3315d84 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:04.161889 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 233/468] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:30:04.173120 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f4589-48c1-4511-9f3f-66d1699b77d8 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:04.173735 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f4589-48c1-4511-9f3f-66d1699b77d8 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:04.174434 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f4589-48c1-4511-9f3f-66d1699b77d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:04.187559 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:04.210323 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-f60f4589-48c1-4511-9f3f-66d1699b77d8 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:04.213831 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-f60f4589-48c1-4511-9f3f-66d1699b77d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:04.295978 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9aef4d-0205-46ce-a55e-3b8726119d0d None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:04.354584 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 234/469] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:30:04.356657 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08dcdbe-fb65-4128-a379-33692395e1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:04.357331 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08dcdbe-fb65-4128-a379-33692395e1ae None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:04.357618 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08dcdbe-fb65-4128-a379-33692395e1ae None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:04.357898 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08dcdbe-fb65-4128-a379-33692395e1ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:04.366239 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:04.370345 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08dcdbe-fb65-4128-a379-33692395e1ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:04.371827 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08dcdbe-fb65-4128-a379-33692395e1ae None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:04.380044 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f4589-48c1-4511-9f3f-66d1699b77d8 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:04.392267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-b08dcdbe-fb65-4128-a379-33692395e1ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:04.392267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:04.392267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:04.392267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:04.392267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:04.392267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:04.392267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:04.392267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:04.392267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:04.392267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:04.392267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:04.392267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:04.392267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:04.392267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:04.392267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:04.393166 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:04.393166 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:04.393166 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:04.393166 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:04.393166 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:04.393166 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:04.393166 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:04.393166 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:04.393166 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:04.393166 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:04.393166 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:04.393166 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:04.393166 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:04.393166 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:04.393166 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:04.393166 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:04.393166 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:04.394032 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:04.394032 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:04.394032 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:04.394032 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:04.394032 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 236/470] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:04.400041 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08dcdbe-fb65-4128-a379-33692395e1ae None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:04.520456 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f4589-48c1-4511-9f3f-66d1699b77d8 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:04.529477 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08dcdbe-fb65-4128-a379-33692395e1ae None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:04.570942 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:04.579218 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614018c-5b9c-4141-b51b-1432e71bbcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:04.581321 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614018c-5b9c-4141-b51b-1432e71bbcbb None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:04.589383 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614018c-5b9c-4141-b51b-1432e71bbcbb None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:04.589383 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614018c-5b9c-4141-b51b-1432e71bbcbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:04.600854 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc56fa1-5c0c-48ff-b7f7-02000855d6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:04.601486 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc56fa1-5c0c-48ff-b7f7-02000855d6c9 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:04.601769 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc56fa1-5c0c-48ff-b7f7-02000855d6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:04.602048 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc56fa1-5c0c-48ff-b7f7-02000855d6c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:04.602815 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc56fa1-5c0c-48ff-b7f7-02000855d6c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:04.603151 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc56fa1-5c0c-48ff-b7f7-02000855d6c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:04.604550 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc56fa1-5c0c-48ff-b7f7-02000855d6c9 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:04.607074 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d614018c-5b9c-4141-b51b-1432e71bbcbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:04.608537 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d614018c-5b9c-4141-b51b-1432e71bbcbb None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:04.632908 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 237/471] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:04.642413 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-d614018c-5b9c-4141-b51b-1432e71bbcbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:04.642413 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:04.642413 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:04.642413 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:04.642413 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:04.642413 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:04.642413 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:04.642413 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:04.642413 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:04.642413 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:04.642413 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:04.642413 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:04.642413 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:04.642413 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:04.642413 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:04.643325 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:04.643325 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:04.643325 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:04.643325 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:04.643325 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:04.643325 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:04.643325 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:04.643325 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:04.643325 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:04.643325 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:04.643325 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:04.643325 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:04.643325 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:04.643325 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:04.643325 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:04.643325 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:04.643325 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:04.644701 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:04.644701 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:04.644701 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:04.644701 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:04.644701 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 235/472] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:30:04.645500 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc56fa1-5c0c-48ff-b7f7-02000855d6c9 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:04.660620 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614018c-5b9c-4141-b51b-1432e71bbcbb None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:04.736181 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:04.801256 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc56fa1-5c0c-48ff-b7f7-02000855d6c9 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:04.821997 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614018c-5b9c-4141-b51b-1432e71bbcbb None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:04.847072 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1df7b-885a-4cce-8ab9-c90b5ca3e7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:04.847072 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1df7b-885a-4cce-8ab9-c90b5ca3e7db None admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:04.847072 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1df7b-885a-4cce-8ab9-c90b5ca3e7db None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:04.847072 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1df7b-885a-4cce-8ab9-c90b5ca3e7db None admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:04.847478 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f1df7b-885a-4cce-8ab9-c90b5ca3e7db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:04.847478 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f1df7b-885a-4cce-8ab9-c90b5ca3e7db None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:04.859875 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd899675-c1d7-443a-9aa5-9a209fde4b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:04.860502 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd899675-c1d7-443a-9aa5-9a209fde4b82 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:04.860789 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd899675-c1d7-443a-9aa5-9a209fde4b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:04.861067 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd899675-c1d7-443a-9aa5-9a209fde4b82 None admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:04.861785 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd899675-c1d7-443a-9aa5-9a209fde4b82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:04.862072 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd899675-c1d7-443a-9aa5-9a209fde4b82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:04.863510 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd899675-c1d7-443a-9aa5-9a209fde4b82 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:04.875625 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 236/473] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:04.876697 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee572d-6726-46f6-a318-5b3a19c8a70c None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:04.876993 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee572d-6726-46f6-a318-5b3a19c8a70c None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:04.877268 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee572d-6726-46f6-a318-5b3a19c8a70c None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:04.878606 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 237/474] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:30:04.883839 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee572d-6726-46f6-a318-5b3a19c8a70c None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:04.935645 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:04.936045 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 238/475] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 5 02:30:04 2022] POST /identity/v3/users => generated 248 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:30:04.937229 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db0856-131d-4c9e-8fc4-3d5dac4e27b0 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:04.937526 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db0856-131d-4c9e-8fc4-3d5dac4e27b0 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:04.937810 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db0856-131d-4c9e-8fc4-3d5dac4e27b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:04.958803 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-04db0856-131d-4c9e-8fc4-3d5dac4e27b0 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:04.960226 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-04db0856-131d-4c9e-8fc4-3d5dac4e27b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:05.021711 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee572d-6726-46f6-a318-5b3a19c8a70c None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:05.102701 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b173d-fd0c-4ab1-a4a2-7a07d73cb1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:05.103393 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b173d-fd0c-4ab1-a4a2-7a07d73cb1a3 None admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:05.103680 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b173d-fd0c-4ab1-a4a2-7a07d73cb1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:05.103988 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b173d-fd0c-4ab1-a4a2-7a07d73cb1a3 None admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:05.104712 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b173d-fd0c-4ab1-a4a2-7a07d73cb1a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:05.106199 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b173d-fd0c-4ab1-a4a2-7a07d73cb1a3 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:05.108736 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 239/476] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:30:05.134822 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db0856-131d-4c9e-8fc4-3d5dac4e27b0 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:05.168019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:05.187516 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 238/477] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 5 02:30:04 2022] POST /identity/v3/users => generated 249 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:30:05.289924 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db0856-131d-4c9e-8fc4-3d5dac4e27b0 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:05.331370 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1ce9e-c752-42cc-b4fc-5dda6e1cf9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:05.331998 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1ce9e-c752-42cc-b4fc-5dda6e1cf9a3 None admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:05.332283 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1ce9e-c752-42cc-b4fc-5dda6e1cf9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:05.332556 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1ce9e-c752-42cc-b4fc-5dda6e1cf9a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:05.333426 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d1ce9e-c752-42cc-b4fc-5dda6e1cf9a3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:05.334847 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d1ce9e-c752-42cc-b4fc-5dda6e1cf9a3 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:05.369134 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.sql.core [None req-39d1ce9e-c752-42cc-b4fc-5dda6e1cf9a3 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 05 02:30:05.369134 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 05 02:30:05.369134 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [parameters: {'id': '76f290947d794b9d9c1f21cc52dcfd19', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 05 02:30:05.369134 dv-cinder-815582-13-smb devstack@keystone.service[80822]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80822) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 05 02:30:05.386034 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-39d1ce9e-c752-42cc-b4fc-5dda6e1cf9a3 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 05 02:30:05.386034 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:05.386034 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 05 02:30:05.386034 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 05 02:30:05.386034 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 05 02:30:05.386034 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 05 02:30:05.386034 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 05 02:30:05.386034 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application result = self._query(query) Aug 05 02:30:05.386034 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 05 02:30:05.386034 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application conn.query(q) Aug 05 02:30:05.386034 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 05 02:30:05.386034 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 05 02:30:05.386034 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 05 02:30:05.386034 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application result.read() Aug 05 02:30:05.386034 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 05 02:30:05.386993 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 05 02:30:05.386993 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 05 02:30:05.386993 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 05 02:30:05.386993 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 05 02:30:05.386993 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 05 02:30:05.386993 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 05 02:30:05.386993 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 05 02:30:05.386993 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 05 02:30:05.386993 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:05.386993 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 05 02:30:05.386993 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:05.386993 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:05.386993 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 05 02:30:05.386993 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 05 02:30:05.386993 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 05 02:30:05.386993 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return ref.to_dict() Aug 05 02:30:05.386993 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 05 02:30:05.386993 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application next(self.gen) Aug 05 02:30:05.387921 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 05 02:30:05.387921 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application yield resource Aug 05 02:30:05.387921 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 05 02:30:05.387921 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application next(self.gen) Aug 05 02:30:05.387921 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 05 02:30:05.387921 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self.session.rollback() Aug 05 02:30:05.387921 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 05 02:30:05.387921 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self.force_reraise() Aug 05 02:30:05.387921 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 05 02:30:05.387921 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise self.value Aug 05 02:30:05.387921 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 05 02:30:05.387921 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 05 02:30:05.387921 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 05 02:30:05.387921 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application session.commit() Aug 05 02:30:05.387921 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 05 02:30:05.387921 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 05 02:30:05.387921 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 05 02:30:05.388768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self._prepare_impl() Aug 05 02:30:05.388768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 05 02:30:05.388768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self.session.flush() Aug 05 02:30:05.388768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 05 02:30:05.388768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self._flush(objects) Aug 05 02:30:05.388768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 05 02:30:05.388768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 05 02:30:05.388768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 05 02:30:05.388768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application compat.raise_( Aug 05 02:30:05.388768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 05 02:30:05.388768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception Aug 05 02:30:05.388768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 05 02:30:05.388768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application flush_context.execute() Aug 05 02:30:05.388768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 05 02:30:05.388768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rec.execute(self) Aug 05 02:30:05.388768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 05 02:30:05.388768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 05 02:30:05.389677 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 05 02:30:05.389677 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 05 02:30:05.389677 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 05 02:30:05.389677 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 05 02:30:05.389677 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 05 02:30:05.389677 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 05 02:30:05.389677 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 05 02:30:05.389677 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 05 02:30:05.389677 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 05 02:30:05.389677 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 05 02:30:05.389677 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 05 02:30:05.389677 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 05 02:30:05.389677 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 05 02:30:05.389677 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 05 02:30:05.389677 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 05 02:30:05.389677 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception Aug 05 02:30:05.390621 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 05 02:30:05.390621 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 05 02:30:05.390621 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 05 02:30:05.390621 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 05 02:30:05.390621 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 05 02:30:05.390621 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application result = self._query(query) Aug 05 02:30:05.390621 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 05 02:30:05.390621 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application conn.query(q) Aug 05 02:30:05.390621 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 05 02:30:05.390621 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 05 02:30:05.390621 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 05 02:30:05.390621 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application result.read() Aug 05 02:30:05.390621 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 05 02:30:05.390621 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 05 02:30:05.390621 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 05 02:30:05.390621 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 05 02:30:05.391439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 05 02:30:05.391439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 05 02:30:05.391439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 05 02:30:05.391439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 05 02:30:05.391439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 05 02:30:05.391439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 05 02:30:05.391439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [parameters: {'id': '76f290947d794b9d9c1f21cc52dcfd19', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 05 02:30:05.391439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 05 02:30:05.391439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:05.391439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:30:05.391439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:05.391439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:05.391439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:05.391439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:05.391439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:05.391439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:05.392222 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:05.392222 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:05.392222 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:05.392222 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:05.392222 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:05.392222 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:05.392222 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 05 02:30:05.392222 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 05 02:30:05.392222 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:05.392222 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:05.392222 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 05 02:30:05.392222 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 05 02:30:05.392222 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 05 02:30:05.392222 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 05 02:30:05.392222 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 05 02:30:05.392222 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:05.393233 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 240/478] 10.222.0.42 () {60 vars in 1131 bytes} [Fri Aug 5 02:30:05 2022] POST /identity/v3/roles => generated 144 bytes in 254 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:30:05.398094 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b173d-fd0c-4ab1-a4a2-7a07d73cb1a3 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:05.504666 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:05.507851 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b173d-fd0c-4ab1-a4a2-7a07d73cb1a3 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:05.546124 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e73f6e-864f-4614-a8c1-e50588f0f69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:05.546858 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e73f6e-864f-4614-a8c1-e50588f0f69d None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:05.547171 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e73f6e-864f-4614-a8c1-e50588f0f69d None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:05.547447 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e73f6e-864f-4614-a8c1-e50588f0f69d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:05.559612 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e73f6e-864f-4614-a8c1-e50588f0f69d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:30:05.564746 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-78e73f6e-864f-4614-a8c1-e50588f0f69d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:30:05.564746 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:05.564746 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:05.564746 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:05.564746 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:05.564746 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:05.564746 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:05.564746 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:05.564746 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:05.564746 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:05.564746 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:05.564746 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:05.564746 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:30:05.564746 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:30:05.564746 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:30:05.564746 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:30:05.566876 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:30:05.566876 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:30:05.566876 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:30:05.566876 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:30:05.566876 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:05.566876 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:05.566876 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:05.566876 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:05.566876 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:05.566876 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:05.566876 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:05.566876 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:05.566876 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:05.566876 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:05.566876 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:05.566876 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:05.569160 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:05.569160 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:05.569160 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:05.569160 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:05.569160 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:30:05.569160 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:30:05.569160 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:30:05.569160 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:30:05.569160 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:30:05.569160 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:30:05.569160 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:30:05.569160 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:05.569160 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 239/479] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 5 02:30:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:05.574998 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1ce9e-c752-42cc-b4fc-5dda6e1cf9a3 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:05.690874 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:05.697467 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1ce9e-c752-42cc-b4fc-5dda6e1cf9a3 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:05.744586 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0d5c1-0fc3-48c8-ae8c-22a3e65ee00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:05.745604 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0d5c1-0fc3-48c8-ae8c-22a3e65ee00f None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:05.746091 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0d5c1-0fc3-48c8-ae8c-22a3e65ee00f None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:05.746574 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0d5c1-0fc3-48c8-ae8c-22a3e65ee00f None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:05.747526 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0d5c1-0fc3-48c8-ae8c-22a3e65ee00f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:05.748032 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0d5c1-0fc3-48c8-ae8c-22a3e65ee00f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:05.749717 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0d5c1-0fc3-48c8-ae8c-22a3e65ee00f None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:05.762552 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 241/480] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:30:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:30:06.629908 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7c7be-c35b-46a1-a22f-799cb79a082b None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:06.631216 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7c7be-c35b-46a1-a22f-799cb79a082b None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:06.631216 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7c7be-c35b-46a1-a22f-799cb79a082b None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:06.632380 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 240/481] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:30:06.647503 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b13358-65d6-404d-a43b-d9a7c04ed4b6 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:06.648083 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b13358-65d6-404d-a43b-d9a7c04ed4b6 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:06.648083 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b13358-65d6-404d-a43b-d9a7c04ed4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:06.682638 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd0c97-d875-4246-ba8d-0e42e0ae9df4 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:06.682638 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd0c97-d875-4246-ba8d-0e42e0ae9df4 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:06.682638 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd0c97-d875-4246-ba8d-0e42e0ae9df4 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:06.682638 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 241/482] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:30:06.683388 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-c3b13358-65d6-404d-a43b-d9a7c04ed4b6 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:06.683388 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-c3b13358-65d6-404d-a43b-d9a7c04ed4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:06.686317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fb31d-7c64-438c-b4fd-5f7b6654b54c None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:06.686810 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fb31d-7c64-438c-b4fd-5f7b6654b54c None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:06.687347 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fb31d-7c64-438c-b4fd-5f7b6654b54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:06.726527 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-ee8fb31d-7c64-438c-b4fd-5f7b6654b54c None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:06.732313 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-ee8fb31d-7c64-438c-b4fd-5f7b6654b54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:06.849403 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 242/483] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:30:06.885655 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b13358-65d6-404d-a43b-d9a7c04ed4b6 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:06.908376 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 242/484] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:30:06.948156 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8fb31d-7c64-438c-b4fd-5f7b6654b54c None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:07.099317 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:07.122613 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b13358-65d6-404d-a43b-d9a7c04ed4b6 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:07.147357 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:07.162855 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8fb31d-7c64-438c-b4fd-5f7b6654b54c None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:07.202576 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf2ad7-fa11-4ea6-8bd4-ca08dbd6f510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:07.203183 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf2ad7-fa11-4ea6-8bd4-ca08dbd6f510 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:07.203479 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf2ad7-fa11-4ea6-8bd4-ca08dbd6f510 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:07.203761 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf2ad7-fa11-4ea6-8bd4-ca08dbd6f510 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:07.204092 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde17f1-bdcb-4c67-ac00-4313970b0089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:07.204933 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde17f1-bdcb-4c67-ac00-4313970b0089 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:07.205220 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde17f1-bdcb-4c67-ac00-4313970b0089 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:07.205494 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde17f1-bdcb-4c67-ac00-4313970b0089 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:07.218237 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf2ad7-fa11-4ea6-8bd4-ca08dbd6f510 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:30:07.223518 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-cedf2ad7-fa11-4ea6-8bd4-ca08dbd6f510 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:30:07.223518 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:07.223518 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:07.223518 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:07.223518 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:07.223518 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:07.223518 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:07.223518 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:07.223518 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:07.223518 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:07.223518 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:07.223518 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:07.223518 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:30:07.223518 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:30:07.223518 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:30:07.223518 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:30:07.224432 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:30:07.224432 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:30:07.224432 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:30:07.224432 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:30:07.224432 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:07.224432 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:07.224432 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:07.224432 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:07.224432 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:07.224432 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:07.224432 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:07.224432 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:07.224432 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:07.224432 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:07.224432 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:07.224432 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:07.225235 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:07.225235 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:07.225235 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:07.225235 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:07.225235 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:30:07.225235 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:30:07.225235 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:30:07.225235 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:30:07.225235 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:30:07.225235 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:30:07.225235 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:30:07.225235 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:07.225235 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 243/485] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 5 02:30:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:30:07.257371 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf2ad7-fa11-4ea6-8bd4-ca08dbd6f510 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:07.257576 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdde17f1-bdcb-4c67-ac00-4313970b0089 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:30:07.269003 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-fdde17f1-bdcb-4c67-ac00-4313970b0089 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:30:07.269003 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:07.269003 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:07.269003 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:07.269003 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:07.269003 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:07.269003 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:07.269003 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:07.269003 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:07.269003 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:07.269003 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:07.269003 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:07.269003 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:30:07.269003 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:30:07.269003 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:30:07.269003 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:30:07.269924 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:30:07.269924 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:30:07.269924 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:30:07.269924 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:30:07.269924 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:07.269924 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:07.269924 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:07.269924 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:07.269924 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:07.269924 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:07.269924 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:07.269924 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:07.269924 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:07.269924 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:07.269924 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:07.269924 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:07.270749 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:07.270749 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:07.270749 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:07.270749 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:07.270749 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:30:07.270749 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:30:07.270749 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:30:07.270749 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:30:07.270749 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:30:07.270749 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:30:07.270749 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:30:07.270749 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:07.270749 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 243/486] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 5 02:30:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:07.284774 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde17f1-bdcb-4c67-ac00-4313970b0089 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:07.394131 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf2ad7-fa11-4ea6-8bd4-ca08dbd6f510 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:07.452600 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e18b25-3f3a-4deb-8183-1d92bf1cab19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:07.453249 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e18b25-3f3a-4deb-8183-1d92bf1cab19 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:07.453548 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e18b25-3f3a-4deb-8183-1d92bf1cab19 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:07.453829 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e18b25-3f3a-4deb-8183-1d92bf1cab19 None admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:07.454629 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e18b25-3f3a-4deb-8183-1d92bf1cab19 None admin] RBAC: Adding query filter params (name=service) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:07.455078 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e18b25-3f3a-4deb-8183-1d92bf1cab19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:07.456685 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e18b25-3f3a-4deb-8183-1d92bf1cab19 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:07.476520 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 244/487] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 5 02:30:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:07.484044 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e18b25-3f3a-4deb-8183-1d92bf1cab19 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:07.499738 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde17f1-bdcb-4c67-ac00-4313970b0089 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:07.511369 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:07.540348 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d81ef-2767-49a8-a031-297259ee5a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:07.540975 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d81ef-2767-49a8-a031-297259ee5a60 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:07.541252 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d81ef-2767-49a8-a031-297259ee5a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:07.541531 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d81ef-2767-49a8-a031-297259ee5a60 None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:07.542253 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d81ef-2767-49a8-a031-297259ee5a60 None admin] RBAC: Adding query filter params (name=service) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:07.542562 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d81ef-2767-49a8-a031-297259ee5a60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:07.543995 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d81ef-2767-49a8-a031-297259ee5a60 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:07.555074 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 244/488] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 5 02:30:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:07.559579 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fdded-5964-4731-997d-74287e70b72b None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:07.559882 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fdded-5964-4731-997d-74287e70b72b None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:07.560169 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fdded-5964-4731-997d-74287e70b72b None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:07.565704 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 245/489] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:30:07.565704 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80fdded-5964-4731-997d-74287e70b72b None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:07.584159 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:07.624838 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e18b25-3f3a-4deb-8183-1d92bf1cab19 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:07.684525 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6d2eb-1c6e-42a4-93fc-0402494b2b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:07.686818 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6d2eb-1c6e-42a4-93fc-0402494b2b85 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:07.688219 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6d2eb-1c6e-42a4-93fc-0402494b2b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:07.688748 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6d2eb-1c6e-42a4-93fc-0402494b2b85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:07.694275 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80fdded-5964-4731-997d-74287e70b72b None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:07.706770 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6d2eb-1c6e-42a4-93fc-0402494b2b85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:07.709033 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6d2eb-1c6e-42a4-93fc-0402494b2b85 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:07.732361 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-98e6d2eb-1c6e-42a4-93fc-0402494b2b85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:07.732361 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:07.732361 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:07.732361 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:07.732361 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:07.732361 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:07.732361 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:07.732361 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:07.732361 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:07.732361 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:07.732361 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:07.732361 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:07.732361 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:07.732361 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:07.732361 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:07.733249 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:07.733249 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:07.733249 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:07.733249 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:07.733249 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:07.733249 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:07.733249 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:07.733249 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:07.733249 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:07.733249 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:07.733249 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:07.733249 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:07.733249 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:07.733249 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:07.733249 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:07.733249 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:07.733249 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:07.734126 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:07.734126 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:07.734126 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:07.734126 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:07.737227 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 245/490] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:07.740754 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b935d-7389-498c-90f4-697e8fde9581 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:07.741252 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b935d-7389-498c-90f4-697e8fde9581 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:07.741427 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57e172-0aec-474c-8534-adde55318ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:07.741945 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b935d-7389-498c-90f4-697e8fde9581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:07.742340 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57e172-0aec-474c-8534-adde55318ead None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:07.742638 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57e172-0aec-474c-8534-adde55318ead None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:07.742915 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57e172-0aec-474c-8534-adde55318ead None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:07.758628 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd57e172-0aec-474c-8534-adde55318ead None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:07.760307 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd57e172-0aec-474c-8534-adde55318ead None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:07.763291 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-be9b935d-7389-498c-90f4-697e8fde9581 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:07.764721 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-be9b935d-7389-498c-90f4-697e8fde9581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:07.775144 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-bd57e172-0aec-474c-8534-adde55318ead None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:07.775144 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:07.775144 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:07.775144 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:07.775144 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:07.775144 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:07.775144 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:07.775144 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:07.775144 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:07.775144 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:07.775144 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:07.775144 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:07.775144 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:07.775144 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:07.775144 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:07.776008 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:07.776008 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:07.776008 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:07.776008 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:07.776008 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:07.776008 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:07.776008 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:07.776008 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:07.776008 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:07.776008 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:07.776008 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:07.776008 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:07.776008 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:07.776008 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:07.776008 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:07.776008 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:07.776008 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:07.776840 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:07.776840 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:07.776840 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:07.776840 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:07.777601 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 246/491] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:07.778701 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57e172-0aec-474c-8534-adde55318ead None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:07.852866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:07.863332 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:07.866423 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 246/492] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:30:07.867548 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b935d-7389-498c-90f4-697e8fde9581 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:07.896793 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57e172-0aec-474c-8534-adde55318ead None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:07.936176 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa2e0b-4aa9-4831-afa7-b21b04776055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:07.937104 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa2e0b-4aa9-4831-afa7-b21b04776055 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:07.937595 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa2e0b-4aa9-4831-afa7-b21b04776055 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:07.938044 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa2e0b-4aa9-4831-afa7-b21b04776055 None admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:07.938920 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fa2e0b-4aa9-4831-afa7-b21b04776055 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:07.939429 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fa2e0b-4aa9-4831-afa7-b21b04776055 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:07.940964 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fa2e0b-4aa9-4831-afa7-b21b04776055 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:07.953533 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 247/493] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:07.955101 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d283516-7e03-4375-8e2b-4d6b52dd4e77 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:07.955395 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d283516-7e03-4375-8e2b-4d6b52dd4e77 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:07.955658 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d283516-7e03-4375-8e2b-4d6b52dd4e77 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:07.957057 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 248/494] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:30:07.962138 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d283516-7e03-4375-8e2b-4d6b52dd4e77 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:07.994813 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b935d-7389-498c-90f4-697e8fde9581 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:08.032725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972211c-8c1d-4dc8-bf16-372ac4158ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:08.033621 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972211c-8c1d-4dc8-bf16-372ac4158ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:08.034048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972211c-8c1d-4dc8-bf16-372ac4158ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:08.034465 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972211c-8c1d-4dc8-bf16-372ac4158ad2 None admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:08.035368 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7972211c-8c1d-4dc8-bf16-372ac4158ad2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:08.035833 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7972211c-8c1d-4dc8-bf16-372ac4158ad2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:08.037927 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7972211c-8c1d-4dc8-bf16-372ac4158ad2 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:08.049670 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 247/495] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:08.050467 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972211c-8c1d-4dc8-bf16-372ac4158ad2 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:08.079380 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d283516-7e03-4375-8e2b-4d6b52dd4e77 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:08.105949 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:08.110378 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:08.117842 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b8737-fe3d-4bfd-88a8-d6f178c86a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:08.118815 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b8737-fe3d-4bfd-88a8-d6f178c86a20 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:08.118815 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b8737-fe3d-4bfd-88a8-d6f178c86a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:08.120236 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b8737-fe3d-4bfd-88a8-d6f178c86a20 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:08.132274 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754b8737-fe3d-4bfd-88a8-d6f178c86a20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:30:08.137577 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-754b8737-fe3d-4bfd-88a8-d6f178c86a20 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:30:08.137577 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:08.137577 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:08.137577 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:08.137577 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:08.137577 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:08.137577 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:08.137577 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:08.137577 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:08.137577 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:08.137577 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:08.137577 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:08.137577 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:30:08.137577 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:30:08.137577 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:30:08.137577 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:30:08.138469 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:30:08.138469 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:30:08.138469 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:30:08.138469 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:30:08.138469 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:08.138469 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:08.138469 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:08.138469 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:08.138469 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:08.138469 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:08.138469 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:08.138469 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:08.138469 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:08.138469 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:08.138469 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:08.138469 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:08.139310 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:08.139310 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:08.139310 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:08.139310 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:08.139310 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:30:08.139310 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:30:08.139310 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:30:08.139310 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:30:08.139310 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:30:08.139310 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:30:08.139310 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:30:08.139310 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:08.143300 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 249/496] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 5 02:30:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:08.144669 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327c83f-3e08-42a7-8fb7-cb0565d048d0 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:08.145011 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327c83f-3e08-42a7-8fb7-cb0565d048d0 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:08.145506 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327c83f-3e08-42a7-8fb7-cb0565d048d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:08.160829 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972211c-8c1d-4dc8-bf16-372ac4158ad2 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:08.166940 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-d327c83f-3e08-42a7-8fb7-cb0565d048d0 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:08.168169 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-d327c83f-3e08-42a7-8fb7-cb0565d048d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:08.197233 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62509a35-bc67-4e70-aca1-a1694d07dc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:08.197872 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62509a35-bc67-4e70-aca1-a1694d07dc2c None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:08.198150 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62509a35-bc67-4e70-aca1-a1694d07dc2c None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:08.198419 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62509a35-bc67-4e70-aca1-a1694d07dc2c None admin] PATH_INFO: `/v3/users/glance` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:08.206254 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62509a35-bc67-4e70-aca1-a1694d07dc2c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:08.207794 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62509a35-bc67-4e70-aca1-a1694d07dc2c None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:08.221046 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-62509a35-bc67-4e70-aca1-a1694d07dc2c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 05 02:30:08.221046 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:08.221046 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:08.221046 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:08.221046 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:08.221046 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:08.221046 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:08.221046 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:08.221046 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:08.221046 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:08.221046 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:08.221046 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:08.221046 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:30:08.221046 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:30:08.221046 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:30:08.221046 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:30:08.221964 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:08.221964 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:08.221964 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:30:08.221964 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:08.221964 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:30:08.221964 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:08.221964 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:08.221964 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:08.221964 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:08.221964 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:08.221964 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:08.221964 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:08.221964 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:08.221964 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:08.221964 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:08.221964 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:08.221964 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:08.221964 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:08.222862 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:08.222862 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:08.222862 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:30:08.222862 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:30:08.222862 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:30:08.222862 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:30:08.222862 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:30:08.222862 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:30:08.222862 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 05 02:30:08.222862 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:08.222862 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 248/497] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:30:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:08.224560 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62509a35-bc67-4e70-aca1-a1694d07dc2c None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:08.246434 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 250/498] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:30:08.247381 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327c83f-3e08-42a7-8fb7-cb0565d048d0 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:08.346649 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62509a35-bc67-4e70-aca1-a1694d07dc2c None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:08.351070 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327c83f-3e08-42a7-8fb7-cb0565d048d0 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:08.361633 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:08.364906 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:08.382236 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44431090-d5a0-4bb3-8d6b-598f3a8443ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:08.382875 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44431090-d5a0-4bb3-8d6b-598f3a8443ca None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:08.383199 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44431090-d5a0-4bb3-8d6b-598f3a8443ca None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:08.383480 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44431090-d5a0-4bb3-8d6b-598f3a8443ca None admin] PATH_INFO: `/v3/users/nova` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:08.386546 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca277b-1625-4b7a-9e2a-d7d18d8a2797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:08.387193 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca277b-1625-4b7a-9e2a-d7d18d8a2797 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:08.387477 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca277b-1625-4b7a-9e2a-d7d18d8a2797 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:08.387753 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca277b-1625-4b7a-9e2a-d7d18d8a2797 None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:08.388472 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca277b-1625-4b7a-9e2a-d7d18d8a2797 None admin] RBAC: Adding query filter params (name=service) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:08.388777 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca277b-1625-4b7a-9e2a-d7d18d8a2797 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:08.390163 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca277b-1625-4b7a-9e2a-d7d18d8a2797 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:08.391696 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44431090-d5a0-4bb3-8d6b-598f3a8443ca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:08.393149 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44431090-d5a0-4bb3-8d6b-598f3a8443ca None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:08.399058 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 251/499] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 5 02:30:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:08.399766 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca277b-1625-4b7a-9e2a-d7d18d8a2797 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:08.410502 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-44431090-d5a0-4bb3-8d6b-598f3a8443ca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 02:30:08.410502 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:08.410502 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:08.410502 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:08.410502 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:08.410502 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:08.410502 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:08.410502 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:08.410502 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:08.410502 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:08.410502 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:08.410502 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:08.410502 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:30:08.410502 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:30:08.410502 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:30:08.410502 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:30:08.415315 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:08.415315 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:08.415315 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:30:08.415315 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:08.415315 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:30:08.415315 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:08.415315 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:08.415315 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:08.415315 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:08.415315 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:08.415315 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:08.415315 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:08.415315 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:08.415315 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:08.415315 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:08.415315 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:08.415315 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:08.415315 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:08.416626 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:08.416626 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:08.416626 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:30:08.416626 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:30:08.416626 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:30:08.416626 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:30:08.416626 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:30:08.416626 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:30:08.416626 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 02:30:08.416626 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:08.416626 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 249/500] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Aug 5 02:30:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:08.416626 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44431090-d5a0-4bb3-8d6b-598f3a8443ca None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:08.509297 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca277b-1625-4b7a-9e2a-d7d18d8a2797 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:08.521652 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44431090-d5a0-4bb3-8d6b-598f3a8443ca None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:08.542004 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7bab19-47c4-438a-8c9d-4e1ed37306a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:08.542643 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7bab19-47c4-438a-8c9d-4e1ed37306a5 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:08.542923 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7bab19-47c4-438a-8c9d-4e1ed37306a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:08.543225 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7bab19-47c4-438a-8c9d-4e1ed37306a5 None admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:08.544015 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7bab19-47c4-438a-8c9d-4e1ed37306a5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:08.544319 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7bab19-47c4-438a-8c9d-4e1ed37306a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:08.545740 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7bab19-47c4-438a-8c9d-4e1ed37306a5 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:08.556381 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fccaa1-ff32-40c2-9afc-6229a0966f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:08.557077 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fccaa1-ff32-40c2-9afc-6229a0966f25 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:08.557364 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fccaa1-ff32-40c2-9afc-6229a0966f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:08.557634 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fccaa1-ff32-40c2-9afc-6229a0966f25 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:08.567997 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fccaa1-ff32-40c2-9afc-6229a0966f25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:30:08.573272 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-f7fccaa1-ff32-40c2-9afc-6229a0966f25 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:30:08.573272 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:08.573272 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:08.573272 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:08.573272 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:08.573272 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:08.573272 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:08.573272 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:08.573272 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:08.573272 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:08.573272 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:08.573272 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:08.573272 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:30:08.573272 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:30:08.573272 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:30:08.573272 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:30:08.574306 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:30:08.574306 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:30:08.574306 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:30:08.574306 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:30:08.574306 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:08.574306 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:08.574306 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:08.574306 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:08.574306 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:08.574306 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:08.574306 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:08.574306 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:08.574306 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:08.574306 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:08.574306 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:08.574306 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:08.575304 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:08.575304 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:08.575304 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:08.575304 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:08.575304 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:30:08.575304 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:30:08.575304 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:30:08.575304 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:30:08.575304 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:30:08.575304 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:30:08.575304 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:30:08.575304 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:08.575304 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 250/501] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 5 02:30:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:08.575304 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fccaa1-ff32-40c2-9afc-6229a0966f25 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:08.584770 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 252/502] 10.222.0.42 () {56 vars in 1137 bytes} [Fri Aug 5 02:30:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:08.584770 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7bab19-47c4-438a-8c9d-4e1ed37306a5 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:08.612349 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:08.614706 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:08.677507 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fccaa1-ff32-40c2-9afc-6229a0966f25 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:08.680766 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7bab19-47c4-438a-8c9d-4e1ed37306a5 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:08.711479 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a8662-2bf8-4829-ad26-9c8d5b3a5502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:08.712116 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a8662-2bf8-4829-ad26-9c8d5b3a5502 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:08.712397 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a8662-2bf8-4829-ad26-9c8d5b3a5502 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:08.712673 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a8662-2bf8-4829-ad26-9c8d5b3a5502 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:08.715289 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba11ea6-7d5b-452a-b41f-c06db30f98f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:08.715907 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba11ea6-7d5b-452a-b41f-c06db30f98f7 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:08.716191 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba11ea6-7d5b-452a-b41f-c06db30f98f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:08.716469 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba11ea6-7d5b-452a-b41f-c06db30f98f7 None admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:08.717265 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba11ea6-7d5b-452a-b41f-c06db30f98f7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:08.717574 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba11ea6-7d5b-452a-b41f-c06db30f98f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:08.719044 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba11ea6-7d5b-452a-b41f-c06db30f98f7 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:08.722535 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a8662-2bf8-4829-ad26-9c8d5b3a5502 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:08.724042 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a8662-2bf8-4829-ad26-9c8d5b3a5502 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:08.738892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-785a8662-2bf8-4829-ad26-9c8d5b3a5502 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:08.738892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:08.738892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:08.738892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:08.738892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:08.738892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:08.738892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:08.738892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:08.738892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:08.738892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:08.738892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:08.738892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:08.738892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:08.738892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:08.738892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:08.740329 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:08.740329 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:08.740329 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:08.740329 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:08.740329 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:08.740329 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:08.740329 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:08.740329 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:08.740329 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:08.740329 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:08.740329 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:08.740329 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:08.740329 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:08.740329 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:08.740329 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:08.740329 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:08.740329 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:08.741603 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:08.741603 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:08.741603 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:08.741603 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:08.741603 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 251/503] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:08.741858 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 253/504] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Aug 5 02:30:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:08.741932 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0c135-a3dc-444f-ad77-537c710aa47e None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:08.741998 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba11ea6-7d5b-452a-b41f-c06db30f98f7 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:08.742069 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0c135-a3dc-444f-ad77-537c710aa47e None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:08.742320 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0c135-a3dc-444f-ad77-537c710aa47e None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:08.743562 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 252/505] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:30:08.744243 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d0c135-a3dc-444f-ad77-537c710aa47e None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:08.836332 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:08.839194 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:08.848015 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba11ea6-7d5b-452a-b41f-c06db30f98f7 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:08.851725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d0c135-a3dc-444f-ad77-537c710aa47e None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:08.881826 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf30f3-1934-461a-8a77-885a740b94ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:08.882541 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf30f3-1934-461a-8a77-885a740b94ea None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:08.882888 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf30f3-1934-461a-8a77-885a740b94ea None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:08.883250 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf30f3-1934-461a-8a77-885a740b94ea None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:08.884060 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf30f3-1934-461a-8a77-885a740b94ea None admin] RBAC: Adding query filter params (name=service) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:08.884423 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf30f3-1934-461a-8a77-885a740b94ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:08.885861 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf30f3-1934-461a-8a77-885a740b94ea None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:08.886087 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e1fc4-db67-4b1d-be07-287b4ecbc2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:08.886707 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e1fc4-db67-4b1d-be07-287b4ecbc2e6 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:08.887017 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e1fc4-db67-4b1d-be07-287b4ecbc2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:08.887328 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e1fc4-db67-4b1d-be07-287b4ecbc2e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:08.893898 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 254/506] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 5 02:30:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:08.895092 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd131dc-3478-4d73-84ee-9712995467b9 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:08.895378 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd131dc-3478-4d73-84ee-9712995467b9 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:08.896188 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd131dc-3478-4d73-84ee-9712995467b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:08.914270 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-8dd131dc-3478-4d73-84ee-9712995467b9 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:08.915483 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-8dd131dc-3478-4d73-84ee-9712995467b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:08.956576 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e1fc4-db67-4b1d-be07-287b4ecbc2e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:08.958569 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e1fc4-db67-4b1d-be07-287b4ecbc2e6 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:08.981975 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 255/507] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:30:08.982815 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd131dc-3478-4d73-84ee-9712995467b9 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:09.052587 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:09.072390 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 253/508] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:30:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:30:09.072549 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:09.072640 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e1fc4-db67-4b1d-be07-287b4ecbc2e6 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:09.091084 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd131dc-3478-4d73-84ee-9712995467b9 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:09.123543 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12242c79-9383-4c42-8755-4d4a14c1c8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:09.124174 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12242c79-9383-4c42-8755-4d4a14c1c8b5 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:09.124816 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12242c79-9383-4c42-8755-4d4a14c1c8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:09.125081 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12242c79-9383-4c42-8755-4d4a14c1c8b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:09.167366 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e1fc4-db67-4b1d-be07-287b4ecbc2e6 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:09.191626 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12242c79-9383-4c42-8755-4d4a14c1c8b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:09.193621 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12242c79-9383-4c42-8755-4d4a14c1c8b5 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:09.201852 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263725b-c85b-42b2-975d-eb3d4c5a3cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:09.202460 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263725b-c85b-42b2-975d-eb3d4c5a3cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:09.202736 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263725b-c85b-42b2-975d-eb3d4c5a3cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:09.203038 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263725b-c85b-42b2-975d-eb3d4c5a3cd4 None admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:09.203717 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e263725b-c85b-42b2-975d-eb3d4c5a3cd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:09.204041 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e263725b-c85b-42b2-975d-eb3d4c5a3cd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:09.205430 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e263725b-c85b-42b2-975d-eb3d4c5a3cd4 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:09.217784 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 254/509] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:09.218472 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263725b-c85b-42b2-975d-eb3d4c5a3cd4 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:09.265604 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:09.281002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:09.301059 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 256/510] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:30:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:30:09.302044 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12242c79-9383-4c42-8755-4d4a14c1c8b5 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:09.321093 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263725b-c85b-42b2-975d-eb3d4c5a3cd4 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:09.353981 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac3326-190d-4ced-9400-9ef64da0a01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:09.354550 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac3326-190d-4ced-9400-9ef64da0a01e None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:09.354832 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac3326-190d-4ced-9400-9ef64da0a01e None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:09.355136 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac3326-190d-4ced-9400-9ef64da0a01e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:09.365392 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac3326-190d-4ced-9400-9ef64da0a01e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:09.366843 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac3326-190d-4ced-9400-9ef64da0a01e None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:09.381201 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-e8ac3326-190d-4ced-9400-9ef64da0a01e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:09.381201 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:09.381201 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:09.381201 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:09.381201 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:09.381201 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:09.381201 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:09.381201 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:09.381201 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:09.381201 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:09.381201 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:09.381201 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:09.381201 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:09.381201 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:09.381201 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:09.382168 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:09.382168 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:09.382168 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:09.382168 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:09.382168 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:09.382168 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:09.382168 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:09.382168 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:09.382168 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:09.382168 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:09.382168 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:09.382168 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:09.382168 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:09.382168 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:09.382168 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:09.382168 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:09.382168 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:09.383105 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:09.383105 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:09.383105 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:09.383105 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:09.383105 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 255/511] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:09.383105 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac3326-190d-4ced-9400-9ef64da0a01e None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:09.398886 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12242c79-9383-4c42-8755-4d4a14c1c8b5 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:09.432668 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa3e75-662e-4c1f-9329-6a06440afb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:09.433333 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa3e75-662e-4c1f-9329-6a06440afb0c None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:09.433616 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa3e75-662e-4c1f-9329-6a06440afb0c None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:09.433900 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa3e75-662e-4c1f-9329-6a06440afb0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:09.444844 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffa3e75-662e-4c1f-9329-6a06440afb0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:09.446284 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffa3e75-662e-4c1f-9329-6a06440afb0c None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:09.460032 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-9ffa3e75-662e-4c1f-9329-6a06440afb0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:09.460032 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:09.460032 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:09.460032 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:09.460032 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:09.460032 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:09.460032 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:09.460032 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:09.460032 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:09.460032 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:09.460032 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:09.460032 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:09.460032 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:09.460032 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:09.460032 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:09.460866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:09.460866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:09.460866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:09.460866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:09.460866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:09.460866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:09.460866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:09.460866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:09.460866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:09.460866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:09.460866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:09.460866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:09.460866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:09.460866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:09.460866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:09.460866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:09.460866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:09.461716 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:09.461716 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:09.461716 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:09.461716 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:09.461716 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 257/512] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:09.461982 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa3e75-662e-4c1f-9329-6a06440afb0c None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:09.487005 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:09.490864 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac3326-190d-4ced-9400-9ef64da0a01e None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:09.495248 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:09.525481 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c068ce5-f0fe-4ca6-afe4-30d283ccb165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:09.526129 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c068ce5-f0fe-4ca6-afe4-30d283ccb165 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:09.526412 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c068ce5-f0fe-4ca6-afe4-30d283ccb165 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:09.526690 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c068ce5-f0fe-4ca6-afe4-30d283ccb165 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:09.537356 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c068ce5-f0fe-4ca6-afe4-30d283ccb165 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:09.538832 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c068ce5-f0fe-4ca6-afe4-30d283ccb165 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:09.554099 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-9c068ce5-f0fe-4ca6-afe4-30d283ccb165 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:09.554099 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:09.554099 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:09.554099 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:09.554099 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:09.554099 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:09.554099 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:09.554099 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:09.554099 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:09.554099 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:09.554099 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:09.554099 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:09.554099 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:09.554099 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:09.554099 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:09.555030 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:09.555030 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:09.555030 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:09.555030 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:09.555030 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:09.555030 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:09.555030 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:09.555030 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:09.555030 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:09.555030 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:09.555030 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:09.555030 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:09.555030 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:09.555030 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:09.555030 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:09.555030 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:09.555030 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:09.556206 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:09.556206 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:09.556206 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:09.556206 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:09.556206 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 256/513] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:09.556596 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c068ce5-f0fe-4ca6-afe4-30d283ccb165 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:09.566188 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa3e75-662e-4c1f-9329-6a06440afb0c None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:09.599818 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6885dfa-ee86-4c5e-8b58-006c31babfed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:09.600718 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6885dfa-ee86-4c5e-8b58-006c31babfed None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:09.600994 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6885dfa-ee86-4c5e-8b58-006c31babfed None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:09.601266 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6885dfa-ee86-4c5e-8b58-006c31babfed None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:09.608505 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6885dfa-ee86-4c5e-8b58-006c31babfed None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:09.609974 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6885dfa-ee86-4c5e-8b58-006c31babfed None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:09.624401 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-f6885dfa-ee86-4c5e-8b58-006c31babfed None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 05 02:30:09.624401 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:09.624401 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:09.624401 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:09.624401 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:09.624401 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:09.624401 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:09.624401 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:09.624401 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:09.624401 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:09.624401 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:09.624401 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:09.624401 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:30:09.624401 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:30:09.624401 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:30:09.624401 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:30:09.625499 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:09.625499 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:09.625499 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:30:09.625499 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:09.625499 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:30:09.625499 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:09.625499 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:09.625499 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:09.625499 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:09.625499 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:09.625499 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:09.625499 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:09.625499 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:09.625499 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:09.625499 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:09.625499 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:09.625499 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:09.625499 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:09.626632 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:09.626632 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:09.626632 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:30:09.626632 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:30:09.626632 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:30:09.626632 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:30:09.626632 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:30:09.626632 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:30:09.626632 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 05 02:30:09.626632 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:09.627560 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 258/514] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:30:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:09.628424 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6885dfa-ee86-4c5e-8b58-006c31babfed None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:09.656070 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c068ce5-f0fe-4ca6-afe4-30d283ccb165 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:09.688771 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692fd4e9-b32e-4589-b273-46078c25b5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:09.689403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692fd4e9-b32e-4589-b273-46078c25b5a5 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:09.689686 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692fd4e9-b32e-4589-b273-46078c25b5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:09.689965 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692fd4e9-b32e-4589-b273-46078c25b5a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:09.700703 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692fd4e9-b32e-4589-b273-46078c25b5a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:09.702154 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692fd4e9-b32e-4589-b273-46078c25b5a5 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:09.715858 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-692fd4e9-b32e-4589-b273-46078c25b5a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:09.715858 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:09.715858 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:09.715858 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:09.715858 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:09.715858 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:09.715858 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:09.715858 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:09.715858 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:09.715858 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:09.715858 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:09.715858 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:09.715858 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:09.715858 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:09.715858 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:09.722145 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:09.722145 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:09.722145 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:09.722145 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:09.722145 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:09.722145 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:09.722145 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:09.722145 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:09.722145 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:09.722145 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:09.722145 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:09.722145 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:09.722145 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:09.722145 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:09.722145 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:09.722145 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:09.722145 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:09.723037 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:09.723037 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:09.723037 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:09.723037 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:09.723037 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 257/515] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:09.723037 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692fd4e9-b32e-4589-b273-46078c25b5a5 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:09.723344 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:09.725158 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:09.727651 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6885dfa-ee86-4c5e-8b58-006c31babfed None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:09.761518 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5caaa1d-fa4f-41fa-8902-edaf6bb3ee2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:09.762157 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5caaa1d-fa4f-41fa-8902-edaf6bb3ee2b None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:09.762448 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5caaa1d-fa4f-41fa-8902-edaf6bb3ee2b None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:09.762721 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5caaa1d-fa4f-41fa-8902-edaf6bb3ee2b None admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:09.763436 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5caaa1d-fa4f-41fa-8902-edaf6bb3ee2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:09.763738 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5caaa1d-fa4f-41fa-8902-edaf6bb3ee2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:09.765121 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5caaa1d-fa4f-41fa-8902-edaf6bb3ee2b None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:09.776364 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 259/516] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:09.777148 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5caaa1d-fa4f-41fa-8902-edaf6bb3ee2b None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:09.825012 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692fd4e9-b32e-4589-b273-46078c25b5a5 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:09.859398 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4dbd42-1cf3-47e2-88bb-78a94e19c6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:09.859970 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4dbd42-1cf3-47e2-88bb-78a94e19c6a5 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:09.860251 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4dbd42-1cf3-47e2-88bb-78a94e19c6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:09.860523 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4dbd42-1cf3-47e2-88bb-78a94e19c6a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:09.861208 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4dbd42-1cf3-47e2-88bb-78a94e19c6a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:09.861511 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4dbd42-1cf3-47e2-88bb-78a94e19c6a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:09.862887 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4dbd42-1cf3-47e2-88bb-78a94e19c6a5 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:09.873785 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5caaa1d-fa4f-41fa-8902-edaf6bb3ee2b None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:09.874876 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 258/517] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:09.875861 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4dbd42-1cf3-47e2-88bb-78a94e19c6a5 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:09.906212 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f8771c-0eba-4b05-8be1-0bf65cc045a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:09.906830 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8771c-0eba-4b05-8be1-0bf65cc045a8 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:09.907139 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8771c-0eba-4b05-8be1-0bf65cc045a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:09.907420 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8771c-0eba-4b05-8be1-0bf65cc045a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:09.908107 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f8771c-0eba-4b05-8be1-0bf65cc045a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:09.908414 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f8771c-0eba-4b05-8be1-0bf65cc045a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:09.909781 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f8771c-0eba-4b05-8be1-0bf65cc045a8 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:09.923002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 260/518] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:09.923784 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f8771c-0eba-4b05-8be1-0bf65cc045a8 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:09.937587 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:09.939618 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:09.976922 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4dbd42-1cf3-47e2-88bb-78a94e19c6a5 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:10.010317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490efbfc-e446-4a39-aac1-bad96f30ee67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:10.010924 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490efbfc-e446-4a39-aac1-bad96f30ee67 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:10.011238 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490efbfc-e446-4a39-aac1-bad96f30ee67 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:10.011513 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490efbfc-e446-4a39-aac1-bad96f30ee67 None admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:10.012290 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490efbfc-e446-4a39-aac1-bad96f30ee67 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:10.012593 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490efbfc-e446-4a39-aac1-bad96f30ee67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:10.014038 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490efbfc-e446-4a39-aac1-bad96f30ee67 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:10.021172 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f8771c-0eba-4b05-8be1-0bf65cc045a8 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:10.055925 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 259/519] 10.222.0.42 () {56 vars in 1137 bytes} [Fri Aug 5 02:30:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:10.056762 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490efbfc-e446-4a39-aac1-bad96f30ee67 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:10.059573 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2654f7-6fb2-4f03-83f2-277cc37cb3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:10.060389 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2654f7-6fb2-4f03-83f2-277cc37cb3bd None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:10.060782 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2654f7-6fb2-4f03-83f2-277cc37cb3bd None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:10.061127 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2654f7-6fb2-4f03-83f2-277cc37cb3bd None admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:10.061833 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2654f7-6fb2-4f03-83f2-277cc37cb3bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:10.062142 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2654f7-6fb2-4f03-83f2-277cc37cb3bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:10.063562 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2654f7-6fb2-4f03-83f2-277cc37cb3bd None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:10.075460 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 261/520] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:10.076099 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2654f7-6fb2-4f03-83f2-277cc37cb3bd None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:10.149168 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:10.158756 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490efbfc-e446-4a39-aac1-bad96f30ee67 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:10.174409 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2654f7-6fb2-4f03-83f2-277cc37cb3bd None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:10.180130 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:10.193812 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302d367-7d10-4d67-8b79-16a9d118762c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:10.194447 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302d367-7d10-4d67-8b79-16a9d118762c None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:10.194733 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302d367-7d10-4d67-8b79-16a9d118762c None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:10.195032 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302d367-7d10-4d67-8b79-16a9d118762c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:10.202318 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302d367-7d10-4d67-8b79-16a9d118762c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:10.203969 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302d367-7d10-4d67-8b79-16a9d118762c None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:10.209477 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb3ca9-7b7d-4d09-a12e-295c4256ec53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:10.210085 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb3ca9-7b7d-4d09-a12e-295c4256ec53 None admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:10.210363 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb3ca9-7b7d-4d09-a12e-295c4256ec53 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:10.210630 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb3ca9-7b7d-4d09-a12e-295c4256ec53 None admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:10.211329 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb3ca9-7b7d-4d09-a12e-295c4256ec53 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:10.212740 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb3ca9-7b7d-4d09-a12e-295c4256ec53 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:10.216308 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-8302d367-7d10-4d67-8b79-16a9d118762c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 05 02:30:10.216308 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:10.216308 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:10.216308 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:10.216308 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:10.216308 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:10.216308 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:10.216308 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:10.216308 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:10.216308 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:10.216308 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:10.216308 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:10.216308 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:30:10.216308 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:30:10.216308 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:30:10.216308 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:30:10.217347 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:10.217347 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:10.217347 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:30:10.217347 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:10.217347 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:30:10.217347 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:10.217347 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:10.217347 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:10.217347 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:10.217347 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:10.217347 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:10.217347 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:10.217347 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:10.217347 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:10.217347 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:10.217347 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:10.217347 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:10.217347 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:10.218297 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:10.218297 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:10.218297 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:30:10.218297 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:30:10.218297 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:30:10.218297 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:30:10.218297 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:30:10.218297 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:30:10.218297 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 05 02:30:10.218297 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:10.218297 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 260/521] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 5 02:30:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:10.219267 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302d367-7d10-4d67-8b79-16a9d118762c None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:10.320270 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302d367-7d10-4d67-8b79-16a9d118762c None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:10.327617 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 262/522] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 5 02:30:10 2022] POST /identity/v3/users => generated 247 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:30:10.328548 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb3ca9-7b7d-4d09-a12e-295c4256ec53 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:10.365845 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5f228-b5b2-4fc2-b5b8-a2019ce06425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:10.366689 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5f228-b5b2-4fc2-b5b8-a2019ce06425 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:10.367071 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5f228-b5b2-4fc2-b5b8-a2019ce06425 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:10.367269 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5f228-b5b2-4fc2-b5b8-a2019ce06425 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:10.381246 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc5f228-b5b2-4fc2-b5b8-a2019ce06425 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:10.383045 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc5f228-b5b2-4fc2-b5b8-a2019ce06425 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:10.399414 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-7cc5f228-b5b2-4fc2-b5b8-a2019ce06425 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:10.399414 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:10.399414 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:10.399414 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:10.399414 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:10.399414 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:10.399414 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:10.399414 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:10.399414 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:10.399414 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:10.399414 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:10.399414 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:10.399414 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:30:10.399414 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:30:10.399414 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:30:10.400317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:30:10.400317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:10.400317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:10.400317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:10.400317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:10.400317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:10.400317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:10.400317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:10.400317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:10.400317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:10.400317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:10.400317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:10.400317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:10.400317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:10.400317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:10.400317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:10.400317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:10.401178 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:30:10.401178 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:30:10.401178 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:30:10.401178 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:30:10.401178 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:30:10.401178 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:30:10.401178 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:10.401178 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:10.402373 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 261/523] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:30:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:10.403597 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5f228-b5b2-4fc2-b5b8-a2019ce06425 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:10.459406 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:10.490927 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb3ca9-7b7d-4d09-a12e-295c4256ec53 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:10.528183 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:10.537021 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936f02c-7b1f-4f36-b516-8588558b914c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:10.538983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936f02c-7b1f-4f36-b516-8588558b914c None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:10.538983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936f02c-7b1f-4f36-b516-8588558b914c None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:10.538983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936f02c-7b1f-4f36-b516-8588558b914c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:10.540716 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5f228-b5b2-4fc2-b5b8-a2019ce06425 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:10.577557 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24549e3-e01e-4c79-af31-40667d7343ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:10.578312 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24549e3-e01e-4c79-af31-40667d7343ff None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:10.578596 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24549e3-e01e-4c79-af31-40667d7343ff None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:10.578868 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24549e3-e01e-4c79-af31-40667d7343ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:10.587863 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24549e3-e01e-4c79-af31-40667d7343ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:10.589656 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24549e3-e01e-4c79-af31-40667d7343ff None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:10.601818 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-f24549e3-e01e-4c79-af31-40667d7343ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:10.601818 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:10.601818 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:10.601818 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:10.601818 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:10.601818 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:10.601818 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:10.601818 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:10.601818 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:10.601818 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:10.601818 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:10.601818 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:10.601818 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:30:10.601818 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:30:10.601818 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:30:10.602870 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:30:10.602870 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:10.602870 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:10.602870 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:10.602870 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:10.602870 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:10.602870 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:10.602870 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:10.602870 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:10.602870 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:10.602870 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:10.602870 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:10.602870 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:10.602870 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:10.602870 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:10.602870 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:10.602870 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:10.603893 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:30:10.603893 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:30:10.603893 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:30:10.603893 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:30:10.603893 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:30:10.603893 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:30:10.603893 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:10.603893 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:10.603893 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 262/524] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:30:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:10.604362 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24549e3-e01e-4c79-af31-40667d7343ff None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:10.620591 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0936f02c-7b1f-4f36-b516-8588558b914c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:10.622453 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0936f02c-7b1f-4f36-b516-8588558b914c None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:10.714799 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:10.718420 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24549e3-e01e-4c79-af31-40667d7343ff None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:10.742607 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 263/525] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:30:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:30:10.742607 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936f02c-7b1f-4f36-b516-8588558b914c None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:10.760827 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae0718-fc5b-491a-9a09-bea48e7e7b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:10.761671 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae0718-fc5b-491a-9a09-bea48e7e7b82 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:10.762098 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae0718-fc5b-491a-9a09-bea48e7e7b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:10.762543 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae0718-fc5b-491a-9a09-bea48e7e7b82 None admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:10.763498 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae0718-fc5b-491a-9a09-bea48e7e7b82 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:10.763946 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae0718-fc5b-491a-9a09-bea48e7e7b82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:10.765543 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae0718-fc5b-491a-9a09-bea48e7e7b82 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:10.780008 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:10.789024 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 263/526] 10.222.0.42 () {56 vars in 1139 bytes} [Fri Aug 5 02:30:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:10.789024 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae0718-fc5b-491a-9a09-bea48e7e7b82 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:10.861898 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936f02c-7b1f-4f36-b516-8588558b914c None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:10.897716 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28221a-d4e2-438e-b5fa-377982ecd66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:10.898337 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28221a-d4e2-438e-b5fa-377982ecd66e None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:10.898621 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28221a-d4e2-438e-b5fa-377982ecd66e None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:10.898897 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28221a-d4e2-438e-b5fa-377982ecd66e None admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:10.899167 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae0718-fc5b-491a-9a09-bea48e7e7b82 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:10.899686 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da28221a-d4e2-438e-b5fa-377982ecd66e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:10.899994 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da28221a-d4e2-438e-b5fa-377982ecd66e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:10.901617 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da28221a-d4e2-438e-b5fa-377982ecd66e None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:10.921182 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 264/527] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 5 02:30:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:10.922020 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28221a-d4e2-438e-b5fa-377982ecd66e None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:10.940235 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63d844-835e-4fe1-b07a-02a24a5c2c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:10.940878 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63d844-835e-4fe1-b07a-02a24a5c2c27 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:10.941156 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63d844-835e-4fe1-b07a-02a24a5c2c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:10.941427 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63d844-835e-4fe1-b07a-02a24a5c2c27 None admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:10.942163 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d63d844-835e-4fe1-b07a-02a24a5c2c27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:10.943098 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d63d844-835e-4fe1-b07a-02a24a5c2c27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:10.944534 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d63d844-835e-4fe1-b07a-02a24a5c2c27 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:10.962937 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 264/528] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 5 02:30:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:10.967938 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63d844-835e-4fe1-b07a-02a24a5c2c27 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:10.987070 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:11.024128 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:11.037214 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28221a-d4e2-438e-b5fa-377982ecd66e None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:11.073868 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88301d7-f390-41cb-8704-2c5baeaf9795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:11.074511 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88301d7-f390-41cb-8704-2c5baeaf9795 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:11.074798 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88301d7-f390-41cb-8704-2c5baeaf9795 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:11.075115 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88301d7-f390-41cb-8704-2c5baeaf9795 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:11.080832 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63d844-835e-4fe1-b07a-02a24a5c2c27 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:11.085938 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88301d7-f390-41cb-8704-2c5baeaf9795 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:11.087456 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88301d7-f390-41cb-8704-2c5baeaf9795 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:11.102608 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-e88301d7-f390-41cb-8704-2c5baeaf9795 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:11.102608 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:11.102608 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:11.102608 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:11.102608 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:11.102608 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:11.102608 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:11.102608 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:11.102608 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:11.102608 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:11.102608 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:11.102608 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:11.102608 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:11.102608 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:11.102608 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:11.103526 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:11.103526 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:11.103526 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:11.103526 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:11.103526 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:11.103526 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:11.103526 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:11.103526 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:11.103526 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:11.103526 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:11.103526 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:11.103526 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:11.103526 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:11.103526 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:11.103526 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:11.103526 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:11.103526 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:11.104374 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:11.104374 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:11.104374 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:11.104374 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:11.104374 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 265/529] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:11.104655 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88301d7-f390-41cb-8704-2c5baeaf9795 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:11.126378 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f72bf-3512-4041-9506-3fa43b469a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:11.127044 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f72bf-3512-4041-9506-3fa43b469a7b None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:11.127365 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f72bf-3512-4041-9506-3fa43b469a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:11.127645 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f72bf-3512-4041-9506-3fa43b469a7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:11.198888 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11f72bf-3512-4041-9506-3fa43b469a7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:11.200386 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11f72bf-3512-4041-9506-3fa43b469a7b None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:11.209211 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88301d7-f390-41cb-8704-2c5baeaf9795 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:11.218302 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:11.250397 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26561fd-412c-4abb-aedf-eaa5ca3f3937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:11.251039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26561fd-412c-4abb-aedf-eaa5ca3f3937 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:11.251320 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26561fd-412c-4abb-aedf-eaa5ca3f3937 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:11.251592 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26561fd-412c-4abb-aedf-eaa5ca3f3937 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:11.252374 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26561fd-412c-4abb-aedf-eaa5ca3f3937 None admin] RBAC: Adding query filter params (role.id=2642213efc7d4861b3d3b4f5fbc9ad73, scope.project.id=63b323c02a614fc28aac6e7a060064ba, user.id=116f66d7dd7b42878f71bd29dc55729c) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:11.252682 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26561fd-412c-4abb-aedf-eaa5ca3f3937 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:11.254124 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26561fd-412c-4abb-aedf-eaa5ca3f3937 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:11.260685 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 266/530] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:30:11 2022] GET /identity/v3/role_assignments?user.id=116f66d7dd7b42878f71bd29dc55729c&scope.project.id=63b323c02a614fc28aac6e7a060064ba&role.id=2642213efc7d4861b3d3b4f5fbc9ad73 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:11.261268 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26561fd-412c-4abb-aedf-eaa5ca3f3937 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:11.281437 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:11.327055 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 265/531] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:30:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:30:11.328421 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f72bf-3512-4041-9506-3fa43b469a7b None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:11.412972 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26561fd-412c-4abb-aedf-eaa5ca3f3937 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:11.453000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6825c04-967c-4554-b890-72abfa403613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:11.453629 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6825c04-967c-4554-b890-72abfa403613 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:11.453912 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6825c04-967c-4554-b890-72abfa403613 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:11.454186 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6825c04-967c-4554-b890-72abfa403613 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:11.456790 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6825c04-967c-4554-b890-72abfa403613 None admin] RBAC: Adding query filter params (role.id=2642213efc7d4861b3d3b4f5fbc9ad73, scope.project.id=63b323c02a614fc28aac6e7a060064ba, user.id=55374d3bccd541c9a8f82da9b21c2fb8) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:11.457135 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6825c04-967c-4554-b890-72abfa403613 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:11.459312 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6825c04-967c-4554-b890-72abfa403613 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:11.471396 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 267/532] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:30:11 2022] GET /identity/v3/role_assignments?user.id=55374d3bccd541c9a8f82da9b21c2fb8&scope.project.id=63b323c02a614fc28aac6e7a060064ba&role.id=2642213efc7d4861b3d3b4f5fbc9ad73 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:11.472369 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6825c04-967c-4554-b890-72abfa403613 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:11.477201 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f72bf-3512-4041-9506-3fa43b469a7b None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:11.499503 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:11.523252 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a930af-a55f-444f-b0a0-2dcbd4851068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:11.523887 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a930af-a55f-444f-b0a0-2dcbd4851068 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:11.524648 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a930af-a55f-444f-b0a0-2dcbd4851068 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:11.524934 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a930af-a55f-444f-b0a0-2dcbd4851068 None admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:11.525646 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a930af-a55f-444f-b0a0-2dcbd4851068 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:11.525955 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a930af-a55f-444f-b0a0-2dcbd4851068 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:11.527431 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a930af-a55f-444f-b0a0-2dcbd4851068 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:11.541921 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 266/533] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:11.549130 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a930af-a55f-444f-b0a0-2dcbd4851068 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:11.650247 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:11.706994 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6825c04-967c-4554-b890-72abfa403613 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:11.759960 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550eb78b-d77a-4ef3-8aa4-f381594416a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:11.760596 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550eb78b-d77a-4ef3-8aa4-f381594416a2 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:11.760871 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550eb78b-d77a-4ef3-8aa4-f381594416a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:11.761145 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550eb78b-d77a-4ef3-8aa4-f381594416a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:11.761419 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a930af-a55f-444f-b0a0-2dcbd4851068 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:11.773229 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550eb78b-d77a-4ef3-8aa4-f381594416a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:11.774791 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550eb78b-d77a-4ef3-8aa4-f381594416a2 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:11.792612 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-550eb78b-d77a-4ef3-8aa4-f381594416a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:11.792612 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:11.792612 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:11.792612 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:11.792612 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:11.792612 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:11.792612 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:11.792612 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:11.792612 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:11.792612 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:11.792612 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:11.792612 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:11.792612 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:11.792612 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:11.792612 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:11.793695 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:11.793695 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:11.793695 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:11.793695 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:11.793695 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:11.793695 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:11.793695 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:11.793695 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:11.793695 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:11.793695 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:11.793695 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:11.793695 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:11.793695 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:11.793695 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:11.793695 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:11.793695 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:11.793695 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:11.794753 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:11.794753 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:11.794753 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:11.794753 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:11.797344 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 268/534] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:11.803578 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550eb78b-d77a-4ef3-8aa4-f381594416a2 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:11.894878 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60bb6e-5819-4202-b3d9-66f1b26fffb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:11.895838 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60bb6e-5819-4202-b3d9-66f1b26fffb2 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:11.896295 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60bb6e-5819-4202-b3d9-66f1b26fffb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:11.896740 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60bb6e-5819-4202-b3d9-66f1b26fffb2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:11.920032 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550eb78b-d77a-4ef3-8aa4-f381594416a2 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:11.928294 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b60bb6e-5819-4202-b3d9-66f1b26fffb2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:11.931046 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b60bb6e-5819-4202-b3d9-66f1b26fffb2 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:11.954526 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:11.963793 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb0a0f-a5cd-48b0-9f21-277d2db51c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:11.964430 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb0a0f-a5cd-48b0-9f21-277d2db51c1a None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:11.964709 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb0a0f-a5cd-48b0-9f21-277d2db51c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:11.964982 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb0a0f-a5cd-48b0-9f21-277d2db51c1a None admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:11.967583 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb0a0f-a5cd-48b0-9f21-277d2db51c1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:11.967583 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb0a0f-a5cd-48b0-9f21-277d2db51c1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:11.967583 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb0a0f-a5cd-48b0-9f21-277d2db51c1a None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:11.973560 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-0b60bb6e-5819-4202-b3d9-66f1b26fffb2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:11.973560 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:11.973560 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:11.973560 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:11.973560 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:11.973560 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:11.973560 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:11.973560 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:11.973560 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:11.973560 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:11.973560 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:11.973560 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:11.973560 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:30:11.973560 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:30:11.973560 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:30:11.974407 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:30:11.974407 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:11.974407 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:11.974407 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:11.974407 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:11.974407 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:11.974407 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:11.974407 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:11.974407 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:11.974407 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:11.974407 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:11.974407 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:11.974407 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:11.974407 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:11.974407 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:11.974407 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:11.974407 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:11.975622 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:30:11.975622 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:30:11.975622 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:30:11.975622 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:30:11.975622 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:30:11.975622 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:30:11.975622 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:11.975622 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:11.983122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 267/535] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:30:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 430 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:11.991305 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 269/536] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:11.992675 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60bb6e-5819-4202-b3d9-66f1b26fffb2 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:12.000156 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb0a0f-a5cd-48b0-9f21-277d2db51c1a None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:12.083848 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:12.212910 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60bb6e-5819-4202-b3d9-66f1b26fffb2 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:12.216883 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb0a0f-a5cd-48b0-9f21-277d2db51c1a None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:12.290523 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8870c0b-e190-4af9-be0a-86833bec2d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:12.291857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33614da4-5e53-4163-a0a5-d1bd601b2420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:12.292472 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33614da4-5e53-4163-a0a5-d1bd601b2420 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:12.292748 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33614da4-5e53-4163-a0a5-d1bd601b2420 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:12.293020 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33614da4-5e53-4163-a0a5-d1bd601b2420 None admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:12.293768 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33614da4-5e53-4163-a0a5-d1bd601b2420 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:12.294073 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33614da4-5e53-4163-a0a5-d1bd601b2420 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:12.295302 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8870c0b-e190-4af9-be0a-86833bec2d2e None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:12.295583 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8870c0b-e190-4af9-be0a-86833bec2d2e None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:12.295854 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8870c0b-e190-4af9-be0a-86833bec2d2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:12.297183 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33614da4-5e53-4163-a0a5-d1bd601b2420 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:12.311505 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8870c0b-e190-4af9-be0a-86833bec2d2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:12.312946 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8870c0b-e190-4af9-be0a-86833bec2d2e None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:12.331139 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 268/537] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 5 02:30:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:12.336882 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-b8870c0b-e190-4af9-be0a-86833bec2d2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:12.336882 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:12.336882 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:12.336882 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:12.336882 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:12.336882 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:12.336882 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:12.336882 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:12.336882 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:12.336882 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:12.336882 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:12.336882 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:12.336882 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:30:12.336882 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:30:12.336882 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:30:12.337768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:30:12.337768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:12.337768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:12.337768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:12.337768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:12.337768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:12.337768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:12.337768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:12.337768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:12.337768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:12.337768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:12.337768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:12.337768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:12.337768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:12.337768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:12.337768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:12.337768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:12.338608 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:30:12.338608 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:30:12.338608 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:30:12.338608 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:30:12.338608 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:30:12.338608 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:30:12.338608 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:12.338608 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:12.339942 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33614da4-5e53-4163-a0a5-d1bd601b2420 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:12.343353 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 270/538] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:30:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:30:12.345826 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8870c0b-e190-4af9-be0a-86833bec2d2e None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:12.403304 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:12.477297 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8870c0b-e190-4af9-be0a-86833bec2d2e None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:12.518982 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b720f-9774-4254-91cb-3f0ec03046cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:12.518982 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b720f-9774-4254-91cb-3f0ec03046cb None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:12.518982 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b720f-9774-4254-91cb-3f0ec03046cb None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:12.518982 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b720f-9774-4254-91cb-3f0ec03046cb None admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:12.519386 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b720f-9774-4254-91cb-3f0ec03046cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:12.522975 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b720f-9774-4254-91cb-3f0ec03046cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:12.522975 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b720f-9774-4254-91cb-3f0ec03046cb None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:12.537845 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 271/539] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 5 02:30:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:12.540972 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa701a6b-d53a-4f63-80a1-d7f3693ecdb0 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:12.541458 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa701a6b-d53a-4f63-80a1-d7f3693ecdb0 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:12.541951 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa701a6b-d53a-4f63-80a1-d7f3693ecdb0 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:12.545334 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 272/540] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:30:12.546311 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa701a6b-d53a-4f63-80a1-d7f3693ecdb0 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:12.625658 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:12.634371 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33614da4-5e53-4163-a0a5-d1bd601b2420 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:12.711891 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19203e-c3b4-4fe8-b2fb-b853801dd00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:12.713036 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19203e-c3b4-4fe8-b2fb-b853801dd00b None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:12.713546 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19203e-c3b4-4fe8-b2fb-b853801dd00b None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:12.714194 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19203e-c3b4-4fe8-b2fb-b853801dd00b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:12.715567 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a19203e-c3b4-4fe8-b2fb-b853801dd00b None admin] RBAC: Adding query filter params (role.id=2642213efc7d4861b3d3b4f5fbc9ad73, scope.project.id=63b323c02a614fc28aac6e7a060064ba, user.id=e60a3568771842e294858e5868068f84) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:12.716083 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a19203e-c3b4-4fe8-b2fb-b853801dd00b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:12.717726 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a19203e-c3b4-4fe8-b2fb-b853801dd00b None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:12.734900 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 269/541] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:30:12 2022] GET /identity/v3/role_assignments?user.id=e60a3568771842e294858e5868068f84&scope.project.id=63b323c02a614fc28aac6e7a060064ba&role.id=2642213efc7d4861b3d3b4f5fbc9ad73 => generated 259 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:30:12.739285 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19161c8b-0d62-47df-842a-b56ff5a74732 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:12.740011 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19161c8b-0d62-47df-842a-b56ff5a74732 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:12.740610 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19161c8b-0d62-47df-842a-b56ff5a74732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:12.799846 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-19161c8b-0d62-47df-842a-b56ff5a74732 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:12.804564 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-19161c8b-0d62-47df-842a-b56ff5a74732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:12.884243 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa701a6b-d53a-4f63-80a1-d7f3693ecdb0 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:12.886693 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:12.987236 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab7797-7778-4675-bd77-d6159a8509f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:12.989253 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab7797-7778-4675-bd77-d6159a8509f4 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:12.990222 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab7797-7778-4675-bd77-d6159a8509f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:12.990736 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab7797-7778-4675-bd77-d6159a8509f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:12.991818 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ab7797-7778-4675-bd77-d6159a8509f4 None admin] RBAC: Adding query filter params (role.id=2642213efc7d4861b3d3b4f5fbc9ad73, scope.project.id=63b323c02a614fc28aac6e7a060064ba, user.id=a0035fcd8b06400bb7946f7ac37393a8) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:12.994113 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ab7797-7778-4675-bd77-d6159a8509f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:12.996129 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ab7797-7778-4675-bd77-d6159a8509f4 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:13.009572 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 273/542] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:30:12 2022] GET /identity/v3/role_assignments?user.id=a0035fcd8b06400bb7946f7ac37393a8&scope.project.id=63b323c02a614fc28aac6e7a060064ba&role.id=2642213efc7d4861b3d3b4f5fbc9ad73 => generated 259 bytes in 464 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:13.076627 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 270/543] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:30:13.120410 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab7797-7778-4675-bd77-d6159a8509f4 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:13.388386 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab7797-7778-4675-bd77-d6159a8509f4 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:13.481059 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d9723-5035-4c1b-b54f-457703349c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:13.481059 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d9723-5035-4c1b-b54f-457703349c5d None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:13.481059 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d9723-5035-4c1b-b54f-457703349c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:13.481059 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d9723-5035-4c1b-b54f-457703349c5d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:13.498539 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5d9723-5035-4c1b-b54f-457703349c5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:30:13.509279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-8c5d9723-5035-4c1b-b54f-457703349c5d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:30:13.509279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:13.509279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:13.509279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:13.509279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:13.509279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:13.509279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:13.509279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:13.509279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:13.509279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:13.509279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:13.509279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:13.509279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:30:13.509279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:30:13.509279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:30:13.509279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:30:13.510187 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:30:13.510187 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:30:13.510187 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:30:13.510187 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:30:13.510187 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:13.510187 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:13.510187 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:13.510187 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:13.510187 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:13.510187 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:13.510187 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:13.510187 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:13.510187 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:13.510187 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:13.510187 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:13.510187 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:13.511011 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:13.511011 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:13.511011 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:13.511011 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:13.511011 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:30:13.511011 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:30:13.511011 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:30:13.511011 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:30:13.511011 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:30:13.511011 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:30:13.511011 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:30:13.511011 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:13.511011 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 274/544] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 5 02:30:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:13.518122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19161c8b-0d62-47df-842a-b56ff5a74732 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:13.794723 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53115c5-3fac-481c-8c84-a111a8ba1608 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:13.795399 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53115c5-3fac-481c-8c84-a111a8ba1608 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:13.795906 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53115c5-3fac-481c-8c84-a111a8ba1608 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:13.797692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 275/545] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:30:13.802925 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748c8ce-2995-42a8-ac95-af7e39d76fe5 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:13.803617 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748c8ce-2995-42a8-ac95-af7e39d76fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:13.804943 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748c8ce-2995-42a8-ac95-af7e39d76fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:13.825990 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-7748c8ce-2995-42a8-ac95-af7e39d76fe5 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:13.827690 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-7748c8ce-2995-42a8-ac95-af7e39d76fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:13.841493 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:13.852685 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:13.861251 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19161c8b-0d62-47df-842a-b56ff5a74732 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:13.909665 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 276/546] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:30:13.934274 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748c8ce-2995-42a8-ac95-af7e39d76fe5 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:13.957666 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6bc35-d1ce-496a-954c-4403e322b387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:13.958346 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6bc35-d1ce-496a-954c-4403e322b387 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:13.958629 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6bc35-d1ce-496a-954c-4403e322b387 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:13.958907 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6bc35-d1ce-496a-954c-4403e322b387 None admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:13.959735 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6bc35-d1ce-496a-954c-4403e322b387 None admin] RBAC: Adding query filter params (name=service) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:13.960044 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6bc35-d1ce-496a-954c-4403e322b387 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:13.961427 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6bc35-d1ce-496a-954c-4403e322b387 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:13.986116 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 271/547] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 5 02:30:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 468 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:13.988754 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5394f-696b-4ff7-ba5f-d73591870072 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:13.989586 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5394f-696b-4ff7-ba5f-d73591870072 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:13.989888 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5394f-696b-4ff7-ba5f-d73591870072 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:13.991768 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 272/548] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:30:13.992475 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5394f-696b-4ff7-ba5f-d73591870072 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:14.052201 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748c8ce-2995-42a8-ac95-af7e39d76fe5 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:14.105793 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebbc341-adaa-4623-8856-ffcbd06c6b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:14.106790 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbc341-adaa-4623-8856-ffcbd06c6b2e None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:14.107607 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbc341-adaa-4623-8856-ffcbd06c6b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:14.108105 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbc341-adaa-4623-8856-ffcbd06c6b2e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:14.113256 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5394f-696b-4ff7-ba5f-d73591870072 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:14.123487 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebbc341-adaa-4623-8856-ffcbd06c6b2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:30:14.137284 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-4ebbc341-adaa-4623-8856-ffcbd06c6b2e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:30:14.137284 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:14.137284 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:14.137284 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:14.137284 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:14.137284 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:14.137284 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:14.137284 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:14.137284 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:14.137284 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:14.137284 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:14.137284 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:14.137284 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:30:14.137284 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:30:14.137284 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:30:14.137284 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:30:14.138225 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:30:14.138225 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:30:14.138225 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:30:14.138225 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:30:14.138225 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:14.138225 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:14.138225 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:14.138225 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:14.138225 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:14.138225 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:14.138225 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:14.138225 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:14.138225 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:14.138225 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:14.138225 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:14.138225 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:14.139036 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:14.139036 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:14.139036 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:14.139036 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:14.139036 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:30:14.139036 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:30:14.139036 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:30:14.139036 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:30:14.139036 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:30:14.139036 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:30:14.139036 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:30:14.139036 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:14.150401 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 277/549] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 5 02:30:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:30:14.156091 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45080b-acdd-4df6-9361-f0216b4da7de None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:14.157294 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45080b-acdd-4df6-9361-f0216b4da7de None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:14.163631 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45080b-acdd-4df6-9361-f0216b4da7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:14.163751 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a11d5-a511-4b4c-9578-462c99fbf348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:14.164554 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a11d5-a511-4b4c-9578-462c99fbf348 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:14.165095 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a11d5-a511-4b4c-9578-462c99fbf348 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:14.165535 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a11d5-a511-4b4c-9578-462c99fbf348 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:14.196807 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a11d5-a511-4b4c-9578-462c99fbf348 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:14.197646 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a11d5-a511-4b4c-9578-462c99fbf348 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:14.229564 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-914a11d5-a511-4b4c-9578-462c99fbf348 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:14.229564 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:14.229564 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:14.229564 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:14.229564 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:14.229564 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:14.229564 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:14.229564 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:14.229564 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:14.229564 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:14.229564 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:14.229564 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:14.229564 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:14.229564 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:14.229564 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:14.230481 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:14.230481 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:14.230481 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:14.230481 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:14.230481 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:14.230481 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:14.230481 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:14.230481 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:14.230481 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:14.230481 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:14.230481 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:14.230481 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:14.230481 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:14.230481 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:14.230481 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:14.230481 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:14.230481 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:14.231372 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:14.231372 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:14.231372 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:14.231372 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:14.232823 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-bd45080b-acdd-4df6-9361-f0216b4da7de None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:14.234239 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-bd45080b-acdd-4df6-9361-f0216b4da7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:14.235268 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 273/550] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:14.237308 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a11d5-a511-4b4c-9578-462c99fbf348 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:14.264104 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:14.289815 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:14.443604 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 278/551] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:30:14.445931 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45080b-acdd-4df6-9361-f0216b4da7de None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:14.619603 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a11d5-a511-4b4c-9578-462c99fbf348 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:14.748484 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5473fd-c8d9-4c4c-8ef3-593ed3a8890d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:14.749121 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5473fd-c8d9-4c4c-8ef3-593ed3a8890d None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:14.749397 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5473fd-c8d9-4c4c-8ef3-593ed3a8890d None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:14.749751 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5473fd-c8d9-4c4c-8ef3-593ed3a8890d None admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:14.750382 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5473fd-c8d9-4c4c-8ef3-593ed3a8890d None admin] RBAC: Adding query filter params (name=service) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:14.750683 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5473fd-c8d9-4c4c-8ef3-593ed3a8890d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:14.752249 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5473fd-c8d9-4c4c-8ef3-593ed3a8890d None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:14.766469 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 274/552] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 5 02:30:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 526 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:14.766469 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5473fd-c8d9-4c4c-8ef3-593ed3a8890d None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:14.777506 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45080b-acdd-4df6-9361-f0216b4da7de None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:14.814040 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858720d2-6a02-4164-a47c-b20a70febbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:14.815051 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858720d2-6a02-4164-a47c-b20a70febbf6 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:14.815537 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858720d2-6a02-4164-a47c-b20a70febbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:14.816093 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858720d2-6a02-4164-a47c-b20a70febbf6 None admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:14.817793 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858720d2-6a02-4164-a47c-b20a70febbf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:14.818311 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858720d2-6a02-4164-a47c-b20a70febbf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:14.819943 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858720d2-6a02-4164-a47c-b20a70febbf6 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:14.832430 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 279/553] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:14.833664 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858720d2-6a02-4164-a47c-b20a70febbf6 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:14.839341 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:14.850185 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:14.882154 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5473fd-c8d9-4c4c-8ef3-593ed3a8890d None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:14.920188 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e75a35-ad70-499f-aca7-ce198c4a0316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:14.921057 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e75a35-ad70-499f-aca7-ce198c4a0316 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:14.921284 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e75a35-ad70-499f-aca7-ce198c4a0316 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:14.921525 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e75a35-ad70-499f-aca7-ce198c4a0316 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:14.933382 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e75a35-ad70-499f-aca7-ce198c4a0316 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:30:14.939425 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-26e75a35-ad70-499f-aca7-ce198c4a0316 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:30:14.939425 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:14.939425 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:14.939425 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:14.939425 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:14.939425 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:14.939425 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:14.939425 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:14.939425 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:14.939425 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:14.939425 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:14.939425 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:14.939425 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:30:14.939425 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:30:14.939425 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:30:14.939425 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:30:14.940343 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:30:14.940343 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:30:14.940343 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:30:14.940343 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:30:14.940343 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:14.940343 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:14.940343 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:14.940343 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:14.940343 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:14.940343 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:14.940343 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:14.940343 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:14.940343 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:14.940343 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:14.940343 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:14.940343 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:14.941172 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:14.941172 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:14.941172 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:14.941172 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:14.941172 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:30:14.941172 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:30:14.941172 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:30:14.941172 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:30:14.941172 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:30:14.941172 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:30:14.941172 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:30:14.941172 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:14.946025 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 275/554] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 5 02:30:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:14.947008 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e75a35-ad70-499f-aca7-ce198c4a0316 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:14.948898 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858720d2-6a02-4164-a47c-b20a70febbf6 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:14.988669 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cedc75-8d52-48a4-b27d-88ae3b3364f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:14.990225 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cedc75-8d52-48a4-b27d-88ae3b3364f7 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:14.990795 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cedc75-8d52-48a4-b27d-88ae3b3364f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:14.991368 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cedc75-8d52-48a4-b27d-88ae3b3364f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:15.003637 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cedc75-8d52-48a4-b27d-88ae3b3364f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:15.006062 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cedc75-8d52-48a4-b27d-88ae3b3364f7 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:15.021216 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-59cedc75-8d52-48a4-b27d-88ae3b3364f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:15.021216 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:15.021216 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:15.021216 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:15.021216 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:15.021216 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:15.021216 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:15.021216 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:15.021216 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:15.021216 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:15.021216 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:15.021216 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:15.021216 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:15.021216 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:15.021216 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:15.022151 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:15.022151 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:15.022151 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:15.022151 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:15.022151 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:15.022151 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:15.022151 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:15.022151 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:15.022151 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:15.022151 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:15.022151 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:15.022151 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:15.022151 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:15.022151 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:15.022151 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:15.022151 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:15.022151 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:15.023051 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:15.023051 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:15.023051 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:15.023051 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:15.025192 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 280/555] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:15.030620 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cedc75-8d52-48a4-b27d-88ae3b3364f7 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:15.064674 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e75a35-ad70-499f-aca7-ce198c4a0316 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:15.091768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:15.102054 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:15.110510 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d4ad7-7600-45c7-8555-8d478dbee1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:15.111215 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d4ad7-7600-45c7-8555-8d478dbee1f7 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:15.111548 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d4ad7-7600-45c7-8555-8d478dbee1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:15.111820 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d4ad7-7600-45c7-8555-8d478dbee1f7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:15.121670 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d4ad7-7600-45c7-8555-8d478dbee1f7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:15.123531 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d4ad7-7600-45c7-8555-8d478dbee1f7 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:15.135618 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-fd8d4ad7-7600-45c7-8555-8d478dbee1f7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 05 02:30:15.135618 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:15.135618 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:15.135618 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:15.135618 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:15.135618 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:15.135618 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:15.135618 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:15.135618 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:15.135618 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:15.135618 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:15.135618 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:15.135618 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:30:15.135618 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:30:15.135618 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:30:15.135618 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:30:15.136623 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:15.136623 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:15.136623 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:30:15.136623 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:15.136623 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:30:15.136623 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:15.136623 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:15.136623 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:15.136623 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:15.136623 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:15.136623 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:15.136623 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:15.136623 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:15.136623 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:15.136623 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:15.136623 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:15.136623 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:15.136623 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:15.137947 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:15.137947 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:15.137947 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:30:15.137947 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:30:15.137947 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:30:15.137947 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:30:15.137947 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:30:15.137947 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:30:15.137947 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 05 02:30:15.137947 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:15.137947 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 276/556] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 5 02:30:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:15.137947 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d4ad7-7600-45c7-8555-8d478dbee1f7 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:15.143570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cedc75-8d52-48a4-b27d-88ae3b3364f7 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:15.178714 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d725e-af14-4a35-96da-0673cf6f1719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:15.179367 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d725e-af14-4a35-96da-0673cf6f1719 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:15.179719 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d725e-af14-4a35-96da-0673cf6f1719 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:15.179923 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d725e-af14-4a35-96da-0673cf6f1719 None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:15.180644 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d725e-af14-4a35-96da-0673cf6f1719 None admin] RBAC: Adding query filter params (name=service) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:15.180949 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d725e-af14-4a35-96da-0673cf6f1719 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:15.182321 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d725e-af14-4a35-96da-0673cf6f1719 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:15.192891 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 281/557] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 5 02:30:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:15.194108 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac42844-9cb7-4dec-856f-119945282896 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:15.194396 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac42844-9cb7-4dec-856f-119945282896 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:15.194671 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac42844-9cb7-4dec-856f-119945282896 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:15.199015 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 282/558] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:30:15.199015 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac42844-9cb7-4dec-856f-119945282896 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:15.253247 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d4ad7-7600-45c7-8555-8d478dbee1f7 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:15.298716 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d14f4-80ae-42da-ae2e-01ced75b3fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:15.298716 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d14f4-80ae-42da-ae2e-01ced75b3fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:15.298716 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d14f4-80ae-42da-ae2e-01ced75b3fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:15.298716 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d14f4-80ae-42da-ae2e-01ced75b3fe6 None admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:15.299163 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d14f4-80ae-42da-ae2e-01ced75b3fe6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:15.299456 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d14f4-80ae-42da-ae2e-01ced75b3fe6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:15.300835 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d14f4-80ae-42da-ae2e-01ced75b3fe6 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:15.313341 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 277/559] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:15.315015 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d14f4-80ae-42da-ae2e-01ced75b3fe6 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:15.345652 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac42844-9cb7-4dec-856f-119945282896 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:15.365726 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:15.366775 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:15.378735 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf741a7-c3d3-433c-b29e-244aab71d718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:15.379392 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf741a7-c3d3-433c-b29e-244aab71d718 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:15.379701 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf741a7-c3d3-433c-b29e-244aab71d718 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:15.379979 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf741a7-c3d3-433c-b29e-244aab71d718 None admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:15.380773 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf741a7-c3d3-433c-b29e-244aab71d718 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:15.381086 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf741a7-c3d3-433c-b29e-244aab71d718 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:15.382530 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf741a7-c3d3-433c-b29e-244aab71d718 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:15.400009 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 283/560] 10.222.0.42 () {56 vars in 1135 bytes} [Fri Aug 5 02:30:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:15.401540 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92503c1-b5a4-4385-9d94-1e5bd2e90473 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:15.402089 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92503c1-b5a4-4385-9d94-1e5bd2e90473 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:15.402372 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92503c1-b5a4-4385-9d94-1e5bd2e90473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:15.415799 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d14f4-80ae-42da-ae2e-01ced75b3fe6 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:15.420954 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-c92503c1-b5a4-4385-9d94-1e5bd2e90473 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:15.422145 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-c92503c1-b5a4-4385-9d94-1e5bd2e90473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:15.451146 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e593a7-c550-44fa-b2c4-2e43a835e292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:15.451889 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e593a7-c550-44fa-b2c4-2e43a835e292 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:15.452172 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e593a7-c550-44fa-b2c4-2e43a835e292 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:15.452436 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e593a7-c550-44fa-b2c4-2e43a835e292 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:15.462682 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e593a7-c550-44fa-b2c4-2e43a835e292 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:15.464294 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e593a7-c550-44fa-b2c4-2e43a835e292 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:15.479487 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-f2e593a7-c550-44fa-b2c4-2e43a835e292 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:15.479487 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:15.479487 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:15.479487 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:15.479487 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:15.479487 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:15.479487 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:15.479487 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:15.479487 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:15.479487 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:15.479487 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:15.479487 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:15.479487 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:15.479487 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:15.479487 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:15.480547 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:15.480547 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:15.480547 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:15.480547 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:15.480547 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:15.480547 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:15.480547 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:15.480547 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:15.480547 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:15.480547 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:15.480547 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:15.480547 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:15.480547 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:15.480547 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:15.480547 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:15.480547 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:15.480547 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:15.481474 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:15.481474 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:15.481474 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:15.481474 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:15.481474 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 278/561] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:15.482062 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb85cf4-7c58-4948-aaeb-b88ad3df2099 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:15.482349 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb85cf4-7c58-4948-aaeb-b88ad3df2099 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:15.482622 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb85cf4-7c58-4948-aaeb-b88ad3df2099 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:15.483890 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 279/562] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:30:15.484582 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb85cf4-7c58-4948-aaeb-b88ad3df2099 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:15.492291 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 284/563] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:30:15.493121 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92503c1-b5a4-4385-9d94-1e5bd2e90473 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:15.580614 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:15.584705 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb85cf4-7c58-4948-aaeb-b88ad3df2099 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:15.596810 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92503c1-b5a4-4385-9d94-1e5bd2e90473 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:15.606676 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:15.619809 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1237c1e-6d02-4c6c-ac15-9e92c493b2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:15.620568 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1237c1e-6d02-4c6c-ac15-9e92c493b2cd None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:15.620849 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1237c1e-6d02-4c6c-ac15-9e92c493b2cd None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:15.621123 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1237c1e-6d02-4c6c-ac15-9e92c493b2cd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:15.628534 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1237c1e-6d02-4c6c-ac15-9e92c493b2cd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:15.630099 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1237c1e-6d02-4c6c-ac15-9e92c493b2cd None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:15.632156 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e2feb0-8010-4231-bd2d-a06a4570a87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:15.632775 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2feb0-8010-4231-bd2d-a06a4570a87a None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:15.633055 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2feb0-8010-4231-bd2d-a06a4570a87a None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:15.633326 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2feb0-8010-4231-bd2d-a06a4570a87a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:15.641379 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-a1237c1e-6d02-4c6c-ac15-9e92c493b2cd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 02:30:15.641379 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:15.641379 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:15.641379 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:15.641379 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:15.641379 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:15.641379 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:15.641379 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:15.641379 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:15.641379 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:15.641379 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:15.641379 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:15.641379 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:30:15.641379 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:30:15.641379 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:30:15.641379 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:30:15.642509 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:15.642509 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:15.642509 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:30:15.642509 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:15.642509 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:30:15.642509 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:15.642509 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:15.642509 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:15.642509 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:15.642509 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:15.642509 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:15.642509 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:15.642509 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:15.642509 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:15.642509 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:15.642509 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:15.642509 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:15.642509 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:15.643547 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:15.643547 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:15.643547 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:30:15.643547 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:30:15.643547 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:30:15.643547 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:30:15.643547 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:30:15.643547 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:30:15.643547 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 02:30:15.643547 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:15.643547 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 280/564] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Aug 5 02:30:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:15.644143 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1237c1e-6d02-4c6c-ac15-9e92c493b2cd None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:15.704291 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e2feb0-8010-4231-bd2d-a06a4570a87a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:15.705756 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e2feb0-8010-4231-bd2d-a06a4570a87a None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:15.746611 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1237c1e-6d02-4c6c-ac15-9e92c493b2cd None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:15.778811 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeae6e0-f8bd-4308-b072-c07cccea7aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:15.779455 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeae6e0-f8bd-4308-b072-c07cccea7aee None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:15.779732 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeae6e0-f8bd-4308-b072-c07cccea7aee None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:15.780003 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeae6e0-f8bd-4308-b072-c07cccea7aee None admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:15.780677 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeae6e0-f8bd-4308-b072-c07cccea7aee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:15.780977 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeae6e0-f8bd-4308-b072-c07cccea7aee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:15.782333 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeae6e0-f8bd-4308-b072-c07cccea7aee None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:15.794639 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 281/565] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:15.795795 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c39798e-7a4f-48c8-abcf-756e5171fe7a None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:15.796081 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c39798e-7a4f-48c8-abcf-756e5171fe7a None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:15.796352 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c39798e-7a4f-48c8-abcf-756e5171fe7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:15.807698 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 285/566] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:30:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:30:15.808738 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e2feb0-8010-4231-bd2d-a06a4570a87a None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:15.818285 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-2c39798e-7a4f-48c8-abcf-756e5171fe7a None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:15.818945 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:15.819504 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-2c39798e-7a4f-48c8-abcf-756e5171fe7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:15.836217 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:15.888221 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 282/567] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:30:15.889039 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c39798e-7a4f-48c8-abcf-756e5171fe7a None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:15.909068 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e2feb0-8010-4231-bd2d-a06a4570a87a None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:15.942853 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c824f31-79dd-41d6-8a41-e74389755656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:15.943531 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c824f31-79dd-41d6-8a41-e74389755656 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:15.943816 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c824f31-79dd-41d6-8a41-e74389755656 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:15.944092 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c824f31-79dd-41d6-8a41-e74389755656 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:15.954299 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c824f31-79dd-41d6-8a41-e74389755656 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:30:15.959753 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-7c824f31-79dd-41d6-8a41-e74389755656 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:30:15.959753 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:15.959753 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:15.959753 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:15.959753 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:15.959753 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:15.959753 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:15.959753 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:15.959753 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:15.959753 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:15.959753 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:15.959753 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:15.959753 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:30:15.959753 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:30:15.959753 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:30:15.959753 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:30:15.960866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:30:15.960866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:30:15.960866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:30:15.960866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:30:15.960866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:15.960866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:15.960866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:15.960866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:15.960866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:15.960866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:15.960866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:15.960866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:15.960866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:15.960866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:15.960866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:15.960866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:15.961888 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:15.961888 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:15.961888 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:15.961888 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:15.961888 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:30:15.961888 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:30:15.961888 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:30:15.961888 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:30:15.961888 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:30:15.961888 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:30:15.961888 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:30:15.961888 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:15.961888 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 286/568] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 5 02:30:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:15.962621 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c824f31-79dd-41d6-8a41-e74389755656 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:15.992497 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c39798e-7a4f-48c8-abcf-756e5171fe7a None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:16.026609 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989dc0df-3b5c-4a77-8318-73d763b5dc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:16.027253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989dc0df-3b5c-4a77-8318-73d763b5dc91 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:16.027536 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989dc0df-3b5c-4a77-8318-73d763b5dc91 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:16.027813 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989dc0df-3b5c-4a77-8318-73d763b5dc91 None admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:16.028593 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989dc0df-3b5c-4a77-8318-73d763b5dc91 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:16.029155 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:16.029264 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989dc0df-3b5c-4a77-8318-73d763b5dc91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:16.030346 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989dc0df-3b5c-4a77-8318-73d763b5dc91 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:16.047932 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 283/569] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Aug 5 02:30:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:16.048747 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989dc0df-3b5c-4a77-8318-73d763b5dc91 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:16.060781 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:16.064510 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c824f31-79dd-41d6-8a41-e74389755656 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:16.099267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527f195-e036-43bb-8eec-ce7bd7415f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:16.099839 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527f195-e036-43bb-8eec-ce7bd7415f3c None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:16.100123 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527f195-e036-43bb-8eec-ce7bd7415f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:16.100651 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527f195-e036-43bb-8eec-ce7bd7415f3c None admin] PATH_INFO: `/v3/users/glance` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:16.107516 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9527f195-e036-43bb-8eec-ce7bd7415f3c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:16.108958 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9527f195-e036-43bb-8eec-ce7bd7415f3c None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:16.120331 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-9527f195-e036-43bb-8eec-ce7bd7415f3c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 05 02:30:16.120331 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:16.120331 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:16.120331 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:16.120331 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:16.120331 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:16.120331 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:16.120331 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:16.120331 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:16.120331 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:16.120331 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:16.120331 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:16.120331 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:30:16.120331 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:30:16.120331 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:30:16.120331 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:30:16.121383 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:16.121383 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:16.121383 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:30:16.121383 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:16.121383 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:30:16.121383 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:16.121383 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:16.121383 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:16.121383 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:16.121383 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:16.121383 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:16.121383 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:16.121383 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:16.121383 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:16.121383 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:16.121383 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:16.121383 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:16.121383 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:16.122732 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:16.122732 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:16.122732 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:30:16.122732 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:30:16.122732 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:30:16.122732 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:30:16.122732 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:30:16.122732 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:30:16.122732 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 05 02:30:16.122732 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:16.122732 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 287/570] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:30:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:16.122732 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527f195-e036-43bb-8eec-ce7bd7415f3c None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:16.150779 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989dc0df-3b5c-4a77-8318-73d763b5dc91 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:16.184714 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb53d9-f42a-415c-803f-72f0ea71e80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:16.185340 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb53d9-f42a-415c-803f-72f0ea71e80c None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:16.185621 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb53d9-f42a-415c-803f-72f0ea71e80c None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:16.185907 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb53d9-f42a-415c-803f-72f0ea71e80c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:16.196334 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdb53d9-f42a-415c-803f-72f0ea71e80c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:16.197782 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdb53d9-f42a-415c-803f-72f0ea71e80c None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:16.212174 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-fbdb53d9-f42a-415c-803f-72f0ea71e80c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:16.212174 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:16.212174 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:16.212174 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:16.212174 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:16.212174 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:16.212174 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:16.212174 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:16.212174 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:16.212174 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:16.212174 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:16.212174 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:16.212174 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:16.212174 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:16.212174 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:16.213176 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:16.213176 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:16.213176 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:16.213176 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:16.213176 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:16.213176 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:16.213176 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:16.213176 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:16.213176 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:16.213176 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:16.213176 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:16.213176 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:16.213176 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:16.213176 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:16.213176 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:16.213176 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:16.213176 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:16.214046 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:16.214046 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:16.214046 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:16.214046 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:16.214046 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 284/571] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:16.214400 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb53d9-f42a-415c-803f-72f0ea71e80c None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:16.244999 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527f195-e036-43bb-8eec-ce7bd7415f3c None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:16.272909 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:16.273362 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:16.279233 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7bf7ff-3038-49f0-90e3-8816ef33068f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:16.279885 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bf7ff-3038-49f0-90e3-8816ef33068f None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:16.280170 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bf7ff-3038-49f0-90e3-8816ef33068f None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:16.280447 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bf7ff-3038-49f0-90e3-8816ef33068f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:16.290932 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7bf7ff-3038-49f0-90e3-8816ef33068f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:30:16.295937 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-2d7bf7ff-3038-49f0-90e3-8816ef33068f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:30:16.295937 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:16.295937 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:16.295937 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:16.295937 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:16.295937 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:16.295937 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:16.295937 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:16.295937 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:16.295937 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:16.295937 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:16.295937 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:16.295937 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:30:16.295937 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:30:16.295937 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:30:16.295937 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:30:16.296891 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:30:16.296891 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:30:16.296891 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:30:16.296891 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:30:16.296891 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:16.296891 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:16.296891 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:16.296891 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:16.296891 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:16.296891 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:16.296891 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:16.296891 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:16.296891 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:16.296891 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:16.296891 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:16.296891 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:16.297722 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:16.297722 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:16.297722 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:16.297722 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:16.297722 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:30:16.297722 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:30:16.297722 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:30:16.297722 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:30:16.297722 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:30:16.297722 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:30:16.297722 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:30:16.297722 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:16.297722 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 288/572] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 5 02:30:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:16.298412 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7bf7ff-3038-49f0-90e3-8816ef33068f None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:16.322874 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb53d9-f42a-415c-803f-72f0ea71e80c None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:16.355604 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577a886-0b82-4755-8403-6a0d04198a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:16.356157 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577a886-0b82-4755-8403-6a0d04198a85 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:16.356444 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577a886-0b82-4755-8403-6a0d04198a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:16.356723 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577a886-0b82-4755-8403-6a0d04198a85 None admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:16.357468 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577a886-0b82-4755-8403-6a0d04198a85 None admin] RBAC: Adding query filter params (name=service) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:16.357775 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577a886-0b82-4755-8403-6a0d04198a85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:16.359185 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577a886-0b82-4755-8403-6a0d04198a85 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:16.368796 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 285/573] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 5 02:30:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:16.369611 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577a886-0b82-4755-8403-6a0d04198a85 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:16.402150 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7bf7ff-3038-49f0-90e3-8816ef33068f None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:16.434283 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75be8a8-c6b5-4bef-8712-c2ddc42254be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:16.434911 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75be8a8-c6b5-4bef-8712-c2ddc42254be None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:16.435224 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75be8a8-c6b5-4bef-8712-c2ddc42254be None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:16.435499 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75be8a8-c6b5-4bef-8712-c2ddc42254be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:16.446156 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75be8a8-c6b5-4bef-8712-c2ddc42254be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:16.447620 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75be8a8-c6b5-4bef-8712-c2ddc42254be None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:16.461251 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-c75be8a8-c6b5-4bef-8712-c2ddc42254be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:16.461251 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:16.461251 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:16.461251 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:16.461251 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:16.461251 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:16.461251 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:16.461251 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:16.461251 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:16.461251 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:16.461251 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:16.461251 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:16.461251 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:16.461251 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:16.461251 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:16.462280 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:16.462280 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:16.462280 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:16.462280 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:16.462280 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:16.462280 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:16.462280 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:16.462280 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:16.462280 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:16.462280 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:16.462280 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:16.462280 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:16.462280 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:16.462280 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:16.462280 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:16.462280 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:16.462280 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:16.463303 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:16.463303 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:16.463303 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:16.463303 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:16.463303 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 289/574] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:16.463658 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75be8a8-c6b5-4bef-8712-c2ddc42254be None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:16.474133 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577a886-0b82-4755-8403-6a0d04198a85 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:16.497813 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:16.503232 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:16.508794 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6750e35-f491-4230-9451-ef737d150316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:16.513930 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6750e35-f491-4230-9451-ef737d150316 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:16.513930 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6750e35-f491-4230-9451-ef737d150316 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:16.513930 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6750e35-f491-4230-9451-ef737d150316 None admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:16.513930 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6750e35-f491-4230-9451-ef737d150316 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:16.513930 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6750e35-f491-4230-9451-ef737d150316 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:16.513930 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6750e35-f491-4230-9451-ef737d150316 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:16.529318 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 286/575] 10.222.0.42 () {56 vars in 1137 bytes} [Fri Aug 5 02:30:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:16.530343 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6750e35-f491-4230-9451-ef737d150316 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:16.564027 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75be8a8-c6b5-4bef-8712-c2ddc42254be None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:16.597807 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4f513-3e7f-4656-9e4c-6a11e0f57f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:16.599003 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4f513-3e7f-4656-9e4c-6a11e0f57f7c None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:16.599263 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4f513-3e7f-4656-9e4c-6a11e0f57f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:16.599543 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4f513-3e7f-4656-9e4c-6a11e0f57f7c None admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:16.600488 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e4f513-3e7f-4656-9e4c-6a11e0f57f7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:16.600803 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e4f513-3e7f-4656-9e4c-6a11e0f57f7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:16.602178 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e4f513-3e7f-4656-9e4c-6a11e0f57f7c None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:16.613856 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 290/576] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:16.615196 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4f513-3e7f-4656-9e4c-6a11e0f57f7c None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:16.641327 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6750e35-f491-4230-9451-ef737d150316 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:16.676492 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47bf2b-ed39-4bea-9ca7-a48dafbc1284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:16.677598 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47bf2b-ed39-4bea-9ca7-a48dafbc1284 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:16.677891 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47bf2b-ed39-4bea-9ca7-a48dafbc1284 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:16.678145 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47bf2b-ed39-4bea-9ca7-a48dafbc1284 None admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:16.679262 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb47bf2b-ed39-4bea-9ca7-a48dafbc1284 None admin] RBAC: Adding query filter params (name=service) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:16.679601 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb47bf2b-ed39-4bea-9ca7-a48dafbc1284 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:16.680988 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb47bf2b-ed39-4bea-9ca7-a48dafbc1284 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:16.689784 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 287/577] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 5 02:30:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:16.690600 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47bf2b-ed39-4bea-9ca7-a48dafbc1284 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:16.717536 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:16.720498 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4f513-3e7f-4656-9e4c-6a11e0f57f7c None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:16.734635 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:16.755309 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45cd82-1b75-4900-ac6f-221e14b9c9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:16.755941 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45cd82-1b75-4900-ac6f-221e14b9c9ed None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:16.756305 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45cd82-1b75-4900-ac6f-221e14b9c9ed None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:16.756587 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45cd82-1b75-4900-ac6f-221e14b9c9ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:16.766401 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d45cd82-1b75-4900-ac6f-221e14b9c9ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:16.767889 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d45cd82-1b75-4900-ac6f-221e14b9c9ed None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:16.781991 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-7d45cd82-1b75-4900-ac6f-221e14b9c9ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:16.781991 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:16.781991 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:16.781991 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:16.781991 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:16.781991 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:16.781991 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:16.781991 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:16.781991 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:16.781991 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:16.781991 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:16.781991 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:16.781991 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:16.781991 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:16.781991 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:16.783060 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:16.783060 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:16.783060 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:16.783060 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:16.783060 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:16.783060 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:16.783060 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:16.783060 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:16.783060 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:16.783060 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:16.783060 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:16.783060 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:16.783060 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:16.783060 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:16.783060 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:16.783060 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:16.783060 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:16.783959 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:16.783959 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:16.783959 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:16.783959 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:16.783959 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 291/578] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:16.783959 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45cd82-1b75-4900-ac6f-221e14b9c9ed None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:16.795201 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47bf2b-ed39-4bea-9ca7-a48dafbc1284 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:16.828442 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb27134-d415-4de8-bfd6-b7a865b25bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:16.829051 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb27134-d415-4de8-bfd6-b7a865b25bea None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:16.829329 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb27134-d415-4de8-bfd6-b7a865b25bea None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:16.829602 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb27134-d415-4de8-bfd6-b7a865b25bea None admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:16.830281 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb27134-d415-4de8-bfd6-b7a865b25bea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:16.830578 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb27134-d415-4de8-bfd6-b7a865b25bea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:16.831995 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb27134-d415-4de8-bfd6-b7a865b25bea None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:16.843629 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 288/579] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:16.844587 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb27134-d415-4de8-bfd6-b7a865b25bea None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:16.882938 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45cd82-1b75-4900-ac6f-221e14b9c9ed None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:16.917535 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a74bb-2d44-4978-8895-2c3226c1d11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:16.918173 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a74bb-2d44-4978-8895-2c3226c1d11a None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:16.918459 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a74bb-2d44-4978-8895-2c3226c1d11a None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:16.918737 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a74bb-2d44-4978-8895-2c3226c1d11a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:16.929735 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a74bb-2d44-4978-8895-2c3226c1d11a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:16.931213 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a74bb-2d44-4978-8895-2c3226c1d11a None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:16.944946 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-074a74bb-2d44-4978-8895-2c3226c1d11a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:16.944946 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:16.944946 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:16.944946 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:16.944946 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:16.944946 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:16.944946 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:16.944946 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:16.944946 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:16.944946 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:16.944946 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:16.944946 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:16.944946 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:16.944946 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:16.944946 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:16.945997 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:16.945997 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:16.945997 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:16.945997 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:16.945997 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:16.945997 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:16.945997 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:16.945997 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:16.945997 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:16.945997 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:16.945997 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:16.945997 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:16.945997 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:16.945997 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:16.945997 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:16.945997 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:16.945997 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:16.947414 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:16.947414 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:16.947414 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:16.947414 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:16.947637 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb27134-d415-4de8-bfd6-b7a865b25bea None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:16.948046 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 292/580] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:16.948046 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a74bb-2d44-4978-8895-2c3226c1d11a None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:16.948281 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:16.953700 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:16.981244 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50275007-e01d-424e-8454-5035ccc7204c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:16.981884 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50275007-e01d-424e-8454-5035ccc7204c None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:16.982168 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50275007-e01d-424e-8454-5035ccc7204c None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:16.982442 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50275007-e01d-424e-8454-5035ccc7204c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:16.989535 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50275007-e01d-424e-8454-5035ccc7204c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:16.990998 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50275007-e01d-424e-8454-5035ccc7204c None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:17.002175 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-50275007-e01d-424e-8454-5035ccc7204c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:17.002175 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:17.002175 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:17.002175 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:17.002175 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:17.002175 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:17.002175 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:17.002175 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:17.002175 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:17.002175 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:17.002175 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:17.002175 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:17.002175 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:30:17.002175 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:30:17.002175 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:30:17.003114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:30:17.003114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:17.003114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:17.003114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:17.003114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:17.003114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:17.003114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:17.003114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:17.003114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:17.003114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:17.003114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:17.003114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:17.003114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:17.003114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:17.003114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:17.003114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:17.003114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:17.004043 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:30:17.004043 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:30:17.004043 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:30:17.004043 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:30:17.004043 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:30:17.004043 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:30:17.004043 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:17.004043 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:17.004043 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 289/581] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:30:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:17.004632 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50275007-e01d-424e-8454-5035ccc7204c None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:17.052039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a74bb-2d44-4978-8895-2c3226c1d11a None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:17.084746 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd5d89-2d9a-4be7-b51d-c7edce16c1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:17.085385 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd5d89-2d9a-4be7-b51d-c7edce16c1b7 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:17.085666 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd5d89-2d9a-4be7-b51d-c7edce16c1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:17.085954 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd5d89-2d9a-4be7-b51d-c7edce16c1b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:17.096120 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd5d89-2d9a-4be7-b51d-c7edce16c1b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:17.097563 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd5d89-2d9a-4be7-b51d-c7edce16c1b7 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:17.103814 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50275007-e01d-424e-8454-5035ccc7204c None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:17.112110 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-63fd5d89-2d9a-4be7-b51d-c7edce16c1b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:17.112110 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:17.112110 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:17.112110 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:17.112110 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:17.112110 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:17.112110 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:17.112110 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:17.112110 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:17.112110 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:17.112110 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:17.112110 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:17.112110 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:17.112110 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:17.112110 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:17.112983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:17.112983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:17.112983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:17.112983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:17.112983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:17.112983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:17.112983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:17.112983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:17.112983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:17.112983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:17.112983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:17.112983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:17.112983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:17.112983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:17.112983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:17.112983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:17.112983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:17.113900 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:17.113900 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:17.113900 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:17.113900 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:17.113900 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 293/582] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:17.114188 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd5d89-2d9a-4be7-b51d-c7edce16c1b7 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:17.140236 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af01527-e46b-4cb9-ab1d-bb191e0599d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:17.140789 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af01527-e46b-4cb9-ab1d-bb191e0599d9 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:17.141071 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af01527-e46b-4cb9-ab1d-bb191e0599d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:17.141347 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af01527-e46b-4cb9-ab1d-bb191e0599d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:17.142032 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af01527-e46b-4cb9-ab1d-bb191e0599d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:17.142335 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af01527-e46b-4cb9-ab1d-bb191e0599d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:17.143731 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af01527-e46b-4cb9-ab1d-bb191e0599d9 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:17.155213 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 290/583] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:17.156054 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af01527-e46b-4cb9-ab1d-bb191e0599d9 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:17.168984 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:17.181308 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:17.211941 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd5d89-2d9a-4be7-b51d-c7edce16c1b7 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:17.245725 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b767f4c9-6d54-452a-9b4a-e4c173641371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:17.246372 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767f4c9-6d54-452a-9b4a-e4c173641371 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:17.246658 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767f4c9-6d54-452a-9b4a-e4c173641371 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:17.246935 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767f4c9-6d54-452a-9b4a-e4c173641371 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:17.255119 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b767f4c9-6d54-452a-9b4a-e4c173641371 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:17.256575 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b767f4c9-6d54-452a-9b4a-e4c173641371 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:17.267591 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-b767f4c9-6d54-452a-9b4a-e4c173641371 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:17.267591 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:17.267591 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:17.267591 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:17.267591 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:17.267591 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:17.267591 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:17.267591 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:17.267591 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:17.267591 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:17.267591 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:17.267591 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:17.267591 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:30:17.267591 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:30:17.267591 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:30:17.268446 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:30:17.268446 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:17.268446 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:17.268446 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:17.268446 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:17.268446 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:17.268446 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:17.268446 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:17.268446 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:17.268446 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:17.268446 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:17.268446 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:17.268446 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:17.268446 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:17.268446 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:17.268446 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:17.268446 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:17.269313 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:30:17.269313 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:30:17.269313 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:30:17.269313 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:30:17.269313 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:30:17.269313 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:30:17.269313 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:17.269313 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:17.269313 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 294/584] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:30:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:17.269957 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b767f4c9-6d54-452a-9b4a-e4c173641371 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:17.275585 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af01527-e46b-4cb9-ab1d-bb191e0599d9 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:17.309609 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c651a-8037-422d-aa58-a6a2243481dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:17.310313 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c651a-8037-422d-aa58-a6a2243481dd None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:17.310665 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c651a-8037-422d-aa58-a6a2243481dd None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:17.311048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c651a-8037-422d-aa58-a6a2243481dd None admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:17.311804 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73c651a-8037-422d-aa58-a6a2243481dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:17.312178 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73c651a-8037-422d-aa58-a6a2243481dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:17.313637 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73c651a-8037-422d-aa58-a6a2243481dd None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:17.325700 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 291/585] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:17.326688 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c651a-8037-422d-aa58-a6a2243481dd None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:17.371075 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b767f4c9-6d54-452a-9b4a-e4c173641371 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:17.387411 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:17.405291 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9775ca-16d9-4650-9b77-2bcde7995132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:17.405817 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:17.405948 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9775ca-16d9-4650-9b77-2bcde7995132 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:17.406261 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9775ca-16d9-4650-9b77-2bcde7995132 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:17.406601 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9775ca-16d9-4650-9b77-2bcde7995132 None admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:17.407463 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9775ca-16d9-4650-9b77-2bcde7995132 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:17.407831 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9775ca-16d9-4650-9b77-2bcde7995132 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:17.409328 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9775ca-16d9-4650-9b77-2bcde7995132 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:17.421240 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 295/586] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 5 02:30:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:17.422022 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9775ca-16d9-4650-9b77-2bcde7995132 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:17.423554 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c651a-8037-422d-aa58-a6a2243481dd None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:17.459567 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2df343-bcc0-482f-8d27-fabefdbf5279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:17.460187 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2df343-bcc0-482f-8d27-fabefdbf5279 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:17.460467 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2df343-bcc0-482f-8d27-fabefdbf5279 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:17.460739 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2df343-bcc0-482f-8d27-fabefdbf5279 None admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:17.461419 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2df343-bcc0-482f-8d27-fabefdbf5279 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:17.461722 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2df343-bcc0-482f-8d27-fabefdbf5279 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:17.463108 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2df343-bcc0-482f-8d27-fabefdbf5279 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:17.474283 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 292/587] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:17.475085 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2df343-bcc0-482f-8d27-fabefdbf5279 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:17.524995 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9775ca-16d9-4650-9b77-2bcde7995132 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:17.558916 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2513c5a-b90b-4915-894d-40c1d9fe6e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:17.559585 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2513c5a-b90b-4915-894d-40c1d9fe6e37 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:17.559868 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2513c5a-b90b-4915-894d-40c1d9fe6e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:17.560142 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2513c5a-b90b-4915-894d-40c1d9fe6e37 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:17.567451 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2513c5a-b90b-4915-894d-40c1d9fe6e37 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:17.569201 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2513c5a-b90b-4915-894d-40c1d9fe6e37 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:17.574755 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2df343-bcc0-482f-8d27-fabefdbf5279 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:17.580175 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-c2513c5a-b90b-4915-894d-40c1d9fe6e37 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 05 02:30:17.580175 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:17.580175 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:17.580175 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:17.580175 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:17.580175 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:17.580175 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:17.580175 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:17.580175 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:17.580175 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:17.580175 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:17.580175 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:17.580175 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:30:17.580175 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:30:17.580175 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:30:17.580175 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:30:17.581270 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:17.581270 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:17.581270 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:30:17.581270 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:17.581270 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:30:17.581270 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:17.581270 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:17.581270 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:17.581270 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:17.581270 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:17.581270 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:17.581270 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:17.581270 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:17.581270 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:17.581270 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:17.581270 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:17.581270 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:17.581270 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:17.582490 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:17.582490 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:17.582490 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:30:17.582490 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:30:17.582490 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:30:17.582490 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:30:17.582490 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:30:17.582490 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:30:17.582490 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 05 02:30:17.582490 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:17.586637 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 296/588] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:30:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:17.587408 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2513c5a-b90b-4915-894d-40c1d9fe6e37 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:17.608228 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b4c5a-913d-4c0f-88b4-1ca397815ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:17.608830 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b4c5a-913d-4c0f-88b4-1ca397815ecf None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:17.609111 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b4c5a-913d-4c0f-88b4-1ca397815ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:17.609380 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b4c5a-913d-4c0f-88b4-1ca397815ecf None admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:17.610106 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b4c5a-913d-4c0f-88b4-1ca397815ecf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:17.610410 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b4c5a-913d-4c0f-88b4-1ca397815ecf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:17.611882 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b4c5a-913d-4c0f-88b4-1ca397815ecf None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:17.621613 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:17.623311 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 293/589] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 5 02:30:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:17.624079 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b4c5a-913d-4c0f-88b4-1ca397815ecf None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:17.626461 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:17.687458 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2513c5a-b90b-4915-894d-40c1d9fe6e37 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:17.720442 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9816b7-a0fd-4d75-ac4e-701a8640a462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:17.721084 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9816b7-a0fd-4d75-ac4e-701a8640a462 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:17.721184 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b4c5a-913d-4c0f-88b4-1ca397815ecf None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:17.721368 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9816b7-a0fd-4d75-ac4e-701a8640a462 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:17.721643 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9816b7-a0fd-4d75-ac4e-701a8640a462 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:17.728761 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9816b7-a0fd-4d75-ac4e-701a8640a462 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:17.730234 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9816b7-a0fd-4d75-ac4e-701a8640a462 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:17.741925 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-cc9816b7-a0fd-4d75-ac4e-701a8640a462 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:17.741925 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:17.741925 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:17.741925 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:17.741925 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:17.741925 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:17.741925 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:17.741925 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:17.741925 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:17.741925 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:17.741925 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:17.741925 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:17.741925 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:30:17.741925 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:30:17.741925 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:30:17.743039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:30:17.743039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:17.743039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:17.743039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:17.743039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:17.743039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:17.743039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:17.743039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:17.743039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:17.743039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:17.743039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:17.743039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:17.743039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:17.743039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:17.743039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:17.743039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:17.743039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:17.744146 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:30:17.744146 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:30:17.744146 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:30:17.744146 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:30:17.744146 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:30:17.744146 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:30:17.744146 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:17.744146 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:17.744146 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 297/590] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:30:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:17.744146 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9816b7-a0fd-4d75-ac4e-701a8640a462 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:17.761864 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6352eb42-d6bb-49ac-9d0c-e98a9f9f6e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:17.762504 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352eb42-d6bb-49ac-9d0c-e98a9f9f6e35 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:17.762780 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352eb42-d6bb-49ac-9d0c-e98a9f9f6e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:17.763089 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352eb42-d6bb-49ac-9d0c-e98a9f9f6e35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:17.763864 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6352eb42-d6bb-49ac-9d0c-e98a9f9f6e35 None admin] RBAC: Adding query filter params (role.id=2642213efc7d4861b3d3b4f5fbc9ad73, scope.project.id=63b323c02a614fc28aac6e7a060064ba, user.id=40f706f1eb2b4137afd367cb5060ced0) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:17.764167 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6352eb42-d6bb-49ac-9d0c-e98a9f9f6e35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:17.765692 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6352eb42-d6bb-49ac-9d0c-e98a9f9f6e35 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:17.770936 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 294/591] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:30:17 2022] GET /identity/v3/role_assignments?user.id=40f706f1eb2b4137afd367cb5060ced0&scope.project.id=63b323c02a614fc28aac6e7a060064ba&role.id=2642213efc7d4861b3d3b4f5fbc9ad73 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:17.771712 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6352eb42-d6bb-49ac-9d0c-e98a9f9f6e35 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:17.846899 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:17.848894 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:17.855568 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9816b7-a0fd-4d75-ac4e-701a8640a462 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:17.887199 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6352eb42-d6bb-49ac-9d0c-e98a9f9f6e35 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:17.890804 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ab3c8-4ad2-4bfc-8aa0-f0e1a9638c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:17.891508 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ab3c8-4ad2-4bfc-8aa0-f0e1a9638c8b None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:17.891790 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ab3c8-4ad2-4bfc-8aa0-f0e1a9638c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:17.892066 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ab3c8-4ad2-4bfc-8aa0-f0e1a9638c8b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:17.900510 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513ab3c8-4ad2-4bfc-8aa0-f0e1a9638c8b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:17.901979 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513ab3c8-4ad2-4bfc-8aa0-f0e1a9638c8b None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:17.914020 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-513ab3c8-4ad2-4bfc-8aa0-f0e1a9638c8b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 05 02:30:17.914020 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:17.914020 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:17.914020 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:17.914020 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:17.914020 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:17.914020 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:17.914020 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:17.914020 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:17.914020 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:17.914020 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:17.914020 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:17.914020 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:30:17.914020 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:30:17.914020 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:30:17.914020 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:30:17.915058 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:17.915058 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:17.915058 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:30:17.915058 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:17.915058 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:30:17.915058 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:17.915058 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:17.915058 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:17.915058 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:17.915058 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:17.915058 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:17.915058 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:17.915058 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:17.915058 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:17.915058 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:17.915058 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:17.915058 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:17.915058 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:17.916026 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:17.916026 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:17.916026 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:30:17.916026 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:30:17.916026 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:30:17.916026 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:30:17.916026 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:30:17.916026 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:30:17.916026 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 05 02:30:17.916026 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:17.916026 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 298/592] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 5 02:30:17 2022] GET /identity/v3/users/neutron => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:17.916026 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ab3c8-4ad2-4bfc-8aa0-f0e1a9638c8b None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:17.930667 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4414237-7257-45b0-b506-96859601de58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:17.931422 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4414237-7257-45b0-b506-96859601de58 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:17.931703 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4414237-7257-45b0-b506-96859601de58 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:17.931981 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4414237-7257-45b0-b506-96859601de58 None admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:17.932770 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4414237-7257-45b0-b506-96859601de58 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:17.933075 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4414237-7257-45b0-b506-96859601de58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:17.934514 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4414237-7257-45b0-b506-96859601de58 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:17.959509 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 295/593] 10.222.0.42 () {56 vars in 1137 bytes} [Fri Aug 5 02:30:17 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:17.960317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4414237-7257-45b0-b506-96859601de58 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:18.032896 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ab3c8-4ad2-4bfc-8aa0-f0e1a9638c8b None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:18.069140 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec2d72-a64d-4776-94f7-2587ad5317f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:18.069834 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec2d72-a64d-4776-94f7-2587ad5317f6 None admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:18.070411 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec2d72-a64d-4776-94f7-2587ad5317f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:18.070411 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec2d72-a64d-4776-94f7-2587ad5317f6 None admin] PATH_INFO: `/v3/projects/63b323c02a614fc28aac6e7a060064ba/users/55374d3bccd541c9a8f82da9b21c2fb8/roles/2642213efc7d4861b3d3b4f5fbc9ad73` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:18.080331 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4414237-7257-45b0-b506-96859601de58 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:18.106085 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:18.108067 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ec2d72-a64d-4776-94f7-2587ad5317f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=63b323c02a614fc28aac6e7a060064ba, user_id=55374d3bccd541c9a8f82da9b21c2fb8, role_id=2642213efc7d4861b3d3b4f5fbc9ad73)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:18.109603 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ec2d72-a64d-4776-94f7-2587ad5317f6 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:18.118158 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0daff7-8952-4450-bcc4-14df04e68aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:18.118770 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0daff7-8952-4450-bcc4-14df04e68aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:18.119082 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0daff7-8952-4450-bcc4-14df04e68aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:18.127125 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0daff7-8952-4450-bcc4-14df04e68aa4 None admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:18.127125 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0daff7-8952-4450-bcc4-14df04e68aa4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:18.127125 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0daff7-8952-4450-bcc4-14df04e68aa4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:18.127125 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0daff7-8952-4450-bcc4-14df04e68aa4 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:18.133316 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 296/594] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 5 02:30:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:18.134098 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0daff7-8952-4450-bcc4-14df04e68aa4 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:18.208578 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 299/595] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 5 02:30:17 2022] PUT /identity/v3/projects/63b323c02a614fc28aac6e7a060064ba/users/55374d3bccd541c9a8f82da9b21c2fb8/roles/2642213efc7d4861b3d3b4f5fbc9ad73 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:30:18.209770 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec2d72-a64d-4776-94f7-2587ad5317f6 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:18.228023 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:18.250667 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0daff7-8952-4450-bcc4-14df04e68aa4 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:18.310885 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0bb935-e01b-400f-affb-890fd8cdafde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:18.311818 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bb935-e01b-400f-affb-890fd8cdafde None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:18.312295 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bb935-e01b-400f-affb-890fd8cdafde None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:18.313659 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bb935-e01b-400f-affb-890fd8cdafde None admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:18.314728 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0bb935-e01b-400f-affb-890fd8cdafde None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:18.316329 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0bb935-e01b-400f-affb-890fd8cdafde None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:18.318771 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0bb935-e01b-400f-affb-890fd8cdafde None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:18.342612 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 297/596] 10.222.0.42 () {56 vars in 1139 bytes} [Fri Aug 5 02:30:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:18.343715 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0bb935-e01b-400f-affb-890fd8cdafde None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:18.413150 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec2d72-a64d-4776-94f7-2587ad5317f6 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:18.413619 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:18.463600 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb572a88-4e57-4d72-b5f4-953b6559dbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:18.464174 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb572a88-4e57-4d72-b5f4-953b6559dbbd None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:18.464457 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb572a88-4e57-4d72-b5f4-953b6559dbbd None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:18.464733 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb572a88-4e57-4d72-b5f4-953b6559dbbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:18.476161 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb572a88-4e57-4d72-b5f4-953b6559dbbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:18.477618 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb572a88-4e57-4d72-b5f4-953b6559dbbd None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:18.484482 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0bb935-e01b-400f-affb-890fd8cdafde None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:18.494227 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-cb572a88-4e57-4d72-b5f4-953b6559dbbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:18.494227 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:18.494227 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:18.494227 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:18.494227 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:18.494227 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:18.494227 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:18.494227 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:18.494227 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:18.494227 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:18.494227 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:18.494227 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:18.494227 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:18.494227 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:18.494227 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:18.495232 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:18.495232 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:18.495232 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:18.495232 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:18.495232 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:18.495232 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:18.495232 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:18.495232 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:18.495232 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:18.495232 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:18.495232 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:18.495232 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:18.495232 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:18.495232 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:18.495232 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:18.495232 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:18.495232 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:18.496110 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:18.496110 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:18.496110 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:18.496110 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:18.496110 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 300/597] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:18.496467 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb572a88-4e57-4d72-b5f4-953b6559dbbd None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:18.528135 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719cda9-0199-4d47-9a13-040489041ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:18.529059 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719cda9-0199-4d47-9a13-040489041ef6 None admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:18.529760 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719cda9-0199-4d47-9a13-040489041ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:18.530042 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719cda9-0199-4d47-9a13-040489041ef6 None admin] PATH_INFO: `/v3/projects/63b323c02a614fc28aac6e7a060064ba/users/116f66d7dd7b42878f71bd29dc55729c/roles/2642213efc7d4861b3d3b4f5fbc9ad73` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:18.550522 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4719cda9-0199-4d47-9a13-040489041ef6 None admin] RBAC: Authorizing `identity:create_grant(project_id=63b323c02a614fc28aac6e7a060064ba, user_id=116f66d7dd7b42878f71bd29dc55729c, role_id=2642213efc7d4861b3d3b4f5fbc9ad73)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:18.552657 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4719cda9-0199-4d47-9a13-040489041ef6 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:18.565899 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:18.608071 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb572a88-4e57-4d72-b5f4-953b6559dbbd None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:18.627000 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 298/598] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 5 02:30:18 2022] PUT /identity/v3/projects/63b323c02a614fc28aac6e7a060064ba/users/116f66d7dd7b42878f71bd29dc55729c/roles/2642213efc7d4861b3d3b4f5fbc9ad73 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:30:18.628187 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719cda9-0199-4d47-9a13-040489041ef6 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:18.676708 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5424b21-72f3-4a3d-a729-9215b8463040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:18.678816 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5424b21-72f3-4a3d-a729-9215b8463040 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:18.681347 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5424b21-72f3-4a3d-a729-9215b8463040 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:18.681815 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5424b21-72f3-4a3d-a729-9215b8463040 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:18.709221 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5424b21-72f3-4a3d-a729-9215b8463040 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:18.715013 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5424b21-72f3-4a3d-a729-9215b8463040 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:18.756475 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-d5424b21-72f3-4a3d-a729-9215b8463040 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:18.756475 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:18.756475 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:18.756475 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:18.756475 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:18.756475 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:18.756475 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:18.756475 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:18.756475 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:18.756475 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:18.756475 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:18.756475 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:18.756475 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:18.756475 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:18.756475 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:18.757506 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:18.757506 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:18.757506 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:18.757506 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:18.757506 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:18.757506 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:18.757506 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:18.757506 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:18.757506 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:18.757506 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:18.757506 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:18.757506 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:18.757506 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:18.757506 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:18.757506 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:18.757506 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:18.757506 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:18.758409 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:18.758409 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:18.758409 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:18.758409 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:18.764089 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 301/599] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:18.767966 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5424b21-72f3-4a3d-a729-9215b8463040 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:18.821998 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:18.834289 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719cda9-0199-4d47-9a13-040489041ef6 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:18.886382 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751cbf4d-145c-4105-bfc1-e03acdcce62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:18.887671 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cbf4d-145c-4105-bfc1-e03acdcce62c None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:18.888090 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cbf4d-145c-4105-bfc1-e03acdcce62c None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:18.888615 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cbf4d-145c-4105-bfc1-e03acdcce62c None admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:18.895781 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751cbf4d-145c-4105-bfc1-e03acdcce62c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:18.895781 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751cbf4d-145c-4105-bfc1-e03acdcce62c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:18.895781 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751cbf4d-145c-4105-bfc1-e03acdcce62c None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:18.908806 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5424b21-72f3-4a3d-a729-9215b8463040 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:18.909116 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 299/600] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:18.914211 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751cbf4d-145c-4105-bfc1-e03acdcce62c None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:18.934183 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:18.982424 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaea20f-2925-4a60-bb53-d7001a8453c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:18.983681 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaea20f-2925-4a60-bb53-d7001a8453c5 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:18.984804 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaea20f-2925-4a60-bb53-d7001a8453c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:18.985442 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaea20f-2925-4a60-bb53-d7001a8453c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:18.988220 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaea20f-2925-4a60-bb53-d7001a8453c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:18.988773 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaea20f-2925-4a60-bb53-d7001a8453c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:18.990626 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaea20f-2925-4a60-bb53-d7001a8453c5 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:19.014557 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 302/601] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:19.018479 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaea20f-2925-4a60-bb53-d7001a8453c5 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:19.119416 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751cbf4d-145c-4105-bfc1-e03acdcce62c None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:19.177634 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f289bd-26d0-40a4-a87c-7504fa7d12ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:19.178650 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f289bd-26d0-40a4-a87c-7504fa7d12ad None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:19.179279 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f289bd-26d0-40a4-a87c-7504fa7d12ad None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:19.179763 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f289bd-26d0-40a4-a87c-7504fa7d12ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:19.187909 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f289bd-26d0-40a4-a87c-7504fa7d12ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:19.189667 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f289bd-26d0-40a4-a87c-7504fa7d12ad None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:19.203187 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-90f289bd-26d0-40a4-a87c-7504fa7d12ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:19.203187 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:19.203187 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:19.203187 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:19.203187 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:19.203187 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:19.203187 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:19.203187 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:19.203187 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:19.203187 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:19.203187 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:19.203187 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:19.203187 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:30:19.203187 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:30:19.203187 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:30:19.204118 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:30:19.204118 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:19.204118 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:19.204118 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:19.204118 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:19.204118 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:19.204118 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:19.204118 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:19.204118 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:19.204118 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:19.204118 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:19.204118 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:19.204118 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:19.204118 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:19.204118 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:19.204118 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:19.204118 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:19.205018 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:30:19.205018 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:30:19.205018 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:30:19.205018 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:30:19.205018 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:30:19.205018 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:30:19.205018 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:19.205018 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:19.207576 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 300/602] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:30:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:30:19.217755 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f289bd-26d0-40a4-a87c-7504fa7d12ad None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:19.235741 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaea20f-2925-4a60-bb53-d7001a8453c5 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:19.250995 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:19.343638 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc1620-0c5a-471e-8b7c-5c6cfe3fdfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:19.344596 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc1620-0c5a-471e-8b7c-5c6cfe3fdfb5 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:19.346487 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc1620-0c5a-471e-8b7c-5c6cfe3fdfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:19.346980 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc1620-0c5a-471e-8b7c-5c6cfe3fdfb5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:19.363639 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badc1620-0c5a-471e-8b7c-5c6cfe3fdfb5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:19.365853 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badc1620-0c5a-471e-8b7c-5c6cfe3fdfb5 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:19.387906 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f289bd-26d0-40a4-a87c-7504fa7d12ad None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:19.390924 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-badc1620-0c5a-471e-8b7c-5c6cfe3fdfb5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:19.390924 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:19.390924 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:19.390924 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:19.390924 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:19.390924 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:19.390924 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:19.390924 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:19.390924 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:19.390924 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:19.390924 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:19.390924 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:19.390924 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:30:19.390924 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:30:19.390924 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:30:19.391837 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:30:19.391837 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:19.391837 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:19.391837 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:19.391837 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:19.391837 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:19.391837 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:19.391837 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:19.391837 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:19.391837 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:19.391837 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:19.391837 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:19.391837 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:19.391837 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:19.391837 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:19.391837 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:19.391837 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:19.392763 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:30:19.392763 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:30:19.392763 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:30:19.392763 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:30:19.392763 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:30:19.392763 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:30:19.392763 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:19.392763 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:19.400409 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 303/603] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:30:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:19.403780 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc1620-0c5a-471e-8b7c-5c6cfe3fdfb5 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:19.452835 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed2e08-4d26-42be-9878-5f144df1a853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:19.454864 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed2e08-4d26-42be-9878-5f144df1a853 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:19.455549 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed2e08-4d26-42be-9878-5f144df1a853 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:19.456932 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed2e08-4d26-42be-9878-5f144df1a853 None admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:19.457908 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed2e08-4d26-42be-9878-5f144df1a853 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:19.458367 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:19.460323 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed2e08-4d26-42be-9878-5f144df1a853 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:19.462697 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed2e08-4d26-42be-9878-5f144df1a853 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:19.496932 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 301/604] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 5 02:30:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:30:19.499828 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed2e08-4d26-42be-9878-5f144df1a853 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:19.615146 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc1620-0c5a-471e-8b7c-5c6cfe3fdfb5 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:19.659308 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:19.682607 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b2d17-fbac-4ebf-8eef-1d538327243d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:19.683688 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b2d17-fbac-4ebf-8eef-1d538327243d None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:19.683971 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b2d17-fbac-4ebf-8eef-1d538327243d None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:19.685711 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b2d17-fbac-4ebf-8eef-1d538327243d None admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:19.685711 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b2d17-fbac-4ebf-8eef-1d538327243d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:19.685711 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b2d17-fbac-4ebf-8eef-1d538327243d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:19.686713 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b2d17-fbac-4ebf-8eef-1d538327243d None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:19.700363 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 304/605] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 5 02:30:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:19.705685 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b2d17-fbac-4ebf-8eef-1d538327243d None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:19.710200 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed2e08-4d26-42be-9878-5f144df1a853 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:19.756917 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7db67f-7626-4977-9f65-e7096c4f29f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:19.757583 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7db67f-7626-4977-9f65-e7096c4f29f6 None admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:19.757870 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7db67f-7626-4977-9f65-e7096c4f29f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:19.758153 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7db67f-7626-4977-9f65-e7096c4f29f6 None admin] PATH_INFO: `/v3/projects/63b323c02a614fc28aac6e7a060064ba/users/e60a3568771842e294858e5868068f84/roles/2642213efc7d4861b3d3b4f5fbc9ad73` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:19.774689 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7db67f-7626-4977-9f65-e7096c4f29f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=63b323c02a614fc28aac6e7a060064ba, user_id=e60a3568771842e294858e5868068f84, role_id=2642213efc7d4861b3d3b4f5fbc9ad73)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:19.776678 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7db67f-7626-4977-9f65-e7096c4f29f6 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:19.850619 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:19.860530 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b2d17-fbac-4ebf-8eef-1d538327243d None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:19.894883 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df3f76-4328-4b28-85d9-9ea7f334456e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:19.895605 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df3f76-4328-4b28-85d9-9ea7f334456e None admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:19.895890 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df3f76-4328-4b28-85d9-9ea7f334456e None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:19.896169 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df3f76-4328-4b28-85d9-9ea7f334456e None admin] PATH_INFO: `/v3/projects/63b323c02a614fc28aac6e7a060064ba/users/a0035fcd8b06400bb7946f7ac37393a8/roles/2642213efc7d4861b3d3b4f5fbc9ad73` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:19.917709 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 302/606] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 5 02:30:19 2022] PUT /identity/v3/projects/63b323c02a614fc28aac6e7a060064ba/users/e60a3568771842e294858e5868068f84/roles/2642213efc7d4861b3d3b4f5fbc9ad73 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:30:19.921830 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4edbb-6dfb-4498-a003-c39e5bca9305 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:19.921830 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4edbb-6dfb-4498-a003-c39e5bca9305 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:19.921830 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4edbb-6dfb-4498-a003-c39e5bca9305 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:19.921830 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 303/607] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:30:19.922136 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df3f76-4328-4b28-85d9-9ea7f334456e None admin] RBAC: Authorizing `identity:create_grant(project_id=63b323c02a614fc28aac6e7a060064ba, user_id=a0035fcd8b06400bb7946f7ac37393a8, role_id=2642213efc7d4861b3d3b4f5fbc9ad73)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:19.923447 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df3f76-4328-4b28-85d9-9ea7f334456e None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:19.937045 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec0863-3b2c-4084-bf33-b0d1d19df9cf None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:19.937376 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec0863-3b2c-4084-bf33-b0d1d19df9cf None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:19.937597 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec0863-3b2c-4084-bf33-b0d1d19df9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:19.958830 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-38ec0863-3b2c-4084-bf33-b0d1d19df9cf None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:19.960083 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-38ec0863-3b2c-4084-bf33-b0d1d19df9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:20.015303 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 305/608] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 5 02:30:19 2022] PUT /identity/v3/projects/63b323c02a614fc28aac6e7a060064ba/users/a0035fcd8b06400bb7946f7ac37393a8/roles/2642213efc7d4861b3d3b4f5fbc9ad73 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:30:20.069506 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 304/609] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:30:20.110201 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df3f76-4328-4b28-85d9-9ea7f334456e None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:20.252044 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df3f76-4328-4b28-85d9-9ea7f334456e None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:20.288901 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957c6b4-30ed-4872-87b8-e7208d301ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:20.289551 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957c6b4-30ed-4872-87b8-e7208d301ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:20.289834 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957c6b4-30ed-4872-87b8-e7208d301ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:20.290111 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957c6b4-30ed-4872-87b8-e7208d301ad0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:20.298618 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:20.301989 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f957c6b4-30ed-4872-87b8-e7208d301ad0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:30:20.308553 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-f957c6b4-30ed-4872-87b8-e7208d301ad0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:30:20.308553 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:20.308553 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:20.308553 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:20.308553 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:20.308553 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:20.308553 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:20.308553 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:20.308553 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:20.308553 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:20.308553 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:20.308553 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:20.308553 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:30:20.308553 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:30:20.308553 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:30:20.308553 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:30:20.309787 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:30:20.309787 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:30:20.309787 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:30:20.309787 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:30:20.309787 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:20.309787 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:20.309787 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:20.309787 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:20.309787 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:20.309787 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:20.309787 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:20.309787 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:20.309787 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:20.309787 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:20.309787 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:20.309787 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:20.310724 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:20.310724 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:20.310724 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:20.310724 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:20.310724 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:30:20.310724 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:30:20.310724 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:30:20.310724 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:30:20.310724 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:30:20.310724 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:30:20.310724 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:30:20.310724 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:20.310724 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 306/610] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 5 02:30:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:20.314524 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec0863-3b2c-4084-bf33-b0d1d19df9cf None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:20.393217 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:20.483002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35ff08-2da7-4fcc-ab81-93bdfb75b907 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:20.483328 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35ff08-2da7-4fcc-ab81-93bdfb75b907 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:20.483571 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35ff08-2da7-4fcc-ab81-93bdfb75b907 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:20.485164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 307/611] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:30:20.490120 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea806c85-bb51-4136-8867-09c15044afd6 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:20.490409 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea806c85-bb51-4136-8867-09c15044afd6 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:20.490692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea806c85-bb51-4136-8867-09c15044afd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:20.493323 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec0863-3b2c-4084-bf33-b0d1d19df9cf None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:20.508905 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-ea806c85-bb51-4136-8867-09c15044afd6 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:20.510095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-ea806c85-bb51-4136-8867-09c15044afd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:20.548926 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e70e4d-33b0-4606-8416-7a2119b7aed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:20.549479 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e70e4d-33b0-4606-8416-7a2119b7aed6 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:20.554659 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e70e4d-33b0-4606-8416-7a2119b7aed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:20.554659 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e70e4d-33b0-4606-8416-7a2119b7aed6 None admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:20.554659 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e70e4d-33b0-4606-8416-7a2119b7aed6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:20.554659 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e70e4d-33b0-4606-8416-7a2119b7aed6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:20.554659 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e70e4d-33b0-4606-8416-7a2119b7aed6 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:20.572151 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 305/612] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 5 02:30:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:20.574478 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e70e4d-33b0-4606-8416-7a2119b7aed6 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:20.634105 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 308/613] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:30:20.678204 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea806c85-bb51-4136-8867-09c15044afd6 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:20.756996 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e70e4d-33b0-4606-8416-7a2119b7aed6 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:20.787520 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:20.815181 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2da0d6-c56c-4b21-a974-083f3eeb93a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:20.816301 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2da0d6-c56c-4b21-a974-083f3eeb93a6 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:20.818127 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2da0d6-c56c-4b21-a974-083f3eeb93a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:20.819170 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2da0d6-c56c-4b21-a974-083f3eeb93a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:20.841671 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2da0d6-c56c-4b21-a974-083f3eeb93a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:20.845572 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2da0d6-c56c-4b21-a974-083f3eeb93a6 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:20.871458 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-be2da0d6-c56c-4b21-a974-083f3eeb93a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:20.871458 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:20.871458 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:20.871458 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:20.871458 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:20.871458 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:20.871458 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:20.871458 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:20.871458 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:20.871458 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:20.871458 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:20.871458 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:20.871458 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:20.871458 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:20.871458 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:20.872412 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:20.872412 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:20.872412 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:20.872412 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:20.872412 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:20.872412 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:20.872412 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:20.872412 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:20.872412 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:20.872412 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:20.872412 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:20.872412 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:20.872412 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:20.872412 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:20.872412 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:20.872412 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:20.872412 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:20.873313 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:20.873313 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:20.873313 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:20.873313 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:20.885852 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 306/614] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:20.887806 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2da0d6-c56c-4b21-a974-083f3eeb93a6 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:20.905323 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea806c85-bb51-4136-8867-09c15044afd6 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:20.963177 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:20.972099 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4517c64-c44b-411d-aae7-eb79b6e9fb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:20.973248 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4517c64-c44b-411d-aae7-eb79b6e9fb45 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:20.973733 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4517c64-c44b-411d-aae7-eb79b6e9fb45 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:20.974228 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4517c64-c44b-411d-aae7-eb79b6e9fb45 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:21.002603 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4517c64-c44b-411d-aae7-eb79b6e9fb45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:30:21.008535 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-c4517c64-c44b-411d-aae7-eb79b6e9fb45 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:30:21.008535 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:21.008535 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:21.008535 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:21.008535 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:21.008535 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:21.008535 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:21.008535 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:21.008535 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:21.008535 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:21.008535 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:21.008535 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:21.008535 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:30:21.008535 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:30:21.008535 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:30:21.008535 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:30:21.009474 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:30:21.009474 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:30:21.009474 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:30:21.009474 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:30:21.009474 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:21.009474 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:21.009474 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:21.009474 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:21.009474 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:21.009474 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:21.009474 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:21.009474 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:21.009474 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:21.009474 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:21.009474 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:21.009474 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:21.010315 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:21.010315 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:21.010315 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:21.010315 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:21.010315 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:30:21.010315 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:30:21.010315 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:30:21.010315 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:30:21.010315 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:30:21.010315 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:30:21.010315 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:30:21.010315 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:21.010315 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 309/615] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 5 02:30:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:30:21.011642 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63694d-3842-44dc-b35d-5135db585922 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:21.011642 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63694d-3842-44dc-b35d-5135db585922 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:21.011927 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63694d-3842-44dc-b35d-5135db585922 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:21.017172 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 310/616] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:30:21.017950 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e63694d-3842-44dc-b35d-5135db585922 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:21.047553 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2da0d6-c56c-4b21-a974-083f3eeb93a6 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:21.100474 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aec8ee-e42c-4e23-9a6b-0ab38aef3151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:21.101716 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aec8ee-e42c-4e23-9a6b-0ab38aef3151 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:21.102459 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aec8ee-e42c-4e23-9a6b-0ab38aef3151 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:21.102935 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aec8ee-e42c-4e23-9a6b-0ab38aef3151 None admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:21.104670 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aec8ee-e42c-4e23-9a6b-0ab38aef3151 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:21.105185 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aec8ee-e42c-4e23-9a6b-0ab38aef3151 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:21.106814 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aec8ee-e42c-4e23-9a6b-0ab38aef3151 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:21.129202 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 307/617] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:21.129202 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c83786-10a7-426c-ba26-067da3e356a3 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:21.129202 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c83786-10a7-426c-ba26-067da3e356a3 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:21.129202 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c83786-10a7-426c-ba26-067da3e356a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:21.143820 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e63694d-3842-44dc-b35d-5135db585922 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:21.146356 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-f5c83786-10a7-426c-ba26-067da3e356a3 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:21.147550 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-f5c83786-10a7-426c-ba26-067da3e356a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:21.169571 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:21.189506 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16afbb15-54d9-43bb-a54c-de5a1ab54920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:21.190614 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16afbb15-54d9-43bb-a54c-de5a1ab54920 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:21.191321 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16afbb15-54d9-43bb-a54c-de5a1ab54920 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:21.191605 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16afbb15-54d9-43bb-a54c-de5a1ab54920 None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:21.192377 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16afbb15-54d9-43bb-a54c-de5a1ab54920 None admin] RBAC: Adding query filter params (name=service) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:21.192682 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16afbb15-54d9-43bb-a54c-de5a1ab54920 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:21.194802 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16afbb15-54d9-43bb-a54c-de5a1ab54920 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:21.215571 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 311/618] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 5 02:30:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:21.216908 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16afbb15-54d9-43bb-a54c-de5a1ab54920 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:21.246628 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 308/619] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:30:21.246628 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c83786-10a7-426c-ba26-067da3e356a3 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:21.306801 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:21.376407 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16afbb15-54d9-43bb-a54c-de5a1ab54920 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:21.382163 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c83786-10a7-426c-ba26-067da3e356a3 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:21.418581 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885658b8-c73c-4dfd-8a47-8384a25fea14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:21.419656 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885658b8-c73c-4dfd-8a47-8384a25fea14 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:21.419949 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885658b8-c73c-4dfd-8a47-8384a25fea14 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:21.420225 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885658b8-c73c-4dfd-8a47-8384a25fea14 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:21.434141 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885658b8-c73c-4dfd-8a47-8384a25fea14 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:21.435784 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885658b8-c73c-4dfd-8a47-8384a25fea14 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:21.437166 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7d07c-d56b-4107-8b07-22e801a032cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:21.438423 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7d07c-d56b-4107-8b07-22e801a032cf None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:21.439569 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7d07c-d56b-4107-8b07-22e801a032cf None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:21.440068 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7d07c-d56b-4107-8b07-22e801a032cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:21.449505 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-885658b8-c73c-4dfd-8a47-8384a25fea14 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 05 02:30:21.449505 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:21.449505 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:21.449505 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:21.449505 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:21.449505 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:21.449505 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:21.449505 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:21.449505 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:21.449505 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:21.449505 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:21.449505 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:21.449505 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:30:21.449505 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:30:21.449505 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:30:21.449505 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:30:21.450646 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:21.450646 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:21.450646 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:30:21.450646 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:21.450646 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:30:21.450646 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:21.450646 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:21.450646 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:21.450646 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:21.450646 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:21.450646 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:21.450646 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:21.450646 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:21.450646 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:21.450646 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:21.450646 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:21.450646 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:21.450646 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:21.451637 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:21.451637 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:21.451637 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:30:21.451637 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:30:21.451637 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:30:21.451637 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:30:21.451637 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:30:21.451637 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:30:21.451637 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 05 02:30:21.451637 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:21.451637 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 312/620] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 5 02:30:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:21.455585 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885658b8-c73c-4dfd-8a47-8384a25fea14 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:21.458871 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf7d07c-d56b-4107-8b07-22e801a032cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:21.460778 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf7d07c-d56b-4107-8b07-22e801a032cf None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:21.480857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-adf7d07c-d56b-4107-8b07-22e801a032cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:21.480857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:21.480857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:21.480857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:21.480857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:21.480857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:21.480857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:21.480857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:21.480857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:21.480857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:21.480857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:21.480857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:21.480857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:21.480857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:21.480857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:21.481797 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:21.481797 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:21.481797 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:21.481797 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:21.481797 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:21.481797 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:21.481797 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:21.481797 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:21.481797 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:21.481797 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:21.481797 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:21.481797 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:21.481797 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:21.481797 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:21.481797 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:21.481797 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:21.481797 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:21.482719 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:21.482719 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:21.482719 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:21.482719 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:21.489029 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 309/621] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:21.489029 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7d07c-d56b-4107-8b07-22e801a032cf None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:21.499216 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:21.578389 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885658b8-c73c-4dfd-8a47-8384a25fea14 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:21.592042 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7d07c-d56b-4107-8b07-22e801a032cf None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:21.593316 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:21.616995 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb0a31-d378-4c9d-a9a3-c7b84ee51f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:21.617927 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb0a31-d378-4c9d-a9a3-c7b84ee51f5f None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:21.618411 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb0a31-d378-4c9d-a9a3-c7b84ee51f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:21.619003 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb0a31-d378-4c9d-a9a3-c7b84ee51f5f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:21.627499 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a562d-8c23-44b9-8d40-cf7581c2cef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:21.628047 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a562d-8c23-44b9-8d40-cf7581c2cef6 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:21.628340 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a562d-8c23-44b9-8d40-cf7581c2cef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:21.628749 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a562d-8c23-44b9-8d40-cf7581c2cef6 None admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:21.629470 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a562d-8c23-44b9-8d40-cf7581c2cef6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:21.629775 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a562d-8c23-44b9-8d40-cf7581c2cef6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:21.631318 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a562d-8c23-44b9-8d40-cf7581c2cef6 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:21.632302 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb0a31-d378-4c9d-a9a3-c7b84ee51f5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:30:21.638072 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-b0bb0a31-d378-4c9d-a9a3-c7b84ee51f5f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:30:21.638072 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:21.638072 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:21.638072 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:21.638072 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:21.638072 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:21.638072 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:21.638072 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:21.638072 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:21.638072 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:21.638072 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:21.638072 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:21.638072 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:30:21.638072 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:30:21.638072 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:30:21.638072 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:30:21.639019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:30:21.639019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:30:21.639019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:30:21.639019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:30:21.639019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:21.639019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:21.639019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:21.639019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:21.639019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:21.639019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:21.639019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:21.639019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:21.639019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:21.639019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:21.639019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:21.639019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:21.639876 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:21.639876 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:21.639876 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:21.639876 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:21.639876 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:30:21.639876 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:30:21.639876 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:30:21.639876 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:30:21.639876 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:30:21.639876 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:30:21.639876 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:30:21.639876 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:21.647912 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 313/622] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 5 02:30:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:21.649005 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb0a31-d378-4c9d-a9a3-c7b84ee51f5f None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:21.650332 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 310/623] 10.222.0.42 () {56 vars in 1135 bytes} [Fri Aug 5 02:30:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:21.656920 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a562d-8c23-44b9-8d40-cf7581c2cef6 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:21.725658 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:21.759235 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb0a31-d378-4c9d-a9a3-c7b84ee51f5f None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:21.759914 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a562d-8c23-44b9-8d40-cf7581c2cef6 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:21.800175 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e6a82-94ba-4d9d-ba60-c95c13f5bf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:21.800385 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351bc0a-4a69-4abd-ac0c-a41ce57eaff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:21.801000 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351bc0a-4a69-4abd-ac0c-a41ce57eaff5 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:21.801324 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351bc0a-4a69-4abd-ac0c-a41ce57eaff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:21.801602 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351bc0a-4a69-4abd-ac0c-a41ce57eaff5 None admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:21.801970 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e6a82-94ba-4d9d-ba60-c95c13f5bf06 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:21.802319 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c351bc0a-4a69-4abd-ac0c-a41ce57eaff5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:21.802625 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c351bc0a-4a69-4abd-ac0c-a41ce57eaff5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:21.802870 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e6a82-94ba-4d9d-ba60-c95c13f5bf06 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:21.803407 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e6a82-94ba-4d9d-ba60-c95c13f5bf06 None admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:21.804068 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c351bc0a-4a69-4abd-ac0c-a41ce57eaff5 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:21.804517 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e6a82-94ba-4d9d-ba60-c95c13f5bf06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:21.805033 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e6a82-94ba-4d9d-ba60-c95c13f5bf06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:21.806756 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e6a82-94ba-4d9d-ba60-c95c13f5bf06 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:21.817721 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 311/624] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 5 02:30:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:21.817721 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351bc0a-4a69-4abd-ac0c-a41ce57eaff5 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:21.830938 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 314/625] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:21.832462 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e6a82-94ba-4d9d-ba60-c95c13f5bf06 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:21.867782 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:21.942792 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351bc0a-4a69-4abd-ac0c-a41ce57eaff5 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:21.953586 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e6a82-94ba-4d9d-ba60-c95c13f5bf06 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:21.981073 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:21.990665 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39356347-121c-4012-b404-d8a47239bf56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:21.991911 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39356347-121c-4012-b404-d8a47239bf56 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:21.992197 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39356347-121c-4012-b404-d8a47239bf56 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:21.992497 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39356347-121c-4012-b404-d8a47239bf56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:21.993296 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75de4b-76f6-4859-a04e-0a5dc4512f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:21.994151 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75de4b-76f6-4859-a04e-0a5dc4512f48 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:21.994976 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75de4b-76f6-4859-a04e-0a5dc4512f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:21.995877 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75de4b-76f6-4859-a04e-0a5dc4512f48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:22.005277 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39356347-121c-4012-b404-d8a47239bf56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:22.006755 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39356347-121c-4012-b404-d8a47239bf56 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:22.015793 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e75de4b-76f6-4859-a04e-0a5dc4512f48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:22.018042 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e75de4b-76f6-4859-a04e-0a5dc4512f48 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:22.024513 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-39356347-121c-4012-b404-d8a47239bf56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:22.024513 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:22.024513 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:22.024513 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:22.024513 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:22.024513 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:22.024513 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:22.024513 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:22.024513 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:22.024513 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:22.024513 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:22.024513 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:22.024513 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:22.024513 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:22.024513 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:22.025436 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:22.025436 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:22.025436 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:22.025436 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:22.025436 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:22.025436 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:22.025436 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:22.025436 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:22.025436 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:22.025436 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:22.025436 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:22.025436 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:22.025436 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:22.025436 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:22.025436 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:22.025436 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:22.025436 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:22.026358 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:22.026358 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:22.026358 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:22.026358 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:22.030626 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 315/626] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:22.031522 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39356347-121c-4012-b404-d8a47239bf56 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:22.039493 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-4e75de4b-76f6-4859-a04e-0a5dc4512f48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:22.039493 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:22.039493 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:22.039493 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:22.039493 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:22.039493 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:22.039493 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:22.039493 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:22.039493 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:22.039493 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:22.039493 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:22.039493 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:22.039493 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:22.039493 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:22.039493 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:22.040395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:22.040395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:22.040395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:22.040395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:22.040395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:22.040395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:22.040395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:22.040395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:22.040395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:22.040395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:22.040395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:22.040395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:22.040395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:22.040395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:22.040395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:22.040395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:22.040395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:22.041402 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:22.041402 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:22.041402 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:22.041402 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:22.043650 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 312/627] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:22.044586 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75de4b-76f6-4859-a04e-0a5dc4512f48 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:22.136285 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:22.154125 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39356347-121c-4012-b404-d8a47239bf56 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:22.190261 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75de4b-76f6-4859-a04e-0a5dc4512f48 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:22.190635 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352777c8-d3be-42c9-b400-f5b9b51f4a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:22.191429 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352777c8-d3be-42c9-b400-f5b9b51f4a9f None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:22.192442 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352777c8-d3be-42c9-b400-f5b9b51f4a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:22.192875 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352777c8-d3be-42c9-b400-f5b9b51f4a9f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:22.207964 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352777c8-d3be-42c9-b400-f5b9b51f4a9f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:22.210286 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352777c8-d3be-42c9-b400-f5b9b51f4a9f None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:22.224825 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-352777c8-d3be-42c9-b400-f5b9b51f4a9f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 02:30:22.224825 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:22.224825 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:22.224825 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:22.224825 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:22.224825 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:22.224825 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:22.224825 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:22.224825 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:22.224825 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:22.224825 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:22.224825 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:22.224825 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:30:22.224825 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:30:22.224825 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:30:22.224825 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:30:22.226074 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:22.226074 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:22.226074 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:30:22.226074 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:22.226074 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:30:22.226074 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:22.226074 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:22.226074 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:22.226074 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:22.226074 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:22.226074 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:22.226074 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:22.226074 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:22.226074 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:22.226074 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:22.226074 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:22.226074 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:22.226074 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:22.227040 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:22.227040 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:22.227040 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:30:22.227040 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:30:22.227040 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:30:22.227040 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:30:22.227040 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:30:22.227040 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:30:22.227040 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 02:30:22.227040 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:22.232986 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 316/628] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Aug 5 02:30:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:22.232986 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352777c8-d3be-42c9-b400-f5b9b51f4a9f None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:22.240816 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce3d58-76ae-42a3-9f66-fa7d7fecccd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:22.241449 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce3d58-76ae-42a3-9f66-fa7d7fecccd2 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:22.241731 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce3d58-76ae-42a3-9f66-fa7d7fecccd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:22.242008 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce3d58-76ae-42a3-9f66-fa7d7fecccd2 None admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:22.242854 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ce3d58-76ae-42a3-9f66-fa7d7fecccd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:22.243062 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ce3d58-76ae-42a3-9f66-fa7d7fecccd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:22.244404 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ce3d58-76ae-42a3-9f66-fa7d7fecccd2 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:22.262023 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 313/629] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:22.262818 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce3d58-76ae-42a3-9f66-fa7d7fecccd2 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:22.309188 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:22.351567 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352777c8-d3be-42c9-b400-f5b9b51f4a9f None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:22.369237 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce3d58-76ae-42a3-9f66-fa7d7fecccd2 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:22.384815 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07db82-26b9-4301-b0fb-c589fa56532b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:22.385434 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07db82-26b9-4301-b0fb-c589fa56532b None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:22.385719 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07db82-26b9-4301-b0fb-c589fa56532b None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:22.386022 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07db82-26b9-4301-b0fb-c589fa56532b None admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:22.386717 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c07db82-26b9-4301-b0fb-c589fa56532b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:22.387056 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c07db82-26b9-4301-b0fb-c589fa56532b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:22.388437 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c07db82-26b9-4301-b0fb-c589fa56532b None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:22.399768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 317/630] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:22.400542 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07db82-26b9-4301-b0fb-c589fa56532b None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:22.402589 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85335d-977b-46ab-908c-f4a78b051925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:22.403239 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85335d-977b-46ab-908c-f4a78b051925 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:22.403519 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85335d-977b-46ab-908c-f4a78b051925 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:22.403793 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85335d-977b-46ab-908c-f4a78b051925 None admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:22.404591 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c85335d-977b-46ab-908c-f4a78b051925 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:22.404896 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c85335d-977b-46ab-908c-f4a78b051925 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:22.406335 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c85335d-977b-46ab-908c-f4a78b051925 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:22.406785 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:22.423468 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 314/631] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Aug 5 02:30:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:22.424687 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec63e1-5984-42a6-89da-020329408f0c None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:22.424969 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec63e1-5984-42a6-89da-020329408f0c None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:22.425244 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec63e1-5984-42a6-89da-020329408f0c None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:22.427022 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 315/632] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:30:22.428027 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b6bb5-ba9c-41a8-958f-56a617fe3744 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:22.428313 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b6bb5-ba9c-41a8-958f-56a617fe3744 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:22.428588 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b6bb5-ba9c-41a8-958f-56a617fe3744 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:22.430041 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 316/633] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:30:22.430743 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b6bb5-ba9c-41a8-958f-56a617fe3744 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:22.503281 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07db82-26b9-4301-b0fb-c589fa56532b None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:22.530887 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:22.535964 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b6bb5-ba9c-41a8-958f-56a617fe3744 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:22.537313 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce34942-4e03-4915-aca1-d9742d08d770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:22.538768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce34942-4e03-4915-aca1-d9742d08d770 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:22.538768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce34942-4e03-4915-aca1-d9742d08d770 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:22.538768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce34942-4e03-4915-aca1-d9742d08d770 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:22.545740 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce34942-4e03-4915-aca1-d9742d08d770 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:22.547209 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce34942-4e03-4915-aca1-d9742d08d770 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:22.560164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-2ce34942-4e03-4915-aca1-d9742d08d770 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 05 02:30:22.560164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:22.560164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:22.560164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:22.560164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:22.560164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:22.560164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:22.560164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:22.560164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:22.560164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:22.560164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:22.560164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:22.560164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:30:22.560164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:30:22.560164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:30:22.560164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:30:22.561267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:22.561267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:22.561267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:30:22.561267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:22.561267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:30:22.561267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:22.561267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:22.561267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:22.561267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:22.561267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:22.561267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:22.561267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:22.561267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:22.561267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:22.561267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:22.561267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:22.561267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:22.561267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:22.562232 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:22.562232 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:22.562232 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:30:22.562232 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:30:22.562232 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:30:22.562232 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:30:22.562232 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:30:22.562232 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:30:22.562232 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 05 02:30:22.562232 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:22.562232 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 318/634] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:30:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:22.562232 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce34942-4e03-4915-aca1-d9742d08d770 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:22.572697 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ec464-fcf9-46b5-9298-55031fb05a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:22.573337 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ec464-fcf9-46b5-9298-55031fb05a28 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:22.573619 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ec464-fcf9-46b5-9298-55031fb05a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:22.573895 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ec464-fcf9-46b5-9298-55031fb05a28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:22.580488 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ec464-fcf9-46b5-9298-55031fb05a28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:22.581932 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ec464-fcf9-46b5-9298-55031fb05a28 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:22.593028 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-ba9ec464-fcf9-46b5-9298-55031fb05a28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:22.593028 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:22.593028 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:22.593028 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:22.593028 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:22.593028 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:22.593028 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:22.593028 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:22.593028 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:22.593028 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:22.593028 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:22.593028 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:22.593028 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:30:22.593028 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:30:22.593028 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:30:22.594114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:30:22.594114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:22.594114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:22.594114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:22.594114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:22.594114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:22.594114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:22.594114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:22.594114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:22.594114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:22.594114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:22.594114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:22.594114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:22.594114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:22.594114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:22.594114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:22.594114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:22.595250 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:30:22.595250 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:30:22.595250 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:30:22.595250 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:30:22.595250 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:30:22.595250 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:30:22.595250 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:22.595250 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:22.595250 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 317/635] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:30:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:22.595859 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37696178-ba46-48d3-8e05-4f94e9c481ea None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:22.595859 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37696178-ba46-48d3-8e05-4f94e9c481ea None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:22.596089 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37696178-ba46-48d3-8e05-4f94e9c481ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:22.615354 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-37696178-ba46-48d3-8e05-4f94e9c481ea None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:22.616534 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-37696178-ba46-48d3-8e05-4f94e9c481ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:22.629011 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:22.666883 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce34942-4e03-4915-aca1-d9742d08d770 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:22.685589 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 318/636] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:30:22.693176 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e57e68-0853-4e11-a8a5-952a3a68dcf0 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:22.693469 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e57e68-0853-4e11-a8a5-952a3a68dcf0 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:22.693743 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e57e68-0853-4e11-a8a5-952a3a68dcf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:22.709023 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f73b9-cd98-470d-ae97-38ad4cdbd4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:22.709652 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f73b9-cd98-470d-ae97-38ad4cdbd4c9 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:22.709935 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f73b9-cd98-470d-ae97-38ad4cdbd4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:22.710210 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f73b9-cd98-470d-ae97-38ad4cdbd4c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:22.717608 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-08e57e68-0853-4e11-a8a5-952a3a68dcf0 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:22.718801 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-08e57e68-0853-4e11-a8a5-952a3a68dcf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:22.780969 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1f73b9-cd98-470d-ae97-38ad4cdbd4c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:22.782342 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1f73b9-cd98-470d-ae97-38ad4cdbd4c9 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:22.788671 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 319/637] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:30:22.789504 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e57e68-0853-4e11-a8a5-952a3a68dcf0 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:22.809479 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:22.846487 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:22.886674 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 319/638] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:30:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:30:22.887542 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f73b9-cd98-470d-ae97-38ad4cdbd4c9 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:22.895135 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e57e68-0853-4e11-a8a5-952a3a68dcf0 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:22.928711 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39c532-0531-4ed9-a118-94da5c1b4c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:22.929409 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39c532-0531-4ed9-a118-94da5c1b4c52 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:22.929691 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39c532-0531-4ed9-a118-94da5c1b4c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:22.929966 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39c532-0531-4ed9-a118-94da5c1b4c52 None admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:22.930744 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d39c532-0531-4ed9-a118-94da5c1b4c52 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:22.931104 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d39c532-0531-4ed9-a118-94da5c1b4c52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:22.932536 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d39c532-0531-4ed9-a118-94da5c1b4c52 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:22.948865 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 320/639] 10.222.0.42 () {56 vars in 1137 bytes} [Fri Aug 5 02:30:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:22.949640 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39c532-0531-4ed9-a118-94da5c1b4c52 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:22.987350 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f73b9-cd98-470d-ae97-38ad4cdbd4c9 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:23.019271 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1027af1-3de2-4731-bb61-ab0e3516b609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:23.020412 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1027af1-3de2-4731-bb61-ab0e3516b609 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:23.020694 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1027af1-3de2-4731-bb61-ab0e3516b609 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:23.020968 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1027af1-3de2-4731-bb61-ab0e3516b609 None admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:23.021711 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1027af1-3de2-4731-bb61-ab0e3516b609 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:23.022014 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1027af1-3de2-4731-bb61-ab0e3516b609 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:23.023468 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1027af1-3de2-4731-bb61-ab0e3516b609 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:23.025938 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:23.036270 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 320/640] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 5 02:30:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:23.036270 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1027af1-3de2-4731-bb61-ab0e3516b609 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:23.049257 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39c532-0531-4ed9-a118-94da5c1b4c52 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:23.060157 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:23.084259 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b7b41-8c35-47f9-9881-b08814b8afbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:23.085004 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b7b41-8c35-47f9-9881-b08814b8afbe None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:23.085381 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b7b41-8c35-47f9-9881-b08814b8afbe None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:23.085718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b7b41-8c35-47f9-9881-b08814b8afbe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:23.096411 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b7b41-8c35-47f9-9881-b08814b8afbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:30:23.102122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-f73b7b41-8c35-47f9-9881-b08814b8afbe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:30:23.102122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:23.102122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:23.102122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:23.102122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:23.102122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:23.102122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:23.102122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:23.102122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:23.102122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:23.102122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:23.102122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:23.102122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:30:23.102122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:30:23.102122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:30:23.102122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:30:23.103114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:30:23.103114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:30:23.103114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:30:23.103114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:30:23.103114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:23.103114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:23.103114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:23.103114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:23.103114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:23.103114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:23.103114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:23.103114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:23.103114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:23.103114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:23.103114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:23.103114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:23.104331 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:23.104331 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:23.104331 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:23.104331 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:23.104331 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:30:23.104331 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:30:23.104331 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:30:23.104331 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:30:23.104331 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:30:23.104331 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:30:23.104331 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:30:23.104331 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:23.104331 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 321/641] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 5 02:30:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:23.104331 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b7b41-8c35-47f9-9881-b08814b8afbe None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:23.136188 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1027af1-3de2-4731-bb61-ab0e3516b609 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:23.169527 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40760fa5-2f23-411a-b0f1-63a3e858de1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:23.170170 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40760fa5-2f23-411a-b0f1-63a3e858de1a None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:23.170453 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40760fa5-2f23-411a-b0f1-63a3e858de1a None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:23.170732 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40760fa5-2f23-411a-b0f1-63a3e858de1a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:23.180818 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40760fa5-2f23-411a-b0f1-63a3e858de1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:30:23.186139 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-40760fa5-2f23-411a-b0f1-63a3e858de1a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:30:23.186139 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:23.186139 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:23.186139 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:23.186139 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:23.186139 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:23.186139 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:23.186139 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:23.186139 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:23.186139 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:23.186139 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:23.186139 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:23.186139 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:30:23.186139 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:30:23.186139 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:30:23.186139 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:30:23.187327 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:30:23.187327 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:30:23.187327 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:30:23.187327 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:30:23.187327 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:23.187327 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:23.187327 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:23.187327 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:23.187327 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:23.187327 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:23.187327 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:23.187327 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:23.187327 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:23.187327 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:23.187327 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:23.187327 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:23.188292 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:23.188292 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:23.188292 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:23.188292 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:23.188292 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:30:23.188292 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:30:23.188292 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:30:23.188292 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:30:23.188292 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:30:23.188292 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:30:23.188292 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:30:23.188292 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:23.188292 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 321/642] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 5 02:30:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:23.191688 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40760fa5-2f23-411a-b0f1-63a3e858de1a None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:23.202913 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b7b41-8c35-47f9-9881-b08814b8afbe None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:23.237050 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac945d8-3071-422d-a014-93b522e1e684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:23.237677 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac945d8-3071-422d-a014-93b522e1e684 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:23.237954 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac945d8-3071-422d-a014-93b522e1e684 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:23.238227 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac945d8-3071-422d-a014-93b522e1e684 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:23.240879 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:23.248476 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac945d8-3071-422d-a014-93b522e1e684 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:23.249920 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac945d8-3071-422d-a014-93b522e1e684 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:23.264725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-2ac945d8-3071-422d-a014-93b522e1e684 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:23.264725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:23.264725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:23.264725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:23.264725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:23.264725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:23.264725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:23.264725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:23.264725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:23.264725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:23.264725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:23.264725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:23.264725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:23.264725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:23.264725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:23.265777 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:23.265777 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:23.265777 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:23.265777 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:23.265777 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:23.265777 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:23.265777 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:23.265777 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:23.265777 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:23.265777 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:23.265777 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:23.265777 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:23.265777 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:23.265777 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:23.265777 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:23.265777 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:23.265777 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:23.272229 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:23.272229 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:23.272229 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:23.272229 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:23.272229 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 322/643] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:23.272229 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac945d8-3071-422d-a014-93b522e1e684 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:23.280816 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:23.297316 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40760fa5-2f23-411a-b0f1-63a3e858de1a None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:23.330644 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617a58f-db2a-4376-9a5a-b13f0179bd58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:23.331302 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617a58f-db2a-4376-9a5a-b13f0179bd58 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:23.331577 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617a58f-db2a-4376-9a5a-b13f0179bd58 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:23.331856 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617a58f-db2a-4376-9a5a-b13f0179bd58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:23.368133 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac945d8-3071-422d-a014-93b522e1e684 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:23.399951 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0617a58f-db2a-4376-9a5a-b13f0179bd58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:23.401423 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0617a58f-db2a-4376-9a5a-b13f0179bd58 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:23.403466 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a22db5b-38e7-4a8f-9e4a-93652d08ff21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:23.404133 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a22db5b-38e7-4a8f-9e4a-93652d08ff21 None admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:23.404409 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a22db5b-38e7-4a8f-9e4a-93652d08ff21 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:23.404679 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a22db5b-38e7-4a8f-9e4a-93652d08ff21 None admin] PATH_INFO: `/v3/projects/63b323c02a614fc28aac6e7a060064ba/users/40f706f1eb2b4137afd367cb5060ced0/roles/2642213efc7d4861b3d3b4f5fbc9ad73` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:23.419059 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a22db5b-38e7-4a8f-9e4a-93652d08ff21 None admin] RBAC: Authorizing `identity:create_grant(project_id=63b323c02a614fc28aac6e7a060064ba, user_id=40f706f1eb2b4137afd367cb5060ced0, role_id=2642213efc7d4861b3d3b4f5fbc9ad73)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:23.420482 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a22db5b-38e7-4a8f-9e4a-93652d08ff21 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:23.480033 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:23.481706 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 323/644] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 5 02:30:23 2022] PUT /identity/v3/projects/63b323c02a614fc28aac6e7a060064ba/users/40f706f1eb2b4137afd367cb5060ced0/roles/2642213efc7d4861b3d3b4f5fbc9ad73 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:30:23.482498 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a22db5b-38e7-4a8f-9e4a-93652d08ff21 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:23.496380 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 322/645] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:30:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:30:23.497174 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617a58f-db2a-4376-9a5a-b13f0179bd58 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:23.542033 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:23.611064 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a22db5b-38e7-4a8f-9e4a-93652d08ff21 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:23.621430 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617a58f-db2a-4376-9a5a-b13f0179bd58 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:23.654013 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5006d-0f92-47c4-af70-acf96f496b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:23.654642 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5006d-0f92-47c4-af70-acf96f496b00 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:23.654921 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5006d-0f92-47c4-af70-acf96f496b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:23.655275 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5006d-0f92-47c4-af70-acf96f496b00 None admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:23.655983 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca5006d-0f92-47c4-af70-acf96f496b00 None admin] RBAC: Adding query filter params (name=service) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:23.656283 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca5006d-0f92-47c4-af70-acf96f496b00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:23.657719 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca5006d-0f92-47c4-af70-acf96f496b00 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:23.663378 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7fe90-e964-4386-9981-c9a9b273af90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:23.664086 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7fe90-e964-4386-9981-c9a9b273af90 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:23.664437 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7fe90-e964-4386-9981-c9a9b273af90 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:23.664781 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7fe90-e964-4386-9981-c9a9b273af90 None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:23.665587 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf7fe90-e964-4386-9981-c9a9b273af90 None admin] RBAC: Adding query filter params (name=service) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:23.665958 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf7fe90-e964-4386-9981-c9a9b273af90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:23.667196 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 324/646] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 5 02:30:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:23.667441 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf7fe90-e964-4386-9981-c9a9b273af90 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:23.668264 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5006d-0f92-47c4-af70-acf96f496b00 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:23.675707 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 323/647] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 5 02:30:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:23.677138 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7fe90-e964-4386-9981-c9a9b273af90 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:23.724938 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:23.776741 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:23.779623 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5006d-0f92-47c4-af70-acf96f496b00 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:23.781659 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7fe90-e964-4386-9981-c9a9b273af90 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:23.814506 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81f01b-c3bc-4c40-8d1c-5fb8dc4fa440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:23.815413 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81f01b-c3bc-4c40-8d1c-5fb8dc4fa440 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:23.815855 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81f01b-c3bc-4c40-8d1c-5fb8dc4fa440 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:23.816261 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81f01b-c3bc-4c40-8d1c-5fb8dc4fa440 None admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:23.817843 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81f01b-c3bc-4c40-8d1c-5fb8dc4fa440 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:23.818419 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81f01b-c3bc-4c40-8d1c-5fb8dc4fa440 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:23.820713 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81f01b-c3bc-4c40-8d1c-5fb8dc4fa440 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:23.820855 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e320a68-7fda-4715-8dc6-a6ca2a8424e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:23.821543 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e320a68-7fda-4715-8dc6-a6ca2a8424e2 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:23.821652 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e320a68-7fda-4715-8dc6-a6ca2a8424e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:23.821919 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e320a68-7fda-4715-8dc6-a6ca2a8424e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:23.834735 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e320a68-7fda-4715-8dc6-a6ca2a8424e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:23.835424 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 325/648] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:23.836227 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e320a68-7fda-4715-8dc6-a6ca2a8424e2 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:23.836530 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81f01b-c3bc-4c40-8d1c-5fb8dc4fa440 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:23.852573 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-4e320a68-7fda-4715-8dc6-a6ca2a8424e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:23.852573 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:23.852573 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:23.852573 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:23.852573 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:23.852573 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:23.852573 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:23.852573 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:23.852573 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:23.852573 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:23.852573 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:23.852573 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:23.852573 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:23.852573 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:23.852573 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:23.853669 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:23.853669 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:23.853669 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:23.853669 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:23.853669 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:23.853669 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:23.853669 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:23.853669 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:23.853669 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:23.853669 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:23.853669 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:23.853669 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:23.853669 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:23.853669 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:23.853669 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:23.853669 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:23.853669 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:23.854738 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:23.854738 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:23.854738 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:23.854738 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:23.858263 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 324/649] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:23.859097 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e320a68-7fda-4715-8dc6-a6ca2a8424e2 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:23.946693 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81f01b-c3bc-4c40-8d1c-5fb8dc4fa440 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:23.965379 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:23.969582 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e320a68-7fda-4715-8dc6-a6ca2a8424e2 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:23.981795 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9baaa-0f5d-485c-8e33-da5a4adf4507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:23.982517 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9baaa-0f5d-485c-8e33-da5a4adf4507 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:23.982861 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9baaa-0f5d-485c-8e33-da5a4adf4507 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:23.983527 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9baaa-0f5d-485c-8e33-da5a4adf4507 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:23.995086 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b9baaa-0f5d-485c-8e33-da5a4adf4507 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:23.996696 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b9baaa-0f5d-485c-8e33-da5a4adf4507 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:24.004788 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1192323-7da6-4bd5-bfb7-df286135478d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:24.005435 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1192323-7da6-4bd5-bfb7-df286135478d None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:24.005720 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1192323-7da6-4bd5-bfb7-df286135478d None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:24.005997 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1192323-7da6-4bd5-bfb7-df286135478d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:24.012337 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-b8b9baaa-0f5d-485c-8e33-da5a4adf4507 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:24.012337 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:24.012337 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:24.012337 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:24.012337 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:24.012337 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:24.012337 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:24.012337 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:24.012337 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:24.012337 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:24.012337 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:24.012337 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:24.012337 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:24.012337 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:24.012337 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:24.013191 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:24.013191 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:24.013191 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:24.013191 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:24.013191 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:24.013191 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:24.013191 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:24.013191 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:24.013191 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:24.013191 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:24.013191 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:24.013191 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:24.013191 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:24.013191 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:24.013191 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:24.013191 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:24.013191 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:24.014107 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:24.014107 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:24.014107 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:24.014107 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:24.018250 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 326/650] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:24.018379 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1192323-7da6-4bd5-bfb7-df286135478d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:24.019091 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9baaa-0f5d-485c-8e33-da5a4adf4507 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:24.020074 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1192323-7da6-4bd5-bfb7-df286135478d None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:24.039178 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:24.040166 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-c1192323-7da6-4bd5-bfb7-df286135478d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:24.040166 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:24.040166 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:24.040166 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:24.040166 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:24.040166 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:24.040166 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:24.040166 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:24.040166 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:24.040166 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:24.040166 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:24.040166 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:24.040166 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:24.040166 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:24.040166 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:24.041061 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:24.041061 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:24.041061 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:24.041061 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:24.041061 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:24.041061 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:24.041061 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:24.041061 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:24.041061 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:24.041061 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:24.041061 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:24.041061 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:24.041061 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:24.041061 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:24.041061 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:24.041061 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:24.041061 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:24.041951 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:24.041951 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:24.041951 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:24.041951 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:24.041951 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 325/651] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:24.042230 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1192323-7da6-4bd5-bfb7-df286135478d None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:24.135046 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9baaa-0f5d-485c-8e33-da5a4adf4507 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:24.150695 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1192323-7da6-4bd5-bfb7-df286135478d None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:24.173086 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3144fd66-6f8d-47cf-b202-7519ae272f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:24.173721 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144fd66-6f8d-47cf-b202-7519ae272f20 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:24.173999 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144fd66-6f8d-47cf-b202-7519ae272f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:24.174270 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144fd66-6f8d-47cf-b202-7519ae272f20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:24.181987 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3144fd66-6f8d-47cf-b202-7519ae272f20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:24.183557 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3144fd66-6f8d-47cf-b202-7519ae272f20 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:24.190727 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107050c0-486f-49a1-b56a-06975fd9a7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:24.191472 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107050c0-486f-49a1-b56a-06975fd9a7fe None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:24.191828 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107050c0-486f-49a1-b56a-06975fd9a7fe None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:24.192172 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107050c0-486f-49a1-b56a-06975fd9a7fe None admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:24.192962 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107050c0-486f-49a1-b56a-06975fd9a7fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:24.193329 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107050c0-486f-49a1-b56a-06975fd9a7fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:24.194756 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107050c0-486f-49a1-b56a-06975fd9a7fe None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:24.194851 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-3144fd66-6f8d-47cf-b202-7519ae272f20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:24.194851 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:24.194851 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:24.194851 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:24.194851 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:24.194851 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:24.194851 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:24.194851 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:24.194851 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:24.194851 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:24.194851 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:24.194851 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:24.194851 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:30:24.194851 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:30:24.194851 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:30:24.195716 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:30:24.195716 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:24.195716 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:24.195716 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:24.195716 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:24.195716 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:24.195716 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:24.195716 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:24.195716 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:24.195716 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:24.195716 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:24.195716 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:24.195716 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:24.195716 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:24.195716 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:24.195716 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:24.195716 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:24.196607 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:30:24.196607 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:30:24.196607 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:30:24.196607 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:30:24.196607 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:30:24.196607 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:30:24.196607 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:24.196607 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:24.201291 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 327/652] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:30:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:24.201720 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3144fd66-6f8d-47cf-b202-7519ae272f20 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:24.209240 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 326/653] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:24.214364 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107050c0-486f-49a1-b56a-06975fd9a7fe None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:24.228419 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:24.290398 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:24.321601 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3144fd66-6f8d-47cf-b202-7519ae272f20 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:24.326240 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107050c0-486f-49a1-b56a-06975fd9a7fe None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:24.359504 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee68c4-b56f-4685-8cf8-98ec1b831bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:24.360370 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee68c4-b56f-4685-8cf8-98ec1b831bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:24.360729 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee68c4-b56f-4685-8cf8-98ec1b831bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:24.361008 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee68c4-b56f-4685-8cf8-98ec1b831bd8 None admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:24.361695 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee68c4-b56f-4685-8cf8-98ec1b831bd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:24.361999 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee68c4-b56f-4685-8cf8-98ec1b831bd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:24.363435 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee68c4-b56f-4685-8cf8-98ec1b831bd8 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:24.365671 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc2fb60-b506-41db-b139-b45c23be313f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:24.366817 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2fb60-b506-41db-b139-b45c23be313f None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:24.367246 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2fb60-b506-41db-b139-b45c23be313f None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:24.367626 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2fb60-b506-41db-b139-b45c23be313f None admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:24.368451 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc2fb60-b506-41db-b139-b45c23be313f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:24.368854 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc2fb60-b506-41db-b139-b45c23be313f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:24.370390 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc2fb60-b506-41db-b139-b45c23be313f None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:24.381147 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 328/654] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:24.381147 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee68c4-b56f-4685-8cf8-98ec1b831bd8 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:24.386085 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 327/655] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:24.391212 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc2fb60-b506-41db-b139-b45c23be313f None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:24.458444 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:24.491592 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee68c4-b56f-4685-8cf8-98ec1b831bd8 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:24.492109 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc2fb60-b506-41db-b139-b45c23be313f None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:24.525837 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:24.531035 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e2a92-13c4-4444-abc2-5fb0a0e8abe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:24.531722 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e2a92-13c4-4444-abc2-5fb0a0e8abe1 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:24.532075 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e2a92-13c4-4444-abc2-5fb0a0e8abe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:24.532415 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e2a92-13c4-4444-abc2-5fb0a0e8abe1 None admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:24.532667 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a102c1-3e1e-4d35-8d96-322314738781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:24.533344 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e2a92-13c4-4444-abc2-5fb0a0e8abe1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:24.533439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a102c1-3e1e-4d35-8d96-322314738781 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:24.533772 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a102c1-3e1e-4d35-8d96-322314738781 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:24.533909 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e2a92-13c4-4444-abc2-5fb0a0e8abe1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:24.534048 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a102c1-3e1e-4d35-8d96-322314738781 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:24.536075 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e2a92-13c4-4444-abc2-5fb0a0e8abe1 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:24.542113 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a102c1-3e1e-4d35-8d96-322314738781 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:24.543581 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a102c1-3e1e-4d35-8d96-322314738781 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:24.548013 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 329/656] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 5 02:30:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:24.553592 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e2a92-13c4-4444-abc2-5fb0a0e8abe1 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:24.555263 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-90a102c1-3e1e-4d35-8d96-322314738781 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:24.555263 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:24.555263 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:24.555263 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:24.555263 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:24.555263 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:24.555263 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:24.555263 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:24.555263 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:24.555263 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:24.555263 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:24.555263 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:24.555263 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:30:24.555263 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:30:24.555263 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:30:24.556368 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:30:24.556368 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:24.556368 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:24.556368 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:24.556368 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:24.556368 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:24.556368 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:24.556368 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:24.556368 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:24.556368 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:24.556368 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:24.556368 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:24.556368 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:24.556368 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:24.556368 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:24.556368 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:24.556368 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:24.557483 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:30:24.557483 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:30:24.557483 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:30:24.557483 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:30:24.557483 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:30:24.557483 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:30:24.557483 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:24.557483 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:24.561032 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 328/657] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:30:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:24.561860 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a102c1-3e1e-4d35-8d96-322314738781 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:24.662728 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e2a92-13c4-4444-abc2-5fb0a0e8abe1 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:24.682886 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a102c1-3e1e-4d35-8d96-322314738781 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:24.698640 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054a186-5b33-4eb0-aeeb-f3d8adb7b4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:24.699305 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054a186-5b33-4eb0-aeeb-f3d8adb7b4ee None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:24.699589 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054a186-5b33-4eb0-aeeb-f3d8adb7b4ee None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:24.699861 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054a186-5b33-4eb0-aeeb-f3d8adb7b4ee None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:24.709269 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4054a186-5b33-4eb0-aeeb-f3d8adb7b4ee None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:24.710130 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4054a186-5b33-4eb0-aeeb-f3d8adb7b4ee None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:24.714052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:24.720863 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d9e2b-8960-41dc-87fe-3152d500aba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:24.721646 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d9e2b-8960-41dc-87fe-3152d500aba1 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:24.722080 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d9e2b-8960-41dc-87fe-3152d500aba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:24.722491 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-4054a186-5b33-4eb0-aeeb-f3d8adb7b4ee None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 05 02:30:24.722491 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:24.722491 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:24.722491 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:24.722491 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:24.722491 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:24.722491 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:24.722491 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:24.722491 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:24.722491 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:24.722491 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:24.722491 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:24.722491 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:30:24.722491 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:30:24.722491 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:30:24.722491 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:30:24.729947 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:24.729947 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:24.729947 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:30:24.729947 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:24.729947 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:30:24.729947 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:24.729947 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:24.729947 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:24.729947 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:24.729947 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:24.729947 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:24.729947 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:24.729947 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:24.729947 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:24.729947 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:24.729947 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:24.729947 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:24.729947 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:24.731169 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:24.731169 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:24.731169 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:30:24.731169 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:30:24.731169 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:30:24.731169 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:30:24.731169 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:30:24.731169 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:30:24.731169 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 05 02:30:24.731169 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:24.731858 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d9e2b-8960-41dc-87fe-3152d500aba1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:24.731954 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 330/658] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 5 02:30:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:24.731954 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054a186-5b33-4eb0-aeeb-f3d8adb7b4ee None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:24.738934 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d9e2b-8960-41dc-87fe-3152d500aba1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:24.740512 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d9e2b-8960-41dc-87fe-3152d500aba1 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:24.753382 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-257d9e2b-8960-41dc-87fe-3152d500aba1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 05 02:30:24.753382 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:24.753382 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:24.753382 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:24.753382 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:24.753382 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:24.753382 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:24.753382 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:24.753382 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:24.753382 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:24.753382 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:24.753382 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:24.753382 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:30:24.753382 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:30:24.753382 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:30:24.753382 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:30:24.754402 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:24.754402 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:24.754402 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:30:24.754402 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:24.754402 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:30:24.754402 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:24.754402 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:24.754402 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:24.754402 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:24.754402 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:24.754402 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:24.754402 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:24.754402 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:24.754402 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:24.754402 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:24.754402 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:24.754402 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:24.754402 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:24.755370 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:24.755370 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:24.755370 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:30:24.755370 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:30:24.755370 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:30:24.755370 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:30:24.755370 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:30:24.755370 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:30:24.755370 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 05 02:30:24.755370 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:24.755370 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 329/659] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:30:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:24.755370 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d9e2b-8960-41dc-87fe-3152d500aba1 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:24.788576 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:24.842480 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054a186-5b33-4eb0-aeeb-f3d8adb7b4ee None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:24.862073 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d9e2b-8960-41dc-87fe-3152d500aba1 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:24.881694 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d2129-c68a-4a49-83e7-fdf835d5da06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:24.882456 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d2129-c68a-4a49-83e7-fdf835d5da06 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:24.882830 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d2129-c68a-4a49-83e7-fdf835d5da06 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:24.883622 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d2129-c68a-4a49-83e7-fdf835d5da06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:24.885432 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d2129-c68a-4a49-83e7-fdf835d5da06 None admin] RBAC: Adding query filter params (role.id=2642213efc7d4861b3d3b4f5fbc9ad73, scope.project.id=63b323c02a614fc28aac6e7a060064ba, user.id=55374d3bccd541c9a8f82da9b21c2fb8) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:24.885432 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d2129-c68a-4a49-83e7-fdf835d5da06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:24.887919 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d2129-c68a-4a49-83e7-fdf835d5da06 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:24.895856 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 331/660] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:30:24 2022] GET /identity/v3/role_assignments?user.id=55374d3bccd541c9a8f82da9b21c2fb8&scope.project.id=63b323c02a614fc28aac6e7a060064ba&role.id=2642213efc7d4861b3d3b4f5fbc9ad73 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:24.897984 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b3dce-1471-458b-a743-6c8d4c8b687d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:24.898600 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b3dce-1471-458b-a743-6c8d4c8b687d None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:24.898879 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b3dce-1471-458b-a743-6c8d4c8b687d None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:24.899199 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b3dce-1471-458b-a743-6c8d4c8b687d None admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:24.899952 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b3dce-1471-458b-a743-6c8d4c8b687d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:24.900256 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b3dce-1471-458b-a743-6c8d4c8b687d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:24.901730 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b3dce-1471-458b-a743-6c8d4c8b687d None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:24.905150 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d2129-c68a-4a49-83e7-fdf835d5da06 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:24.926163 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 330/661] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 5 02:30:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:24.926163 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b3dce-1471-458b-a743-6c8d4c8b687d None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:25.006412 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:25.034473 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d2129-c68a-4a49-83e7-fdf835d5da06 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:25.052855 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:25.064612 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b3dce-1471-458b-a743-6c8d4c8b687d None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:25.077333 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85228bef-e9af-4b42-95fd-ab60b959c25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:25.077709 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85228bef-e9af-4b42-95fd-ab60b959c25e None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:25.077966 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85228bef-e9af-4b42-95fd-ab60b959c25e None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:25.078241 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85228bef-e9af-4b42-95fd-ab60b959c25e None admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:25.079140 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85228bef-e9af-4b42-95fd-ab60b959c25e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:25.079448 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85228bef-e9af-4b42-95fd-ab60b959c25e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:25.080894 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85228bef-e9af-4b42-95fd-ab60b959c25e None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:25.105618 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 332/662] 10.222.0.42 () {56 vars in 1139 bytes} [Fri Aug 5 02:30:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:25.105618 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85228bef-e9af-4b42-95fd-ab60b959c25e None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:25.116572 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c169b3-1d7d-4d96-a9ec-077a106c0e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:25.117200 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c169b3-1d7d-4d96-a9ec-077a106c0e5f None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:25.117481 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c169b3-1d7d-4d96-a9ec-077a106c0e5f None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:25.117752 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c169b3-1d7d-4d96-a9ec-077a106c0e5f None admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:25.118556 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c169b3-1d7d-4d96-a9ec-077a106c0e5f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:25.118861 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c169b3-1d7d-4d96-a9ec-077a106c0e5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:25.120383 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c169b3-1d7d-4d96-a9ec-077a106c0e5f None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:25.146709 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 331/663] 10.222.0.42 () {56 vars in 1137 bytes} [Fri Aug 5 02:30:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:25.147972 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c169b3-1d7d-4d96-a9ec-077a106c0e5f None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:25.255686 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85228bef-e9af-4b42-95fd-ab60b959c25e None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:25.284437 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c169b3-1d7d-4d96-a9ec-077a106c0e5f None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:25.309726 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2819c5-b649-4975-b26b-f965688235ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:25.310693 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2819c5-b649-4975-b26b-f965688235ad None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:25.311217 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2819c5-b649-4975-b26b-f965688235ad None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:25.311694 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2819c5-b649-4975-b26b-f965688235ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:25.313136 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2819c5-b649-4975-b26b-f965688235ad None admin] RBAC: Adding query filter params (role.id=2642213efc7d4861b3d3b4f5fbc9ad73, scope.project.id=63b323c02a614fc28aac6e7a060064ba, user.id=116f66d7dd7b42878f71bd29dc55729c) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:25.313923 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2819c5-b649-4975-b26b-f965688235ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:25.315309 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:25.316602 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2819c5-b649-4975-b26b-f965688235ad None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:25.330991 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20076132-750d-483b-9f2a-78d6b5a799d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:25.330991 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20076132-750d-483b-9f2a-78d6b5a799d2 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:25.330991 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20076132-750d-483b-9f2a-78d6b5a799d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:25.330991 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20076132-750d-483b-9f2a-78d6b5a799d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:25.331572 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 333/664] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:30:25 2022] GET /identity/v3/role_assignments?user.id=116f66d7dd7b42878f71bd29dc55729c&scope.project.id=63b323c02a614fc28aac6e7a060064ba&role.id=2642213efc7d4861b3d3b4f5fbc9ad73 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:25.333189 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2819c5-b649-4975-b26b-f965688235ad None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:25.411823 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:25.481347 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20076132-750d-483b-9f2a-78d6b5a799d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:25.485057 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20076132-750d-483b-9f2a-78d6b5a799d2 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:25.537714 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2819c5-b649-4975-b26b-f965688235ad None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:25.602403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c845ff-c08d-4623-8f6c-4334b838299d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:25.602403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c845ff-c08d-4623-8f6c-4334b838299d None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:25.602403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c845ff-c08d-4623-8f6c-4334b838299d None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:25.602812 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c845ff-c08d-4623-8f6c-4334b838299d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:25.628801 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 332/665] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:30:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:30:25.629946 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac98a6f-064c-4ad1-b4be-d74684a0a346 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:25.630234 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac98a6f-064c-4ad1-b4be-d74684a0a346 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:25.630512 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac98a6f-064c-4ad1-b4be-d74684a0a346 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:25.632021 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 333/666] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:30:25.636044 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac98a6f-064c-4ad1-b4be-d74684a0a346 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:25.655305 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:25.693615 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c845ff-c08d-4623-8f6c-4334b838299d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:25.695619 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c845ff-c08d-4623-8f6c-4334b838299d None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:25.745527 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:25.761110 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac98a6f-064c-4ad1-b4be-d74684a0a346 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:25.799356 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b3b02-2c62-4469-9d7f-9a2b3509ed34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:25.799923 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b3b02-2c62-4469-9d7f-9a2b3509ed34 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:25.800207 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b3b02-2c62-4469-9d7f-9a2b3509ed34 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:25.800485 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b3b02-2c62-4469-9d7f-9a2b3509ed34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:25.811794 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b3b02-2c62-4469-9d7f-9a2b3509ed34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:25.813257 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b3b02-2c62-4469-9d7f-9a2b3509ed34 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:25.816034 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 334/667] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:30:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:30:25.817681 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9dad0-95a1-479c-8936-9bfd7e0eb961 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:25.818191 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9dad0-95a1-479c-8936-9bfd7e0eb961 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:25.818670 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9dad0-95a1-479c-8936-9bfd7e0eb961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:25.830429 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-c44b3b02-2c62-4469-9d7f-9a2b3509ed34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:25.830429 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:25.830429 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:25.830429 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:25.830429 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:25.830429 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:25.830429 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:25.830429 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:25.830429 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:25.830429 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:25.830429 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:25.830429 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:25.830429 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:25.830429 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:25.830429 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:25.831426 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:25.831426 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:25.831426 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:25.831426 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:25.831426 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:25.831426 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:25.831426 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:25.831426 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:25.831426 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:25.831426 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:25.831426 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:25.831426 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:25.831426 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:25.831426 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:25.831426 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:25.831426 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:25.831426 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:25.832389 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:25.832389 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:25.832389 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:25.832389 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:25.832389 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 334/668] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:30:25.833151 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b3b02-2c62-4469-9d7f-9a2b3509ed34 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:25.840813 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-6ad9dad0-95a1-479c-8936-9bfd7e0eb961 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:25.842288 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-6ad9dad0-95a1-479c-8936-9bfd7e0eb961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:25.903340 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:25.935132 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 335/669] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:30:25.936366 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9dad0-95a1-479c-8936-9bfd7e0eb961 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:25.950999 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b3b02-2c62-4469-9d7f-9a2b3509ed34 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:25.986975 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f913e8e-26e2-453b-ba5a-cde69aac58e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:25.987649 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f913e8e-26e2-453b-ba5a-cde69aac58e1 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:25.987931 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f913e8e-26e2-453b-ba5a-cde69aac58e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:25.988207 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f913e8e-26e2-453b-ba5a-cde69aac58e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:25.999602 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f913e8e-26e2-453b-ba5a-cde69aac58e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:26.001076 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f913e8e-26e2-453b-ba5a-cde69aac58e1 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:26.015876 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-4f913e8e-26e2-453b-ba5a-cde69aac58e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:26.015876 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:26.015876 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:26.015876 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:26.015876 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:26.015876 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:26.015876 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:26.015876 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:26.015876 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:26.015876 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:26.015876 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:26.015876 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:26.015876 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:26.015876 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:26.015876 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:26.016806 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:26.016806 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:26.016806 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:26.016806 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:26.016806 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:26.016806 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:26.016806 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:26.016806 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:26.016806 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:26.016806 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:26.016806 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:26.016806 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:26.016806 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:26.016806 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:26.016806 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:26.016806 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:26.016806 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:26.017700 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:26.017700 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:26.017700 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:26.017700 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:26.017700 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 335/670] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:26.018397 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f913e8e-26e2-453b-ba5a-cde69aac58e1 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:26.033255 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:26.068452 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9dad0-95a1-479c-8936-9bfd7e0eb961 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:26.108532 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4bde0-8b26-43ee-8e13-e78a2de81cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:26.109507 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4bde0-8b26-43ee-8e13-e78a2de81cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:26.109993 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4bde0-8b26-43ee-8e13-e78a2de81cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:26.110466 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4bde0-8b26-43ee-8e13-e78a2de81cf0 None admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:26.111401 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4bde0-8b26-43ee-8e13-e78a2de81cf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:26.111930 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4bde0-8b26-43ee-8e13-e78a2de81cf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:26.113564 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4bde0-8b26-43ee-8e13-e78a2de81cf0 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:26.126302 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 336/671] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:26.127535 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4bde0-8b26-43ee-8e13-e78a2de81cf0 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:26.132515 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f913e8e-26e2-453b-ba5a-cde69aac58e1 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:26.146351 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:26.168439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf18e3-6cc7-4f55-ac6a-b1a7672af1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:26.169098 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf18e3-6cc7-4f55-ac6a-b1a7672af1a4 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:26.169381 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf18e3-6cc7-4f55-ac6a-b1a7672af1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:26.169662 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf18e3-6cc7-4f55-ac6a-b1a7672af1a4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:26.180613 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cf18e3-6cc7-4f55-ac6a-b1a7672af1a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:30:26.185592 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-66cf18e3-6cc7-4f55-ac6a-b1a7672af1a4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:30:26.185592 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:26.185592 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:26.185592 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:26.185592 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:26.185592 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:26.185592 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:26.185592 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:26.185592 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:26.185592 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:26.185592 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:26.185592 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:26.185592 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:30:26.185592 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:30:26.185592 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:30:26.185592 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:30:26.186572 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:30:26.186572 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:30:26.186572 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:30:26.186572 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:30:26.186572 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:26.186572 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:26.186572 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:26.186572 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:26.186572 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:26.186572 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:26.186572 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:26.186572 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:26.186572 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:26.186572 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:26.186572 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:26.186572 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:26.187533 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:26.187533 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:26.187533 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:26.187533 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:26.187533 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:30:26.187533 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:30:26.187533 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:30:26.187533 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:30:26.187533 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:30:26.187533 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:30:26.187533 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:30:26.187533 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:26.187533 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 336/672] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 5 02:30:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:26.188235 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf18e3-6cc7-4f55-ac6a-b1a7672af1a4 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:26.252149 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4bde0-8b26-43ee-8e13-e78a2de81cf0 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:26.289168 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267d7e0-f93f-4a04-8c45-3cded6f340b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:26.290112 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267d7e0-f93f-4a04-8c45-3cded6f340b6 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:26.290597 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267d7e0-f93f-4a04-8c45-3cded6f340b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:26.291135 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267d7e0-f93f-4a04-8c45-3cded6f340b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:26.292046 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267d7e0-f93f-4a04-8c45-3cded6f340b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:26.292551 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267d7e0-f93f-4a04-8c45-3cded6f340b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:26.294187 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267d7e0-f93f-4a04-8c45-3cded6f340b6 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:26.306687 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 337/673] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:26.306980 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:26.308375 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267d7e0-f93f-4a04-8c45-3cded6f340b6 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:26.316002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf18e3-6cc7-4f55-ac6a-b1a7672af1a4 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:26.358500 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6872d-daf0-4122-a107-e917bd73f7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:26.359194 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6872d-daf0-4122-a107-e917bd73f7cb None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:26.359485 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6872d-daf0-4122-a107-e917bd73f7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:26.359760 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6872d-daf0-4122-a107-e917bd73f7cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:26.367231 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6872d-daf0-4122-a107-e917bd73f7cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:26.368557 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6872d-daf0-4122-a107-e917bd73f7cb None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:26.381119 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-eaa6872d-daf0-4122-a107-e917bd73f7cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:26.381119 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:26.381119 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:26.381119 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:26.381119 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:26.381119 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:26.381119 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:26.381119 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:26.381119 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:26.381119 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:26.381119 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:26.381119 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:26.381119 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:30:26.381119 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:30:26.381119 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:30:26.382008 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:30:26.382008 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:26.382008 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:26.382008 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:26.382008 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:26.382008 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:26.382008 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:26.382008 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:26.382008 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:26.382008 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:26.382008 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:26.382008 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:26.382008 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:26.382008 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:26.382008 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:26.382008 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:26.382008 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:26.382895 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:30:26.382895 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:30:26.382895 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:30:26.382895 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:30:26.382895 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:30:26.382895 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:30:26.382895 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:26.382895 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:26.382895 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 337/674] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:30:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:26.383436 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6872d-daf0-4122-a107-e917bd73f7cb None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:26.416622 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:26.419524 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267d7e0-f93f-4a04-8c45-3cded6f340b6 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:26.456742 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b8248-2c17-4539-9413-49f419b8cb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:26.458337 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b8248-2c17-4539-9413-49f419b8cb16 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:26.458855 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b8248-2c17-4539-9413-49f419b8cb16 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:26.459391 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b8248-2c17-4539-9413-49f419b8cb16 None admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:26.460355 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b8248-2c17-4539-9413-49f419b8cb16 None admin] RBAC: Adding query filter params (name=service) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:26.460859 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b8248-2c17-4539-9413-49f419b8cb16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:26.462428 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b8248-2c17-4539-9413-49f419b8cb16 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:26.475517 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 338/675] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 5 02:30:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:26.476717 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b8248-2c17-4539-9413-49f419b8cb16 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:26.492975 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6872d-daf0-4122-a107-e917bd73f7cb None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:26.535135 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:26.536242 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f175c0-f35e-4f13-9f98-e09b6d823fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:26.536841 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f175c0-f35e-4f13-9f98-e09b6d823fcd None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:26.537111 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f175c0-f35e-4f13-9f98-e09b6d823fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:26.537393 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f175c0-f35e-4f13-9f98-e09b6d823fcd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:26.544504 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f175c0-f35e-4f13-9f98-e09b6d823fcd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:26.545971 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f175c0-f35e-4f13-9f98-e09b6d823fcd None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:26.563290 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-57f175c0-f35e-4f13-9f98-e09b6d823fcd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:26.563290 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:26.563290 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:26.563290 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:26.563290 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:26.563290 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:26.563290 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:26.563290 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:26.563290 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:26.563290 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:26.563290 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:26.563290 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:26.563290 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:30:26.563290 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:30:26.563290 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:30:26.564271 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:30:26.564271 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:26.564271 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:26.564271 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:26.564271 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:26.564271 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:26.564271 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:26.564271 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:26.564271 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:26.564271 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:26.564271 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:26.564271 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:26.564271 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:26.564271 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:26.564271 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:26.564271 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:26.564271 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:26.565154 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:30:26.565154 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:30:26.565154 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:30:26.565154 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:30:26.565154 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:30:26.565154 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:30:26.565154 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:26.565154 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:26.569743 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 338/676] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:30:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:26.570600 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f175c0-f35e-4f13-9f98-e09b6d823fcd None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:26.597010 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b8248-2c17-4539-9413-49f419b8cb16 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:26.633650 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2536c-852d-4c73-b0f2-9d5535bc6557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:26.634667 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2536c-852d-4c73-b0f2-9d5535bc6557 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:26.635191 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2536c-852d-4c73-b0f2-9d5535bc6557 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:26.635715 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2536c-852d-4c73-b0f2-9d5535bc6557 None admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:26.636685 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab2536c-852d-4c73-b0f2-9d5535bc6557 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:26.637193 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab2536c-852d-4c73-b0f2-9d5535bc6557 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:26.638906 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab2536c-852d-4c73-b0f2-9d5535bc6557 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:26.654161 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 339/677] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 5 02:30:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:26.655366 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2536c-852d-4c73-b0f2-9d5535bc6557 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:26.680185 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:26.690171 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f175c0-f35e-4f13-9f98-e09b6d823fcd None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:26.727669 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df311b0b-61c5-4b35-9978-463f3fb33acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:26.728025 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df311b0b-61c5-4b35-9978-463f3fb33acc None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:26.728313 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df311b0b-61c5-4b35-9978-463f3fb33acc None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:26.728598 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df311b0b-61c5-4b35-9978-463f3fb33acc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:26.740560 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df311b0b-61c5-4b35-9978-463f3fb33acc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:26.742155 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df311b0b-61c5-4b35-9978-463f3fb33acc None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:26.759388 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-df311b0b-61c5-4b35-9978-463f3fb33acc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:26.759388 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:26.759388 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:26.759388 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:26.759388 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:26.759388 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:26.759388 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:26.759388 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:26.759388 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:26.759388 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:26.759388 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:26.759388 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:26.759388 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:26.759388 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:26.759388 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:26.760355 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:26.760355 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:26.760355 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:26.760355 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:26.760355 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:26.760355 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:26.760355 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:26.760355 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:26.760355 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:26.760355 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:26.760355 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:26.760355 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:26.760355 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:26.760355 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:26.760355 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:26.760355 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:26.760355 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:26.761253 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:26.761253 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:26.761253 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:26.761253 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:26.765112 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 339/678] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:26.765961 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df311b0b-61c5-4b35-9978-463f3fb33acc None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:26.768317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2536c-852d-4c73-b0f2-9d5535bc6557 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:26.781229 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:26.807895 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4625b87-0f99-474c-a664-17e2c8643372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:26.808699 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4625b87-0f99-474c-a664-17e2c8643372 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:26.809034 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4625b87-0f99-474c-a664-17e2c8643372 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:26.809411 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4625b87-0f99-474c-a664-17e2c8643372 None admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:26.810664 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4625b87-0f99-474c-a664-17e2c8643372 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:26.810664 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4625b87-0f99-474c-a664-17e2c8643372 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:26.812297 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4625b87-0f99-474c-a664-17e2c8643372 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:26.831051 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 340/679] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 5 02:30:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:26.831051 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4625b87-0f99-474c-a664-17e2c8643372 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:26.902002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df311b0b-61c5-4b35-9978-463f3fb33acc None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:26.938516 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891db94-9502-4785-9c06-8e5556589703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:26.939161 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891db94-9502-4785-9c06-8e5556589703 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:26.939446 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891db94-9502-4785-9c06-8e5556589703 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:26.939723 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891db94-9502-4785-9c06-8e5556589703 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:26.940155 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4625b87-0f99-474c-a664-17e2c8643372 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:26.940569 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891db94-9502-4785-9c06-8e5556589703 None admin] RBAC: Adding query filter params (role.id=2642213efc7d4861b3d3b4f5fbc9ad73, scope.project.id=63b323c02a614fc28aac6e7a060064ba, user.id=a0035fcd8b06400bb7946f7ac37393a8) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:26.940879 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891db94-9502-4785-9c06-8e5556589703 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:26.943045 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891db94-9502-4785-9c06-8e5556589703 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:26.949549 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 340/680] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:30:26 2022] GET /identity/v3/role_assignments?user.id=a0035fcd8b06400bb7946f7ac37393a8&scope.project.id=63b323c02a614fc28aac6e7a060064ba&role.id=2642213efc7d4861b3d3b4f5fbc9ad73 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:26.950544 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891db94-9502-4785-9c06-8e5556589703 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:26.962986 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:26.977344 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0722b03-d259-4faf-b88f-74e55d951693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:26.985131 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0722b03-d259-4faf-b88f-74e55d951693 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:26.985131 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0722b03-d259-4faf-b88f-74e55d951693 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:26.985131 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0722b03-d259-4faf-b88f-74e55d951693 None admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:26.985131 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0722b03-d259-4faf-b88f-74e55d951693 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:26.985131 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0722b03-d259-4faf-b88f-74e55d951693 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:26.985131 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0722b03-d259-4faf-b88f-74e55d951693 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:26.997850 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 341/681] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:27.004844 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0722b03-d259-4faf-b88f-74e55d951693 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:27.059973 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:27.143890 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891db94-9502-4785-9c06-8e5556589703 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:27.187402 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0722b03-d259-4faf-b88f-74e55d951693 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:27.194762 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a83c24-a227-4f51-9397-7be6335e2cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:27.196057 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a83c24-a227-4f51-9397-7be6335e2cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:27.196057 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a83c24-a227-4f51-9397-7be6335e2cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:27.196057 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a83c24-a227-4f51-9397-7be6335e2cb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:27.197228 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a83c24-a227-4f51-9397-7be6335e2cb3 None admin] RBAC: Adding query filter params (role.id=2642213efc7d4861b3d3b4f5fbc9ad73, scope.project.id=63b323c02a614fc28aac6e7a060064ba, user.id=e60a3568771842e294858e5868068f84) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:27.197551 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a83c24-a227-4f51-9397-7be6335e2cb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:27.200216 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a83c24-a227-4f51-9397-7be6335e2cb3 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:27.208760 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 341/682] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:30:26 2022] GET /identity/v3/role_assignments?user.id=e60a3568771842e294858e5868068f84&scope.project.id=63b323c02a614fc28aac6e7a060064ba&role.id=2642213efc7d4861b3d3b4f5fbc9ad73 => generated 608 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:27.209994 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1ccf4-1c6d-463c-86e3-df5ca4acf03b None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:27.210284 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1ccf4-1c6d-463c-86e3-df5ca4acf03b None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:27.210561 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1ccf4-1c6d-463c-86e3-df5ca4acf03b None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:27.212060 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 342/683] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:30:27.223219 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a3564-ed84-4e20-bdc9-87cc587b2fb6 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:27.223542 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a3564-ed84-4e20-bdc9-87cc587b2fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:27.223776 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a3564-ed84-4e20-bdc9-87cc587b2fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:27.256622 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a1936-5e83-47de-9251-2673fb2a6646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:27.257295 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a1936-5e83-47de-9251-2673fb2a6646 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:27.257667 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a1936-5e83-47de-9251-2673fb2a6646 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:27.257988 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a1936-5e83-47de-9251-2673fb2a6646 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:27.266584 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a1936-5e83-47de-9251-2673fb2a6646 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:27.268376 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a1936-5e83-47de-9251-2673fb2a6646 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:27.272551 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-f15a3564-ed84-4e20-bdc9-87cc587b2fb6 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:27.274112 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-f15a3564-ed84-4e20-bdc9-87cc587b2fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:27.294593 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-c11a1936-5e83-47de-9251-2673fb2a6646 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 05 02:30:27.294593 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:27.294593 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:27.294593 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:27.294593 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:27.294593 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:27.294593 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:27.294593 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:27.294593 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:27.294593 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:27.294593 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:27.294593 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:27.294593 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:30:27.294593 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:30:27.294593 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:30:27.294593 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:30:27.295659 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:27.295659 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:27.295659 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:30:27.295659 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:27.295659 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:30:27.295659 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:27.295659 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:27.295659 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:27.295659 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:27.295659 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:27.295659 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:27.295659 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:27.295659 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:27.295659 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:27.295659 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:27.295659 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:27.295659 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:27.295659 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:27.297064 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:27.297064 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:27.297064 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:30:27.297064 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:30:27.297064 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:30:27.297064 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:30:27.297064 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:30:27.297064 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:30:27.297064 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 05 02:30:27.297064 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:27.297064 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 342/684] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 5 02:30:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:27.302745 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a1936-5e83-47de-9251-2673fb2a6646 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:27.393584 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 343/685] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:30:27.419905 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a3564-ed84-4e20-bdc9-87cc587b2fb6 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:27.423245 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:27.484216 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:27.497735 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a1936-5e83-47de-9251-2673fb2a6646 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:27.538493 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59cfc87-6474-46fc-a02c-4769973d825f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:27.539634 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59cfc87-6474-46fc-a02c-4769973d825f None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:27.540132 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59cfc87-6474-46fc-a02c-4769973d825f None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:27.540637 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59cfc87-6474-46fc-a02c-4769973d825f None admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:27.541652 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59cfc87-6474-46fc-a02c-4769973d825f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:27.542255 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59cfc87-6474-46fc-a02c-4769973d825f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:27.543997 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59cfc87-6474-46fc-a02c-4769973d825f None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:27.557672 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a3564-ed84-4e20-bdc9-87cc587b2fb6 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:27.568507 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 343/686] 10.222.0.42 () {56 vars in 1135 bytes} [Fri Aug 5 02:30:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:27.574415 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59cfc87-6474-46fc-a02c-4769973d825f None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:27.602761 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac744be0-02e9-4858-a882-daa4855098cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:27.603824 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac744be0-02e9-4858-a882-daa4855098cb None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:27.604341 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac744be0-02e9-4858-a882-daa4855098cb None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:27.604830 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac744be0-02e9-4858-a882-daa4855098cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:27.617181 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac744be0-02e9-4858-a882-daa4855098cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:30:27.622842 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-ac744be0-02e9-4858-a882-daa4855098cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:30:27.622842 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:27.622842 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:27.622842 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:27.622842 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:27.622842 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:27.622842 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:27.622842 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:27.622842 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:27.622842 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:27.622842 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:27.622842 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:27.622842 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:30:27.622842 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:30:27.622842 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:30:27.622842 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:30:27.623816 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:30:27.623816 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:30:27.623816 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:30:27.623816 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:30:27.623816 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:27.623816 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:27.623816 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:27.623816 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:27.623816 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:27.623816 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:27.623816 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:27.623816 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:27.623816 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:27.623816 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:27.623816 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:27.623816 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:27.624638 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:27.624638 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:27.624638 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:27.624638 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:27.624638 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:30:27.624638 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:30:27.624638 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:30:27.624638 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:30:27.624638 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:30:27.624638 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:30:27.624638 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:30:27.624638 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:27.628583 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 344/687] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 5 02:30:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:30:27.634808 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac744be0-02e9-4858-a882-daa4855098cb None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:27.695190 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59cfc87-6474-46fc-a02c-4769973d825f None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:27.716645 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:27.732522 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00bf5b7-3c72-41c1-9748-f70c273cb320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:27.733290 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bf5b7-3c72-41c1-9748-f70c273cb320 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:27.733726 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bf5b7-3c72-41c1-9748-f70c273cb320 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:27.734102 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bf5b7-3c72-41c1-9748-f70c273cb320 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:27.758077 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:27.773884 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac744be0-02e9-4858-a882-daa4855098cb None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:27.818168 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c319e05-da4c-45b1-8fa3-f350f3bf32c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:27.819342 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c319e05-da4c-45b1-8fa3-f350f3bf32c2 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:27.819531 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00bf5b7-3c72-41c1-9748-f70c273cb320 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:27.819967 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c319e05-da4c-45b1-8fa3-f350f3bf32c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:27.820395 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c319e05-da4c-45b1-8fa3-f350f3bf32c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:27.821002 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00bf5b7-3c72-41c1-9748-f70c273cb320 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:27.821407 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c319e05-da4c-45b1-8fa3-f350f3bf32c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:27.821867 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c319e05-da4c-45b1-8fa3-f350f3bf32c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:27.824537 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c319e05-da4c-45b1-8fa3-f350f3bf32c2 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:27.839867 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 345/688] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:30:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:30:27.842025 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8593314-16c8-4493-a982-78bc45568893 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:27.842738 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8593314-16c8-4493-a982-78bc45568893 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:27.843206 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8593314-16c8-4493-a982-78bc45568893 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:27.845575 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 346/689] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:30:27.846560 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8593314-16c8-4493-a982-78bc45568893 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:27.940126 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 344/690] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:30:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:30:27.941866 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f0676-ad4c-4984-a084-627cceae4117 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:27.942374 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f0676-ad4c-4984-a084-627cceae4117 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:27.942855 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f0676-ad4c-4984-a084-627cceae4117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:27.961031 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-547f0676-ad4c-4984-a084-627cceae4117 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:27.962546 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-547f0676-ad4c-4984-a084-627cceae4117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:27.967370 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8593314-16c8-4493-a982-78bc45568893 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:27.995012 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:28.020234 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd11f3fa-e97a-44b6-a141-80f805b814b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:28.020234 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11f3fa-e97a-44b6-a141-80f805b814b0 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:28.020234 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11f3fa-e97a-44b6-a141-80f805b814b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:28.020234 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11f3fa-e97a-44b6-a141-80f805b814b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:28.020611 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:28.024778 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd11f3fa-e97a-44b6-a141-80f805b814b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:28.026188 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd11f3fa-e97a-44b6-a141-80f805b814b0 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:28.038217 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 345/691] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:30:28.039412 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f0676-ad4c-4984-a084-627cceae4117 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:28.041429 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-cd11f3fa-e97a-44b6-a141-80f805b814b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:28.041429 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:28.041429 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:28.041429 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:28.041429 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:28.041429 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:28.041429 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:28.041429 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:28.041429 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:28.041429 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:28.041429 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:28.041429 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:28.041429 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:28.041429 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:28.041429 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:28.042323 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:28.042323 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:28.042323 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:28.042323 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:28.042323 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:28.042323 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:28.042323 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:28.042323 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:28.042323 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:28.042323 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:28.042323 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:28.042323 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:28.042323 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:28.042323 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:28.042323 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:28.042323 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:28.042323 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:28.043330 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:28.043330 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:28.043330 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:28.043330 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:28.047585 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 347/692] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:28.048177 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd11f3fa-e97a-44b6-a141-80f805b814b0 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:28.188746 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f0676-ad4c-4984-a084-627cceae4117 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:28.217538 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd11f3fa-e97a-44b6-a141-80f805b814b0 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:28.235820 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537a45a-29e4-4b70-b81d-8588fc0bd81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:28.236968 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537a45a-29e4-4b70-b81d-8588fc0bd81f None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:28.237468 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537a45a-29e4-4b70-b81d-8588fc0bd81f None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:28.237952 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537a45a-29e4-4b70-b81d-8588fc0bd81f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:28.264364 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56371fc9-bc22-4f8d-ba13-b396f2adfaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:28.264576 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56371fc9-bc22-4f8d-ba13-b396f2adfaf4 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:28.264929 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56371fc9-bc22-4f8d-ba13-b396f2adfaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:28.265192 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56371fc9-bc22-4f8d-ba13-b396f2adfaf4 None admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:28.265437 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e537a45a-29e4-4b70-b81d-8588fc0bd81f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:28.265948 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56371fc9-bc22-4f8d-ba13-b396f2adfaf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:28.266260 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56371fc9-bc22-4f8d-ba13-b396f2adfaf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:28.267617 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e537a45a-29e4-4b70-b81d-8588fc0bd81f None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:28.267726 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56371fc9-bc22-4f8d-ba13-b396f2adfaf4 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:28.286545 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 348/693] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:28.287484 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56371fc9-bc22-4f8d-ba13-b396f2adfaf4 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:28.290100 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-e537a45a-29e4-4b70-b81d-8588fc0bd81f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:28.290100 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:28.290100 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:28.290100 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:28.290100 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:28.290100 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:28.290100 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:28.290100 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:28.290100 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:28.290100 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:28.290100 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:28.290100 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:28.290100 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:28.290100 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:28.290100 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:28.291069 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:28.291069 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:28.291069 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:28.291069 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:28.291069 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:28.291069 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:28.291069 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:28.291069 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:28.291069 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:28.291069 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:28.291069 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:28.291069 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:28.291069 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:28.291069 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:28.291069 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:28.291069 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:28.291069 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:28.292047 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:28.292047 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:28.292047 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:28.292047 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:28.295048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 346/694] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:28.296181 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537a45a-29e4-4b70-b81d-8588fc0bd81f None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:28.325910 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:28.342597 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:28.446924 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56371fc9-bc22-4f8d-ba13-b396f2adfaf4 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:28.447167 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537a45a-29e4-4b70-b81d-8588fc0bd81f None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:28.515004 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148c87c-31b0-4fdb-8136-4662f446b691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:28.515249 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148c87c-31b0-4fdb-8136-4662f446b691 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:28.515520 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148c87c-31b0-4fdb-8136-4662f446b691 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:28.516399 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148c87c-31b0-4fdb-8136-4662f446b691 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:28.517707 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be301d-74da-48df-b217-890c00332d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:28.518343 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be301d-74da-48df-b217-890c00332d7e None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:28.518622 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be301d-74da-48df-b217-890c00332d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:28.518891 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be301d-74da-48df-b217-890c00332d7e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:28.536735 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be301d-74da-48df-b217-890c00332d7e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:28.538172 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be301d-74da-48df-b217-890c00332d7e None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:28.539642 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1148c87c-31b0-4fdb-8136-4662f446b691 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:28.541300 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1148c87c-31b0-4fdb-8136-4662f446b691 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:28.563363 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-51be301d-74da-48df-b217-890c00332d7e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 02:30:28.563363 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:28.563363 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:28.563363 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:28.563363 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:28.563363 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:28.563363 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:28.563363 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:28.563363 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:28.563363 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:28.563363 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:28.563363 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:28.563363 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:30:28.563363 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:30:28.563363 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:30:28.563363 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:30:28.564403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:28.564403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:28.564403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:30:28.564403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:28.564403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:30:28.564403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:28.564403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:28.564403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:28.564403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:28.564403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:28.564403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:28.564403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:28.564403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:28.564403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:28.564403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:28.564403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:28.564403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:28.564403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:28.565365 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:28.565365 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:28.565365 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:30:28.565365 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:30:28.565365 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:30:28.565365 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:30:28.565365 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:30:28.565365 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:30:28.565365 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 02:30:28.565365 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:28.575024 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-1148c87c-31b0-4fdb-8136-4662f446b691 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:28.575024 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:28.575024 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:28.575024 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:28.575024 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:28.575024 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:28.575024 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:28.575024 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:28.575024 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:28.575024 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:28.575024 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:28.575024 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:28.575024 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:28.575024 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:28.575024 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:28.576226 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:28.576226 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:28.576226 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:28.576226 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:28.576226 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:28.576226 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:28.576226 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:28.576226 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:28.576226 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:28.576226 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:28.576226 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:28.576226 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:28.576226 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:28.576226 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:28.576226 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:28.576226 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:28.576226 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:28.577110 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:28.577110 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:28.577110 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:28.577110 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:28.577332 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 347/695] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Aug 5 02:30:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:28.577332 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be301d-74da-48df-b217-890c00332d7e None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:28.583330 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 349/696] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:28.583330 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148c87c-31b0-4fdb-8136-4662f446b691 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:28.741879 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:28.757651 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:28.780061 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148c87c-31b0-4fdb-8136-4662f446b691 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:28.782218 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be301d-74da-48df-b217-890c00332d7e None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:28.854912 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f3cf2-51fa-410d-a860-5d9ec2e796c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:28.855504 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f3cf2-51fa-410d-a860-5d9ec2e796c4 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:28.855782 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f3cf2-51fa-410d-a860-5d9ec2e796c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:28.856053 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f3cf2-51fa-410d-a860-5d9ec2e796c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:28.856743 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f3cf2-51fa-410d-a860-5d9ec2e796c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:28.857042 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f3cf2-51fa-410d-a860-5d9ec2e796c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:28.858405 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f3cf2-51fa-410d-a860-5d9ec2e796c4 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:28.863072 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a2694-e166-4e3a-8503-1bb39901d8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:28.863072 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a2694-e166-4e3a-8503-1bb39901d8d8 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:28.863072 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a2694-e166-4e3a-8503-1bb39901d8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:28.863072 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a2694-e166-4e3a-8503-1bb39901d8d8 None admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:28.863501 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a2694-e166-4e3a-8503-1bb39901d8d8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:28.863501 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a2694-e166-4e3a-8503-1bb39901d8d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:28.865189 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a2694-e166-4e3a-8503-1bb39901d8d8 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:28.892983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 350/697] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Aug 5 02:30:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:28.893344 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 348/698] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:28.895119 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a2694-e166-4e3a-8503-1bb39901d8d8 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:28.901624 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f3cf2-51fa-410d-a860-5d9ec2e796c4 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:29.064878 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f3cf2-51fa-410d-a860-5d9ec2e796c4 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:29.084456 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a2694-e166-4e3a-8503-1bb39901d8d8 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:29.109716 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cec099-a800-46af-bc5a-7b30079487e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:29.110820 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cec099-a800-46af-bc5a-7b30079487e5 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:29.111330 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cec099-a800-46af-bc5a-7b30079487e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:29.111896 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cec099-a800-46af-bc5a-7b30079487e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:29.123865 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cec099-a800-46af-bc5a-7b30079487e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:29.125321 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cec099-a800-46af-bc5a-7b30079487e5 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:29.147824 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-85cec099-a800-46af-bc5a-7b30079487e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:29.147824 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:29.147824 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:29.147824 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:29.147824 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:29.147824 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:29.147824 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:29.147824 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:29.147824 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:29.147824 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:29.147824 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:29.147824 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:29.147824 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:30:29.147824 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:30:29.147824 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:30:29.148801 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:30:29.148801 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:29.148801 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:29.148801 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:29.148801 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:29.148801 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:29.148801 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:29.148801 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:29.148801 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:29.148801 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:29.148801 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:29.148801 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:29.148801 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:29.148801 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:29.148801 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:29.148801 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:29.148801 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:29.149689 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:30:29.149689 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:30:29.149689 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:30:29.149689 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:30:29.149689 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:30:29.149689 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:30:29.149689 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:29.149689 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:29.155311 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 349/699] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:30:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:29.156831 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3726ca-90a4-495d-9072-9321d29636d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:29.157475 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3726ca-90a4-495d-9072-9321d29636d2 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:29.157759 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3726ca-90a4-495d-9072-9321d29636d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:29.158032 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3726ca-90a4-495d-9072-9321d29636d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:29.158739 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3726ca-90a4-495d-9072-9321d29636d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:29.159068 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3726ca-90a4-495d-9072-9321d29636d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:29.161156 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3726ca-90a4-495d-9072-9321d29636d2 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:29.163581 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cec099-a800-46af-bc5a-7b30079487e5 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:29.183872 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 351/700] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:29.184741 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3726ca-90a4-495d-9072-9321d29636d2 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:29.190710 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:29.207605 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:29.338766 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cec099-a800-46af-bc5a-7b30079487e5 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:29.359291 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3726ca-90a4-495d-9072-9321d29636d2 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:29.379668 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a3707-cb50-4cda-b0d0-4acdce3eb7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:29.380404 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a3707-cb50-4cda-b0d0-4acdce3eb7e6 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:29.380965 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a3707-cb50-4cda-b0d0-4acdce3eb7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:29.381246 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a3707-cb50-4cda-b0d0-4acdce3eb7e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:29.398402 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ccab80-02c9-463d-a279-1b4afd628178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:29.399238 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccab80-02c9-463d-a279-1b4afd628178 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:29.399659 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccab80-02c9-463d-a279-1b4afd628178 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:29.400033 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccab80-02c9-463d-a279-1b4afd628178 None admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:29.400904 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ccab80-02c9-463d-a279-1b4afd628178 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:29.401281 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ccab80-02c9-463d-a279-1b4afd628178 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:29.402893 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ccab80-02c9-463d-a279-1b4afd628178 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:29.420794 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 352/701] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 5 02:30:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:29.420794 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ccab80-02c9-463d-a279-1b4afd628178 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:29.467988 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981a3707-cb50-4cda-b0d0-4acdce3eb7e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:29.469821 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981a3707-cb50-4cda-b0d0-4acdce3eb7e6 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:29.483317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:29.503737 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:29.545808 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ccab80-02c9-463d-a279-1b4afd628178 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:29.594541 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 350/702] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:30:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:30:29.595148 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9ddec-30df-4e6e-ab1f-ec5b54a37d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:29.595876 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9ddec-30df-4e6e-ab1f-ec5b54a37d4c None admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:29.596009 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb5b7a-5d45-476e-b4ed-ef30c784b755 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:29.596163 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9ddec-30df-4e6e-ab1f-ec5b54a37d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:29.596297 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb5b7a-5d45-476e-b4ed-ef30c784b755 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:29.596440 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9ddec-30df-4e6e-ab1f-ec5b54a37d4c None admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:29.596573 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb5b7a-5d45-476e-b4ed-ef30c784b755 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:29.597124 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f9ddec-30df-4e6e-ab1f-ec5b54a37d4c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:29.597979 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 351/703] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:30:29.598606 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f9ddec-30df-4e6e-ab1f-ec5b54a37d4c None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:29.598713 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb5b7a-5d45-476e-b4ed-ef30c784b755 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:29.683133 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 353/704] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 5 02:30:29 2022] POST /identity/v3/users => generated 254 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:30:29.684229 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47097c-cd2c-4fdc-86b1-9487f5725227 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:29.684229 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47097c-cd2c-4fdc-86b1-9487f5725227 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:29.684410 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47097c-cd2c-4fdc-86b1-9487f5725227 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:29.686860 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 354/705] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:30:29.687734 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a47097c-cd2c-4fdc-86b1-9487f5725227 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:29.714008 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb5b7a-5d45-476e-b4ed-ef30c784b755 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:29.729244 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:29.765801 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f59cb4-e9e8-4ed6-b35a-7a3e044cd69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:29.766561 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f59cb4-e9e8-4ed6-b35a-7a3e044cd69c None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:29.766828 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f59cb4-e9e8-4ed6-b35a-7a3e044cd69c None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:29.767173 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f59cb4-e9e8-4ed6-b35a-7a3e044cd69c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:29.768031 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f59cb4-e9e8-4ed6-b35a-7a3e044cd69c None admin] RBAC: Adding query filter params (role.id=2642213efc7d4861b3d3b4f5fbc9ad73, scope.project.id=63b323c02a614fc28aac6e7a060064ba, user.id=40f706f1eb2b4137afd367cb5060ced0) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:29.768383 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f59cb4-e9e8-4ed6-b35a-7a3e044cd69c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:29.769964 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f59cb4-e9e8-4ed6-b35a-7a3e044cd69c None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:29.783013 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 352/706] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:30:29 2022] GET /identity/v3/role_assignments?user.id=40f706f1eb2b4137afd367cb5060ced0&scope.project.id=63b323c02a614fc28aac6e7a060064ba&role.id=2642213efc7d4861b3d3b4f5fbc9ad73 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:29.783013 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f9e78-587b-4b55-b97d-c4aa2bd118fe None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:29.783013 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f9e78-587b-4b55-b97d-c4aa2bd118fe None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:29.783013 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f9e78-587b-4b55-b97d-c4aa2bd118fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:29.837975 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a47097c-cd2c-4fdc-86b1-9487f5725227 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:29.885323 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:29.903638 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020320d-8112-4dab-b242-8765a76a5cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:29.904201 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020320d-8112-4dab-b242-8765a76a5cfe None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:29.904486 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020320d-8112-4dab-b242-8765a76a5cfe None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:29.904762 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020320d-8112-4dab-b242-8765a76a5cfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:29.929944 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5020320d-8112-4dab-b242-8765a76a5cfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:29.931630 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5020320d-8112-4dab-b242-8765a76a5cfe None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:29.951921 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-ca7f9e78-587b-4b55-b97d-c4aa2bd118fe None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:29.953102 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-ca7f9e78-587b-4b55-b97d-c4aa2bd118fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:29.954231 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-5020320d-8112-4dab-b242-8765a76a5cfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:29.954231 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:29.954231 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:29.954231 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:29.954231 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:29.954231 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:29.954231 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:29.954231 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:29.954231 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:29.954231 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:29.954231 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:29.954231 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:29.954231 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:29.954231 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:29.954231 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:29.955164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:29.955164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:29.955164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:29.955164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:29.955164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:29.955164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:29.955164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:29.955164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:29.955164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:29.955164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:29.955164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:29.955164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:29.955164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:29.955164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:29.955164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:29.955164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:29.955164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:29.956158 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:29.956158 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:29.956158 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:29.956158 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:29.956855 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 355/707] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:29.958394 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac00c0-dfd5-4bf5-ae52-50f36ee6b7fe None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:29.958780 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac00c0-dfd5-4bf5-ae52-50f36ee6b7fe None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:29.959115 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac00c0-dfd5-4bf5-ae52-50f36ee6b7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:29.988058 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-aeac00c0-dfd5-4bf5-ae52-50f36ee6b7fe None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:29.989936 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-aeac00c0-dfd5-4bf5-ae52-50f36ee6b7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:30.056780 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 353/708] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:30:30.057682 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f9e78-587b-4b55-b97d-c4aa2bd118fe None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:30.101006 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 356/709] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:30:30.102567 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac00c0-dfd5-4bf5-ae52-50f36ee6b7fe None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:30.194519 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f9e78-587b-4b55-b97d-c4aa2bd118fe None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:30.200188 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:30.236285 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac00c0-dfd5-4bf5-ae52-50f36ee6b7fe None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:30.239258 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:30.319799 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a229e-203c-4079-ae3a-e51111754f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:30.320437 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a229e-203c-4079-ae3a-e51111754f4d None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:30.320716 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a229e-203c-4079-ae3a-e51111754f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:30.320987 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a229e-203c-4079-ae3a-e51111754f4d None admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:30.321688 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a229e-203c-4079-ae3a-e51111754f4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:30.321987 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a229e-203c-4079-ae3a-e51111754f4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:30.324196 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e60021-e2c5-4e14-8cb8-c18befdeaecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:30.325088 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e60021-e2c5-4e14-8cb8-c18befdeaecf None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:30.325516 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a229e-203c-4079-ae3a-e51111754f4d None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:30.326019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e60021-e2c5-4e14-8cb8-c18befdeaecf None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:30.326503 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e60021-e2c5-4e14-8cb8-c18befdeaecf None admin] PATH_INFO: `/v3/services/network` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:30.327389 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e60021-e2c5-4e14-8cb8-c18befdeaecf None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:30.331953 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e60021-e2c5-4e14-8cb8-c18befdeaecf None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:30.344178 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 354/710] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:30.345039 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a229e-203c-4079-ae3a-e51111754f4d None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:30.350242 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-25e60021-e2c5-4e14-8cb8-c18befdeaecf None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 02:30:30.350242 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:30.350242 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:30:30.350242 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:30:30.350242 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:30:30.350242 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:30:30.350242 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:30:30.350242 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:30:30.350242 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 02:30:30.350242 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:30.350242 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:30:30.350242 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:30.350242 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:30.350242 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:30.350242 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:30.350242 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:30.350242 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:30.351416 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:30.351416 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:30.351416 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:30.351416 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:30.351416 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:30.351416 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:30.351416 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:30:30.351416 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:30:30.351416 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:30:30.351416 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:30:30.351416 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:30.351416 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:30.351416 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:30.351416 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:30.351416 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:30.351416 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:30.352328 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:30.352328 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:30.352328 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:30.352328 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:30.352328 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:30.352328 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:30.352328 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:30.352328 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:30.352328 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:30.352328 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:30.352328 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:30:30.352328 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:30:30.352328 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 02:30:30.352328 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:30.356289 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 357/711] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:30:30 2022] GET /identity/v3/services/network => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:30.357366 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e60021-e2c5-4e14-8cb8-c18befdeaecf None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:30.494379 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e60021-e2c5-4e14-8cb8-c18befdeaecf None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:30.526493 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a229e-203c-4079-ae3a-e51111754f4d None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:30.535056 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9a772-8bbe-4cd0-a807-a07a3e2e0e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:30.537114 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9a772-8bbe-4cd0-a807-a07a3e2e0e8f None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:30.538289 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9a772-8bbe-4cd0-a807-a07a3e2e0e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:30.539587 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9a772-8bbe-4cd0-a807-a07a3e2e0e8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:30.560003 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9a772-8bbe-4cd0-a807-a07a3e2e0e8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:30.561747 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9a772-8bbe-4cd0-a807-a07a3e2e0e8f None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:30.576394 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-aec9a772-8bbe-4cd0-a807-a07a3e2e0e8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:30.576394 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:30.576394 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:30.576394 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:30.576394 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:30.576394 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:30.576394 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:30.576394 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:30.576394 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:30.576394 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:30.576394 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:30.576394 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:30.576394 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:30:30.576394 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:30:30.576394 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:30:30.577335 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:30:30.577335 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:30.577335 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:30.577335 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:30.577335 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:30.577335 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:30.577335 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:30.577335 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:30.577335 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:30.577335 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:30.577335 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:30.577335 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:30.577335 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:30.577335 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:30.577335 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:30.577335 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:30.577335 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:30.578353 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:30:30.578353 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:30:30.578353 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:30:30.578353 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:30:30.578353 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:30:30.578353 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:30:30.578353 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:30.578353 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:30.578353 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 358/712] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:30:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:30.578887 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9a772-8bbe-4cd0-a807-a07a3e2e0e8f None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:30.582426 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a5bdf-5385-434d-ba52-875fc8aee9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:30.583510 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a5bdf-5385-434d-ba52-875fc8aee9aa None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:30.586652 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a5bdf-5385-434d-ba52-875fc8aee9aa None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:30.587226 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a5bdf-5385-434d-ba52-875fc8aee9aa None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:30.588091 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a5bdf-5385-434d-ba52-875fc8aee9aa None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:30.589912 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a5bdf-5385-434d-ba52-875fc8aee9aa None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:30.609668 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-c93a5bdf-5385-434d-ba52-875fc8aee9aa None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 02:30:30.609668 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:30.609668 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:30:30.609668 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:30:30.609668 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:30:30.609668 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:30:30.609668 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:30:30.609668 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:30:30.609668 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 02:30:30.609668 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:30.609668 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:30:30.609668 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:30.609668 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:30.609668 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:30.609668 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:30.609668 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:30.610756 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:30.610756 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:30.610756 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:30.610756 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:30.610756 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:30.610756 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:30.610756 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:30.610756 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:30:30.610756 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:30:30.610756 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:30:30.610756 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:30:30.610756 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:30.610756 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:30.610756 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:30.610756 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:30.610756 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:30.611698 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:30.611698 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:30.611698 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:30.611698 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:30.611698 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:30.611698 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:30.611698 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:30.611698 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:30.611698 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:30.611698 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:30.611698 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:30.611698 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:30:30.611698 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:30:30.611698 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 02:30:30.611698 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:30.614658 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:30.616967 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 355/713] 10.222.0.42 () {56 vars in 1129 bytes} [Fri Aug 5 02:30:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:30.618013 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a5bdf-5385-434d-ba52-875fc8aee9aa None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:30.671605 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:30.711104 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9a772-8bbe-4cd0-a807-a07a3e2e0e8f None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:30.757906 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8cf99-9cf5-44e6-b233-826558be7edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:30.758850 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8cf99-9cf5-44e6-b233-826558be7edd None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:30.759166 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8cf99-9cf5-44e6-b233-826558be7edd None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:30.759449 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8cf99-9cf5-44e6-b233-826558be7edd None admin] PATH_INFO: `/v3/services` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:30.760138 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df8cf99-9cf5-44e6-b233-826558be7edd None admin] RBAC: Adding query filter params (name=network) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:30.760448 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df8cf99-9cf5-44e6-b233-826558be7edd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:30.762094 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df8cf99-9cf5-44e6-b233-826558be7edd None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:30.771460 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 359/714] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Aug 5 02:30:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:30.772226 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8cf99-9cf5-44e6-b233-826558be7edd None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:30.806855 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a5bdf-5385-434d-ba52-875fc8aee9aa None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:30.886586 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d10697-048d-41c7-b138-0ef856df5785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:30.887363 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d10697-048d-41c7-b138-0ef856df5785 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:30.887647 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d10697-048d-41c7-b138-0ef856df5785 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:30.887924 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d10697-048d-41c7-b138-0ef856df5785 None admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:30.888189 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:30.888675 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d10697-048d-41c7-b138-0ef856df5785 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:30.888985 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d10697-048d-41c7-b138-0ef856df5785 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:30.890436 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d10697-048d-41c7-b138-0ef856df5785 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:30.899174 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8cf99-9cf5-44e6-b233-826558be7edd None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:30.912175 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 356/715] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 5 02:30:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:30.918554 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d10697-048d-41c7-b138-0ef856df5785 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:30.942603 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39a532-996d-4f0a-aef7-322cf26deec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:30.943577 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39a532-996d-4f0a-aef7-322cf26deec6 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:30.944291 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39a532-996d-4f0a-aef7-322cf26deec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:30.944755 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39a532-996d-4f0a-aef7-322cf26deec6 None admin] PATH_INFO: `/v3/services` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:30.948241 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e39a532-996d-4f0a-aef7-322cf26deec6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:30.948747 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e39a532-996d-4f0a-aef7-322cf26deec6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:30.952499 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e39a532-996d-4f0a-aef7-322cf26deec6 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:30.969445 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 360/716] 10.222.0.42 () {56 vars in 1124 bytes} [Fri Aug 5 02:30:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:30.969445 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39a532-996d-4f0a-aef7-322cf26deec6 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:31.124813 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:31.132931 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39a532-996d-4f0a-aef7-322cf26deec6 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:31.145865 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d10697-048d-41c7-b138-0ef856df5785 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:31.182261 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258150bf-df0b-4180-8bf4-b8bcd4fe722f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:31.183080 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258150bf-df0b-4180-8bf4-b8bcd4fe722f None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:31.183428 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258150bf-df0b-4180-8bf4-b8bcd4fe722f None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:31.183711 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258150bf-df0b-4180-8bf4-b8bcd4fe722f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:31.184516 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258150bf-df0b-4180-8bf4-b8bcd4fe722f None admin] RBAC: Adding query filter params (role.id=83afe883a303495b966480fb9b5bb7dd, scope.project.id=63b323c02a614fc28aac6e7a060064ba, user.id=55374d3bccd541c9a8f82da9b21c2fb8) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:31.186922 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258150bf-df0b-4180-8bf4-b8bcd4fe722f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:31.188437 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258150bf-df0b-4180-8bf4-b8bcd4fe722f None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:31.205062 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 361/717] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:30:30 2022] GET /identity/v3/role_assignments?user.id=55374d3bccd541c9a8f82da9b21c2fb8&scope.project.id=63b323c02a614fc28aac6e7a060064ba&role.id=83afe883a303495b966480fb9b5bb7dd => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:31.206193 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258150bf-df0b-4180-8bf4-b8bcd4fe722f None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:31.240290 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc3897-f745-44df-88cc-1a1c3eb809c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:31.241409 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc3897-f745-44df-88cc-1a1c3eb809c8 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:31.241901 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc3897-f745-44df-88cc-1a1c3eb809c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:31.242383 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc3897-f745-44df-88cc-1a1c3eb809c8 None admin] PATH_INFO: `/v3/services` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:31.243466 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cc3897-f745-44df-88cc-1a1c3eb809c8 None admin] RBAC: Adding query filter params (type=network) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:31.243988 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cc3897-f745-44df-88cc-1a1c3eb809c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:31.248019 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cc3897-f745-44df-88cc-1a1c3eb809c8 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:31.252722 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:31.259125 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 357/718] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Aug 5 02:30:30 2022] GET /identity/v3/services?type=network => generated 124 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:31.484847 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258150bf-df0b-4180-8bf4-b8bcd4fe722f None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:31.558392 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e66ca-aca1-4480-9f4b-3470d94f9826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:31.559430 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e66ca-aca1-4480-9f4b-3470d94f9826 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:31.559938 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e66ca-aca1-4480-9f4b-3470d94f9826 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:31.560422 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e66ca-aca1-4480-9f4b-3470d94f9826 None admin] PATH_INFO: `/v3/services` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:31.561315 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82e66ca-aca1-4480-9f4b-3470d94f9826 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:31.561830 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82e66ca-aca1-4480-9f4b-3470d94f9826 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:31.563453 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82e66ca-aca1-4480-9f4b-3470d94f9826 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:31.570479 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 362/719] 10.222.0.42 () {56 vars in 1124 bytes} [Fri Aug 5 02:30:31 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:32.091063 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304af716-4d23-4c1f-914a-6bbdfb775b04 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:32.091063 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304af716-4d23-4c1f-914a-6bbdfb775b04 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:32.091063 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304af716-4d23-4c1f-914a-6bbdfb775b04 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:32.092152 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 358/720] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:30:32.110994 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ff006-50d3-4fcb-9674-cce9cf5827ef None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:32.110994 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ff006-50d3-4fcb-9674-cce9cf5827ef None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:32.110994 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ff006-50d3-4fcb-9674-cce9cf5827ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:32.133099 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-752ff006-50d3-4fcb-9674-cce9cf5827ef None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:32.134310 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-752ff006-50d3-4fcb-9674-cce9cf5827ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:32.238792 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c535ec9-e3f3-4940-abd7-b10666f1a226 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:32.239402 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c535ec9-e3f3-4940-abd7-b10666f1a226 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:32.239866 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c535ec9-e3f3-4940-abd7-b10666f1a226 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:32.245016 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 359/721] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:30:32.246348 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc5530f-a768-4fb5-9c25-edb589e1ad12 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:32.246811 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc5530f-a768-4fb5-9c25-edb589e1ad12 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:32.247411 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc5530f-a768-4fb5-9c25-edb589e1ad12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:32.250013 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 363/722] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:30:32.298437 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ff006-50d3-4fcb-9674-cce9cf5827ef None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:32.308011 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-efc5530f-a768-4fb5-9c25-edb589e1ad12 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:32.309285 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-efc5530f-a768-4fb5-9c25-edb589e1ad12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:32.340154 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:32.469426 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 360/723] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:30:32.502592 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc5530f-a768-4fb5-9c25-edb589e1ad12 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:32.526712 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ff006-50d3-4fcb-9674-cce9cf5827ef None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:32.565039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc4c56-f4c4-42b1-9067-5d992178dff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:32.565691 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc4c56-f4c4-42b1-9067-5d992178dff7 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:32.566079 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc4c56-f4c4-42b1-9067-5d992178dff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:32.566391 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc4c56-f4c4-42b1-9067-5d992178dff7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:32.578972 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbc4c56-f4c4-42b1-9067-5d992178dff7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:30:32.583883 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-8fbc4c56-f4c4-42b1-9067-5d992178dff7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:30:32.583883 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:32.583883 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:32.583883 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:32.583883 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:32.583883 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:32.583883 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:32.583883 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:32.583883 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:32.583883 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:32.583883 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:32.583883 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:32.583883 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:30:32.583883 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:30:32.583883 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:30:32.583883 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:30:32.584817 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:30:32.584817 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:30:32.584817 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:30:32.584817 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:30:32.584817 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:32.584817 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:32.584817 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:32.584817 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:32.584817 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:32.584817 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:32.584817 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:32.584817 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:32.584817 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:32.584817 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:32.584817 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:32.584817 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:32.585663 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:32.585663 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:32.585663 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:32.585663 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:32.585663 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:30:32.585663 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:30:32.585663 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:30:32.585663 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:30:32.585663 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:30:32.585663 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:30:32.585663 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:30:32.585663 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:32.585663 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 364/724] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 5 02:30:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:32.596069 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc4c56-f4c4-42b1-9067-5d992178dff7 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:32.648436 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:32.673733 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc5530f-a768-4fb5-9c25-edb589e1ad12 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:32.713080 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faca887-2797-40ba-86a3-80d6b75780d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:32.714107 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faca887-2797-40ba-86a3-80d6b75780d2 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:32.714846 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faca887-2797-40ba-86a3-80d6b75780d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:32.715453 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faca887-2797-40ba-86a3-80d6b75780d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:32.730416 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faca887-2797-40ba-86a3-80d6b75780d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:30:32.736785 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-4faca887-2797-40ba-86a3-80d6b75780d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:30:32.736785 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:32.736785 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:32.736785 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:32.736785 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:32.736785 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:32.736785 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:32.736785 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:32.736785 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:32.736785 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:32.736785 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:32.736785 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:32.736785 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:30:32.736785 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:30:32.736785 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:30:32.736785 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:30:32.737731 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:30:32.737731 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:30:32.737731 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:30:32.737731 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:30:32.737731 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:32.737731 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:32.737731 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:32.737731 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:32.737731 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:32.737731 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:32.737731 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:32.737731 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:32.737731 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:32.737731 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:32.737731 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:32.737731 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:32.738621 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:32.738621 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:32.738621 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:32.738621 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:32.738621 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:30:32.738621 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:30:32.738621 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:30:32.738621 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:30:32.738621 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:30:32.738621 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:30:32.738621 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:30:32.738621 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:32.742484 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 361/725] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 5 02:30:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:32.752180 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faca887-2797-40ba-86a3-80d6b75780d2 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:32.752840 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:32.828297 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc4c56-f4c4-42b1-9067-5d992178dff7 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:32.902610 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faca887-2797-40ba-86a3-80d6b75780d2 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:32.948885 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb529e-af8b-4528-b7a9-5b5af1015939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:32.951035 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb529e-af8b-4528-b7a9-5b5af1015939 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:32.951035 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb529e-af8b-4528-b7a9-5b5af1015939 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:32.951035 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb529e-af8b-4528-b7a9-5b5af1015939 None admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:32.951717 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb529e-af8b-4528-b7a9-5b5af1015939 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:32.952021 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb529e-af8b-4528-b7a9-5b5af1015939 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:32.955326 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb529e-af8b-4528-b7a9-5b5af1015939 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:32.964532 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 362/726] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:30:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:32.964915 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c23828-3acf-4786-a58d-99390bc54615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:32.965624 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c23828-3acf-4786-a58d-99390bc54615 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:32.965912 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c23828-3acf-4786-a58d-99390bc54615 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:32.966188 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c23828-3acf-4786-a58d-99390bc54615 None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:32.966919 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c23828-3acf-4786-a58d-99390bc54615 None admin] RBAC: Adding query filter params (name=service) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:32.967280 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c23828-3acf-4786-a58d-99390bc54615 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:32.972312 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb529e-af8b-4528-b7a9-5b5af1015939 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:32.975198 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c23828-3acf-4786-a58d-99390bc54615 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:32.977902 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:32.997529 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 365/727] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 5 02:30:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:30:33.007420 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c23828-3acf-4786-a58d-99390bc54615 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:33.104483 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb529e-af8b-4528-b7a9-5b5af1015939 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:33.159119 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef2475-a584-4a09-8504-d1e20e458cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:33.159888 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef2475-a584-4a09-8504-d1e20e458cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:33.160178 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef2475-a584-4a09-8504-d1e20e458cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:33.160542 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef2475-a584-4a09-8504-d1e20e458cb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:33.185443 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef2475-a584-4a09-8504-d1e20e458cb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:33.194977 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef2475-a584-4a09-8504-d1e20e458cb2 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:33.222040 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-67ef2475-a584-4a09-8504-d1e20e458cb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:33.222040 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:33.222040 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:33.222040 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:33.222040 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:33.222040 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:33.222040 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:33.222040 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:33.222040 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:33.222040 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:33.222040 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:33.222040 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:33.222040 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:33.222040 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:33.222040 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:33.223066 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:33.223066 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:33.223066 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:33.223066 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:33.223066 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:33.223066 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:33.223066 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:33.223066 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:33.223066 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:33.223066 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:33.223066 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:33.223066 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:33.223066 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:33.223066 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:33.223066 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:33.223066 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:33.223066 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:33.223973 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:33.223973 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:33.223973 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:33.223973 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:33.223973 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 363/728] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:33.229652 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef2475-a584-4a09-8504-d1e20e458cb2 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:33.326202 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c23828-3acf-4786-a58d-99390bc54615 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:33.355251 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:33.389936 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbcfccf-d08c-4fd5-ab49-2a5c1f772685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:33.390597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcfccf-d08c-4fd5-ab49-2a5c1f772685 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:33.390881 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcfccf-d08c-4fd5-ab49-2a5c1f772685 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:33.391230 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcfccf-d08c-4fd5-ab49-2a5c1f772685 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:33.396772 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:33.419105 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbcfccf-d08c-4fd5-ab49-2a5c1f772685 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:33.419105 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbcfccf-d08c-4fd5-ab49-2a5c1f772685 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:33.450192 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-7cbcfccf-d08c-4fd5-ab49-2a5c1f772685 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:33.450192 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:33.450192 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:33.450192 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:33.450192 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:33.450192 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:33.450192 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:33.450192 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:33.450192 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:33.450192 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:33.450192 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:33.450192 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:33.450192 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:33.450192 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:33.450192 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:33.451206 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:33.451206 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:33.451206 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:33.451206 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:33.451206 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:33.451206 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:33.451206 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:33.451206 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:33.451206 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:33.451206 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:33.451206 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:33.451206 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:33.451206 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:33.451206 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:33.451206 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:33.451206 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:33.451206 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:33.452120 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:33.452120 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:33.452120 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:33.452120 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:33.452957 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef2475-a584-4a09-8504-d1e20e458cb2 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:33.456427 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 366/729] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 449 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:33.469294 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbcfccf-d08c-4fd5-ab49-2a5c1f772685 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:33.522112 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ead6ef-55e8-469b-a5f7-570262eb4edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:33.522741 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ead6ef-55e8-469b-a5f7-570262eb4edf None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:33.523048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ead6ef-55e8-469b-a5f7-570262eb4edf None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:33.523333 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ead6ef-55e8-469b-a5f7-570262eb4edf None admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:33.524022 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ead6ef-55e8-469b-a5f7-570262eb4edf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:33.525517 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ead6ef-55e8-469b-a5f7-570262eb4edf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:33.529412 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ead6ef-55e8-469b-a5f7-570262eb4edf None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:33.562739 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 364/730] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:30:33.566135 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ead6ef-55e8-469b-a5f7-570262eb4edf None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:33.694549 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbcfccf-d08c-4fd5-ab49-2a5c1f772685 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:33.770149 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02ac9e-a3c8-4cd8-95d0-70f09b90f8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:33.770784 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02ac9e-a3c8-4cd8-95d0-70f09b90f8b0 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:33.772466 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02ac9e-a3c8-4cd8-95d0-70f09b90f8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:33.772760 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02ac9e-a3c8-4cd8-95d0-70f09b90f8b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:33.773468 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f02ac9e-a3c8-4cd8-95d0-70f09b90f8b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:33.773777 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f02ac9e-a3c8-4cd8-95d0-70f09b90f8b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:33.776213 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f02ac9e-a3c8-4cd8-95d0-70f09b90f8b0 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:33.791450 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 367/731] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:33.798147 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02ac9e-a3c8-4cd8-95d0-70f09b90f8b0 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:33.806418 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ead6ef-55e8-469b-a5f7-570262eb4edf None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:33.827584 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:33.863552 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d5636-04a6-4cec-8401-fd311f04639a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:33.864719 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d5636-04a6-4cec-8401-fd311f04639a None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:33.865350 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d5636-04a6-4cec-8401-fd311f04639a None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:33.865841 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d5636-04a6-4cec-8401-fd311f04639a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:33.874689 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d5636-04a6-4cec-8401-fd311f04639a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:33.877457 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d5636-04a6-4cec-8401-fd311f04639a None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:33.881734 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:33.892862 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-c38d5636-04a6-4cec-8401-fd311f04639a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 05 02:30:33.892862 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:33.892862 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:33.892862 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:33.892862 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:33.892862 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:33.892862 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:33.892862 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:33.892862 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:33.892862 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:33.892862 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:33.892862 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:33.892862 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:30:33.892862 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:30:33.892862 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:30:33.892862 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:30:33.897211 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:33.897211 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:33.897211 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:30:33.897211 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:33.897211 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:30:33.897211 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:33.897211 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:33.897211 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:33.897211 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:33.897211 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:33.897211 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:33.897211 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:33.897211 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:33.897211 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:33.897211 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:33.897211 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:33.897211 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:33.897211 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:33.898182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:33.898182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:33.898182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:30:33.898182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:30:33.898182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:30:33.898182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:30:33.898182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:30:33.898182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:30:33.898182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 05 02:30:33.898182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:33.898182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 365/732] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 5 02:30:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:33.898182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b2cb1-3d33-4fda-af9a-f74687547a0c None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:33.899100 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b2cb1-3d33-4fda-af9a-f74687547a0c None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:33.899553 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b2cb1-3d33-4fda-af9a-f74687547a0c None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:33.901292 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 366/733] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:30:33.902161 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b2cb1-3d33-4fda-af9a-f74687547a0c None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:33.958980 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02ac9e-a3c8-4cd8-95d0-70f09b90f8b0 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:34.005542 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cae44b9-e5cb-4e3f-a0f9-12418a955a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:34.006353 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae44b9-e5cb-4e3f-a0f9-12418a955a6d None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:34.006808 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae44b9-e5cb-4e3f-a0f9-12418a955a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:34.007152 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae44b9-e5cb-4e3f-a0f9-12418a955a6d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:34.019707 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cae44b9-e5cb-4e3f-a0f9-12418a955a6d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:34.021301 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cae44b9-e5cb-4e3f-a0f9-12418a955a6d None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:34.040095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-5cae44b9-e5cb-4e3f-a0f9-12418a955a6d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 02:30:34.040095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:34.040095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:34.040095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:34.040095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:34.040095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:34.040095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:34.040095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:34.040095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:34.040095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:34.040095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:34.040095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:34.040095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:30:34.040095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:30:34.040095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:30:34.040095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:30:34.041132 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:34.041132 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:34.041132 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:30:34.041132 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:34.041132 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:30:34.041132 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:34.041132 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:34.041132 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:34.041132 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:34.041132 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:34.041132 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:34.041132 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:34.041132 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:34.041132 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:34.041132 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:34.041132 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:34.041132 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:34.041132 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:34.042121 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:34.042121 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:34.042121 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:30:34.042121 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:30:34.042121 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:30:34.042121 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:30:34.042121 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:30:34.042121 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:30:34.042121 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 02:30:34.042121 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:34.045762 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 368/734] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Aug 5 02:30:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:34.047112 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd39358-0cd7-4f32-b414-e393ebb49902 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:34.047390 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd39358-0cd7-4f32-b414-e393ebb49902 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:34.047672 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd39358-0cd7-4f32-b414-e393ebb49902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:34.052092 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b2cb1-3d33-4fda-af9a-f74687547a0c None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:34.074584 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-cbd39358-0cd7-4f32-b414-e393ebb49902 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:34.076116 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-cbd39358-0cd7-4f32-b414-e393ebb49902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:34.104101 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33370dea-b3d6-481f-ad5a-5d2ae4ff4d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:34.109399 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33370dea-b3d6-481f-ad5a-5d2ae4ff4d42 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:34.109399 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33370dea-b3d6-481f-ad5a-5d2ae4ff4d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:34.109399 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33370dea-b3d6-481f-ad5a-5d2ae4ff4d42 None admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:34.109399 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33370dea-b3d6-481f-ad5a-5d2ae4ff4d42 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:34.109399 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33370dea-b3d6-481f-ad5a-5d2ae4ff4d42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:34.111937 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33370dea-b3d6-481f-ad5a-5d2ae4ff4d42 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:34.139966 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 367/735] 10.222.0.42 () {56 vars in 1135 bytes} [Fri Aug 5 02:30:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:34.141411 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd91f6-af5f-47b7-93d8-980aca923ac8 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:34.141700 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd91f6-af5f-47b7-93d8-980aca923ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:34.141975 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd91f6-af5f-47b7-93d8-980aca923ac8 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:34.147065 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 368/736] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:30:34.147065 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd91f6-af5f-47b7-93d8-980aca923ac8 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:34.166395 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 369/737] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:30:34.167753 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd39358-0cd7-4f32-b414-e393ebb49902 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:34.205034 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:34.244183 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:34.307447 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd91f6-af5f-47b7-93d8-980aca923ac8 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:34.323740 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd39358-0cd7-4f32-b414-e393ebb49902 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:34.343762 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9fa14-9cd3-43c5-96c0-9be58f2a3df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:34.344393 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9fa14-9cd3-43c5-96c0-9be58f2a3df7 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:34.344677 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9fa14-9cd3-43c5-96c0-9be58f2a3df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:34.344946 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9fa14-9cd3-43c5-96c0-9be58f2a3df7 None admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:34.345752 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d9fa14-9cd3-43c5-96c0-9be58f2a3df7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:34.346510 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d9fa14-9cd3-43c5-96c0-9be58f2a3df7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:34.348874 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d9fa14-9cd3-43c5-96c0-9be58f2a3df7 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:34.362918 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbff046-d01f-4e56-a541-d5eed1b5bdee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:34.363725 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbff046-d01f-4e56-a541-d5eed1b5bdee None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:34.364705 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbff046-d01f-4e56-a541-d5eed1b5bdee None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:34.364991 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbff046-d01f-4e56-a541-d5eed1b5bdee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:34.367840 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 369/738] 10.222.0.42 () {56 vars in 1149 bytes} [Fri Aug 5 02:30:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:34.368892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7146b-7aed-4900-852a-26ebd95ff4a8 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:34.369179 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7146b-7aed-4900-852a-26ebd95ff4a8 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:34.369458 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7146b-7aed-4900-852a-26ebd95ff4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:34.388826 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-8ef7146b-7aed-4900-852a-26ebd95ff4a8 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:34.389099 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-8ef7146b-7aed-4900-852a-26ebd95ff4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:34.438545 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbff046-d01f-4e56-a541-d5eed1b5bdee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:34.440078 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbff046-d01f-4e56-a541-d5eed1b5bdee None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:34.466033 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 370/739] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:30:34.466882 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7146b-7aed-4900-852a-26ebd95ff4a8 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:34.489450 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:34.494536 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:34.586054 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7146b-7aed-4900-852a-26ebd95ff4a8 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:34.627709 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f88e0-f669-4043-84f7-f972d8536f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:34.628362 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f88e0-f669-4043-84f7-f972d8536f45 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:34.629301 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f88e0-f669-4043-84f7-f972d8536f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:34.629574 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f88e0-f669-4043-84f7-f972d8536f45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:34.641388 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674f88e0-f669-4043-84f7-f972d8536f45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:30:34.646910 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-674f88e0-f669-4043-84f7-f972d8536f45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:30:34.646910 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:34.646910 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:34.646910 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:34.646910 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:34.646910 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:34.646910 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:34.646910 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:34.646910 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:34.646910 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:34.646910 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:34.646910 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:34.646910 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:30:34.646910 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:30:34.646910 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:30:34.646910 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:30:34.648066 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:30:34.648066 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:30:34.648066 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:30:34.648066 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:30:34.648066 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:34.648066 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:34.648066 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:34.648066 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:34.648066 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:34.648066 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:34.648066 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:34.648066 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:34.648066 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:34.648066 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:34.648066 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:34.648066 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:34.649029 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:34.649029 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:34.649029 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:34.649029 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:34.649029 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:30:34.649029 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:30:34.649029 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:30:34.649029 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:30:34.649029 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:30:34.649029 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:30:34.649029 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:30:34.649029 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:34.653222 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 371/740] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 5 02:30:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:34.654572 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc29b6-5a14-4d6e-8a4c-db05b2c5f10c None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:34.654796 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc29b6-5a14-4d6e-8a4c-db05b2c5f10c None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:34.655108 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc29b6-5a14-4d6e-8a4c-db05b2c5f10c None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:34.656368 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 372/741] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:30:34.657166 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc29b6-5a14-4d6e-8a4c-db05b2c5f10c None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:34.675589 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 370/742] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:30:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:30:34.681321 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbff046-d01f-4e56-a541-d5eed1b5bdee None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:34.746135 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:34.765506 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc29b6-5a14-4d6e-8a4c-db05b2c5f10c None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:34.789369 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbff046-d01f-4e56-a541-d5eed1b5bdee None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:34.802117 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de35fe-f10f-4376-a55d-5b6b20e7842d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:34.802829 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de35fe-f10f-4376-a55d-5b6b20e7842d None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:34.803288 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de35fe-f10f-4376-a55d-5b6b20e7842d None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:34.803628 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de35fe-f10f-4376-a55d-5b6b20e7842d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:34.829599 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a67ae4-ec21-4386-8e9e-b66821cd89a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:34.830551 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a67ae4-ec21-4386-8e9e-b66821cd89a0 None admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:34.830839 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a67ae4-ec21-4386-8e9e-b66821cd89a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:34.831259 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a67ae4-ec21-4386-8e9e-b66821cd89a0 None admin] PATH_INFO: `/v3/services` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:34.832587 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a67ae4-ec21-4386-8e9e-b66821cd89a0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:34.833970 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a67ae4-ec21-4386-8e9e-b66821cd89a0 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:34.885457 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de35fe-f10f-4376-a55d-5b6b20e7842d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:34.886853 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de35fe-f10f-4376-a55d-5b6b20e7842d None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:34.938573 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:34.945634 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 371/743] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Aug 5 02:30:34 2022] POST /identity/v3/services => generated 240 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:30:34.946447 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a67ae4-ec21-4386-8e9e-b66821cd89a0 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:34.974531 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:34.997369 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 373/744] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:30:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:30:34.998241 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc213f5-5335-4f35-af31-cc122c07e240 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:34.998537 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc213f5-5335-4f35-af31-cc122c07e240 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:34.998808 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc213f5-5335-4f35-af31-cc122c07e240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:35.024843 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-4fc213f5-5335-4f35-af31-cc122c07e240 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:35.026478 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-4fc213f5-5335-4f35-af31-cc122c07e240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:35.097440 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a67ae4-ec21-4386-8e9e-b66821cd89a0 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:35.126980 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 374/745] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:34 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:30:35.127841 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc213f5-5335-4f35-af31-cc122c07e240 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:35.152856 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb694e-5ebe-42c0-869d-6f18143097c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:35.153710 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb694e-5ebe-42c0-869d-6f18143097c4 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:35.154153 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb694e-5ebe-42c0-869d-6f18143097c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:35.154583 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb694e-5ebe-42c0-869d-6f18143097c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:35.155337 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbb694e-5ebe-42c0-869d-6f18143097c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:35.155717 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbb694e-5ebe-42c0-869d-6f18143097c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:35.157463 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbb694e-5ebe-42c0-869d-6f18143097c4 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:35.166392 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 372/746] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:30:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:35.171176 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb694e-5ebe-42c0-869d-6f18143097c4 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:35.244495 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:35.252337 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc213f5-5335-4f35-af31-cc122c07e240 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:35.267808 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:35.292248 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43c586-e4b0-4429-9ec8-e44b45ce1f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:35.293913 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43c586-e4b0-4429-9ec8-e44b45ce1f06 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:35.294628 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43c586-e4b0-4429-9ec8-e44b45ce1f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:35.295116 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43c586-e4b0-4429-9ec8-e44b45ce1f06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:35.309404 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb694e-5ebe-42c0-869d-6f18143097c4 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:35.313263 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43c586-e4b0-4429-9ec8-e44b45ce1f06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:35.316169 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43c586-e4b0-4429-9ec8-e44b45ce1f06 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:35.337554 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-cc43c586-e4b0-4429-9ec8-e44b45ce1f06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:35.337554 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:35.337554 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:35.337554 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:35.337554 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:35.337554 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:35.337554 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:35.337554 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:35.337554 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:35.337554 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:35.337554 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:35.337554 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:35.337554 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:35.337554 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:35.337554 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:35.338575 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:35.338575 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:35.338575 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:35.338575 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:35.338575 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:35.338575 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:35.338575 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:35.338575 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:35.338575 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:35.338575 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:35.338575 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:35.338575 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:35.338575 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:35.338575 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:35.338575 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:35.338575 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:35.338575 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:35.339533 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:35.339533 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:35.339533 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:35.339533 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:35.343161 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 375/747] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:35.344840 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43c586-e4b0-4429-9ec8-e44b45ce1f06 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:35.359359 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9bbd9-3777-44b1-b6fe-45817d0050c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:35.360227 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9bbd9-3777-44b1-b6fe-45817d0050c7 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:35.360339 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9bbd9-3777-44b1-b6fe-45817d0050c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:35.360563 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9bbd9-3777-44b1-b6fe-45817d0050c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:35.373150 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d9bbd9-3777-44b1-b6fe-45817d0050c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:35.374609 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d9bbd9-3777-44b1-b6fe-45817d0050c7 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:35.389597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-64d9bbd9-3777-44b1-b6fe-45817d0050c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:35.389597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:35.389597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:35.389597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:35.389597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:35.389597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:35.389597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:35.389597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:35.389597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:35.389597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:35.389597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:35.389597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:35.389597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:35.389597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:35.389597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:35.390532 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:35.390532 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:35.390532 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:35.390532 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:35.390532 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:35.390532 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:35.390532 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:35.390532 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:35.390532 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:35.390532 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:35.390532 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:35.390532 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:35.390532 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:35.390532 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:35.390532 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:35.390532 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:35.390532 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:35.392140 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:35.392140 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:35.392140 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:35.392140 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:35.392140 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 373/748] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:35.392140 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9bbd9-3777-44b1-b6fe-45817d0050c7 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:35.467209 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43c586-e4b0-4429-9ec8-e44b45ce1f06 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:35.507895 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b97a21-78af-43ce-81c7-72739e2e2dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:35.508827 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b97a21-78af-43ce-81c7-72739e2e2dac None admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:35.510250 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b97a21-78af-43ce-81c7-72739e2e2dac None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:35.510250 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b97a21-78af-43ce-81c7-72739e2e2dac None admin] PATH_INFO: `/v3/services` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:35.510250 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b97a21-78af-43ce-81c7-72739e2e2dac None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:35.512017 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b97a21-78af-43ce-81c7-72739e2e2dac None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:35.517622 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9bbd9-3777-44b1-b6fe-45817d0050c7 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:35.528542 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:35.567770 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a01bd-9eb5-435b-baac-91950c1e9fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:35.568526 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a01bd-9eb5-435b-baac-91950c1e9fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:35.568834 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a01bd-9eb5-435b-baac-91950c1e9fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:35.569123 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a01bd-9eb5-435b-baac-91950c1e9fe6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:35.583624 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a01bd-9eb5-435b-baac-91950c1e9fe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:35.585076 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a01bd-9eb5-435b-baac-91950c1e9fe6 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:35.600959 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-074a01bd-9eb5-435b-baac-91950c1e9fe6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:35.600959 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:35.600959 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:35.600959 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:35.600959 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:35.600959 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:35.600959 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:35.600959 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:35.600959 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:35.600959 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:35.600959 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:35.600959 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:35.600959 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:35.600959 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:35.600959 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:35.601899 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:35.601899 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:35.601899 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:35.601899 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:35.601899 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:35.601899 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:35.601899 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:35.601899 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:35.601899 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:35.601899 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:35.601899 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:35.601899 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:35.601899 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:35.601899 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:35.601899 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:35.601899 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:35.601899 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:35.602799 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:35.602799 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:35.602799 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:35.602799 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:35.606851 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 374/749] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:35.607709 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a01bd-9eb5-435b-baac-91950c1e9fe6 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:35.613735 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 376/750] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Aug 5 02:30:35 2022] POST /identity/v3/services => generated 251 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:30:35.614825 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b97a21-78af-43ce-81c7-72739e2e2dac None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:35.652833 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:35.804800 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b97a21-78af-43ce-81c7-72739e2e2dac None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:35.833348 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a01bd-9eb5-435b-baac-91950c1e9fe6 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:35.862973 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ce0e8-f2c0-4667-af62-2d241d08adc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:35.863693 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ce0e8-f2c0-4667-af62-2d241d08adc1 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:35.863980 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ce0e8-f2c0-4667-af62-2d241d08adc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:35.864275 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ce0e8-f2c0-4667-af62-2d241d08adc1 None admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:35.864964 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ce0e8-f2c0-4667-af62-2d241d08adc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:35.865272 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ce0e8-f2c0-4667-af62-2d241d08adc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:35.866777 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ce0e8-f2c0-4667-af62-2d241d08adc1 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:35.883050 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 377/751] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:35.884729 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ce0e8-f2c0-4667-af62-2d241d08adc1 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:35.898513 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c236e9-23bc-4def-a74d-d1fab77c8a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:35.899565 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c236e9-23bc-4def-a74d-d1fab77c8a41 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:35.901798 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c236e9-23bc-4def-a74d-d1fab77c8a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:35.904183 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c236e9-23bc-4def-a74d-d1fab77c8a41 None admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:35.905165 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c236e9-23bc-4def-a74d-d1fab77c8a41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:35.907670 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c236e9-23bc-4def-a74d-d1fab77c8a41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:35.912547 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c236e9-23bc-4def-a74d-d1fab77c8a41 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:35.929235 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 375/752] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:35.931841 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c236e9-23bc-4def-a74d-d1fab77c8a41 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:35.975333 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:36.021444 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:36.052023 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ce0e8-f2c0-4667-af62-2d241d08adc1 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:36.084190 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c236e9-23bc-4def-a74d-d1fab77c8a41 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:36.101441 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8469e0e-03ea-45eb-8418-8f2d66bd3308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:36.103456 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8469e0e-03ea-45eb-8418-8f2d66bd3308 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:36.106544 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8469e0e-03ea-45eb-8418-8f2d66bd3308 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:36.106544 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8469e0e-03ea-45eb-8418-8f2d66bd3308 None admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:36.107134 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8469e0e-03ea-45eb-8418-8f2d66bd3308 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:36.109030 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8469e0e-03ea-45eb-8418-8f2d66bd3308 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:36.111708 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8469e0e-03ea-45eb-8418-8f2d66bd3308 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:36.133295 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 378/753] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:36.134355 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8469e0e-03ea-45eb-8418-8f2d66bd3308 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:36.160521 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55046c5-2157-41ae-ad99-34130e442c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:36.161985 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55046c5-2157-41ae-ad99-34130e442c44 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:36.163006 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55046c5-2157-41ae-ad99-34130e442c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:36.163526 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55046c5-2157-41ae-ad99-34130e442c44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:36.171563 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55046c5-2157-41ae-ad99-34130e442c44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:36.173421 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55046c5-2157-41ae-ad99-34130e442c44 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:36.188446 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-b55046c5-2157-41ae-ad99-34130e442c44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:36.188446 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:36.188446 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:36.188446 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:36.188446 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:36.188446 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:36.188446 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:36.188446 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:36.188446 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:36.188446 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:36.188446 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:36.188446 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:36.188446 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:30:36.188446 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:30:36.188446 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:30:36.189455 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:30:36.189455 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:36.189455 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:36.189455 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:36.189455 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:36.189455 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:36.189455 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:36.189455 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:36.189455 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:36.189455 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:36.189455 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:36.189455 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:36.189455 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:36.189455 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:36.189455 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:36.189455 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:36.189455 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:36.190333 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:30:36.190333 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:30:36.190333 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:30:36.190333 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:30:36.190333 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:30:36.190333 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:30:36.190333 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:36.190333 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:36.194761 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 376/754] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:30:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:36.195893 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55046c5-2157-41ae-ad99-34130e442c44 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:36.333522 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8469e0e-03ea-45eb-8418-8f2d66bd3308 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:36.381689 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:36.385655 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb045a59-50a3-447c-9819-63e31b5ec8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:36.388846 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb045a59-50a3-447c-9819-63e31b5ec8f3 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:36.389138 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb045a59-50a3-447c-9819-63e31b5ec8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:36.389416 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb045a59-50a3-447c-9819-63e31b5ec8f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:36.405283 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb045a59-50a3-447c-9819-63e31b5ec8f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:36.406794 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb045a59-50a3-447c-9819-63e31b5ec8f3 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:36.415558 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:36.429126 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-fb045a59-50a3-447c-9819-63e31b5ec8f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:36.429126 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:36.429126 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:36.429126 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:36.429126 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:36.429126 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:36.429126 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:36.429126 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:36.429126 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:36.429126 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:36.429126 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:36.429126 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:36.429126 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:30:36.429126 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:30:36.429126 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:30:36.430069 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:30:36.430069 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:36.430069 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:36.430069 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:36.430069 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:36.430069 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:36.430069 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:36.430069 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:36.430069 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:36.430069 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:36.430069 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:36.430069 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:36.430069 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:36.430069 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:36.430069 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:36.430069 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:36.430069 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:36.431091 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:30:36.431091 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:30:36.431091 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:30:36.431091 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:30:36.431091 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:30:36.431091 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:30:36.431091 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:36.431091 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:36.431974 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55046c5-2157-41ae-ad99-34130e442c44 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:36.434148 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 379/755] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:30:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:36.435212 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb045a59-50a3-447c-9819-63e31b5ec8f3 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:36.510238 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645e1e0-4e5b-417a-83be-b06a19162c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:36.510905 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645e1e0-4e5b-417a-83be-b06a19162c54 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:36.511208 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645e1e0-4e5b-417a-83be-b06a19162c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:36.511481 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645e1e0-4e5b-417a-83be-b06a19162c54 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:36.533789 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b645e1e0-4e5b-417a-83be-b06a19162c54 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:36.535393 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b645e1e0-4e5b-417a-83be-b06a19162c54 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:36.563094 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-b645e1e0-4e5b-417a-83be-b06a19162c54 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 02:30:36.563094 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:36.563094 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:36.563094 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:36.563094 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:36.563094 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:36.563094 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:36.563094 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:36.563094 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:36.563094 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:36.563094 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:36.563094 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:36.563094 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:30:36.563094 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:30:36.563094 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:30:36.563094 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:30:36.564124 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:36.564124 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:36.564124 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:30:36.564124 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:36.564124 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:30:36.564124 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:36.564124 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:36.564124 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:36.564124 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:36.564124 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:36.564124 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:36.564124 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:36.564124 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:36.564124 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:36.564124 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:36.564124 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:36.564124 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:36.564124 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:36.565102 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:36.565102 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:36.565102 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:30:36.565102 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:30:36.565102 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:30:36.565102 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:30:36.565102 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:30:36.565102 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:30:36.565102 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 02:30:36.565102 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:36.565102 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 377/756] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Aug 5 02:30:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:36.565698 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645e1e0-4e5b-417a-83be-b06a19162c54 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:36.577615 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb045a59-50a3-447c-9819-63e31b5ec8f3 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:36.628093 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8778526-4ee3-414f-a978-0a421d00c35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:36.629666 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8778526-4ee3-414f-a978-0a421d00c35e None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:36.630286 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8778526-4ee3-414f-a978-0a421d00c35e None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:36.631117 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8778526-4ee3-414f-a978-0a421d00c35e None admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:36.632134 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8778526-4ee3-414f-a978-0a421d00c35e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:36.632657 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8778526-4ee3-414f-a978-0a421d00c35e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:36.634497 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8778526-4ee3-414f-a978-0a421d00c35e None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:36.653526 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 380/757] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 5 02:30:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:36.654726 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8778526-4ee3-414f-a978-0a421d00c35e None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:36.744656 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:36.783447 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645e1e0-4e5b-417a-83be-b06a19162c54 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:36.799488 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8778526-4ee3-414f-a978-0a421d00c35e None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:36.845533 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b7b94-f924-4d8e-8cdf-97fdf688b01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:36.846531 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b7b94-f924-4d8e-8cdf-97fdf688b01f None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:36.847039 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b7b94-f924-4d8e-8cdf-97fdf688b01f None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:36.847571 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b7b94-f924-4d8e-8cdf-97fdf688b01f None admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:36.848729 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b7b94-f924-4d8e-8cdf-97fdf688b01f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:36.851291 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b7b94-f924-4d8e-8cdf-97fdf688b01f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:36.853476 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b7b94-f924-4d8e-8cdf-97fdf688b01f None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:36.860027 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010535b5-fb07-4bcf-9500-32ec44ab358a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:36.860662 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010535b5-fb07-4bcf-9500-32ec44ab358a None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:36.860939 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010535b5-fb07-4bcf-9500-32ec44ab358a None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:36.861211 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010535b5-fb07-4bcf-9500-32ec44ab358a None admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:36.861974 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010535b5-fb07-4bcf-9500-32ec44ab358a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:36.862275 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010535b5-fb07-4bcf-9500-32ec44ab358a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:36.868034 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010535b5-fb07-4bcf-9500-32ec44ab358a None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:36.876158 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 381/758] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Aug 5 02:30:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:36.877259 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b7b94-f924-4d8e-8cdf-97fdf688b01f None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:36.884704 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:36.896193 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 378/759] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 5 02:30:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:36.898441 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010535b5-fb07-4bcf-9500-32ec44ab358a None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:37.032127 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010535b5-fb07-4bcf-9500-32ec44ab358a None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:37.084025 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914474e5-d9b0-4e1f-b0e9-d086258d7280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:37.085707 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914474e5-d9b0-4e1f-b0e9-d086258d7280 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:37.085707 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914474e5-d9b0-4e1f-b0e9-d086258d7280 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:37.085707 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914474e5-d9b0-4e1f-b0e9-d086258d7280 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:37.090970 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b7b94-f924-4d8e-8cdf-97fdf688b01f None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:37.100090 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914474e5-d9b0-4e1f-b0e9-d086258d7280 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:37.102014 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914474e5-d9b0-4e1f-b0e9-d086258d7280 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:37.109594 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:37.122081 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-914474e5-d9b0-4e1f-b0e9-d086258d7280 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:37.122081 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:37.122081 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:37.122081 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:37.122081 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:37.122081 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:37.122081 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:37.122081 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:37.122081 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:37.122081 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:37.122081 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:37.122081 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:37.122081 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:37.122081 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:37.122081 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:37.128002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:37.128002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:37.128002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:37.128002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:37.128002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:37.128002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:37.128002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:37.128002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:37.128002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:37.128002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:37.128002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:37.128002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:37.128002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:37.128002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:37.128002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:37.128002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:37.128002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:37.128927 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:37.128927 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:37.128927 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:37.128927 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:37.128927 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 379/760] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:37.128927 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914474e5-d9b0-4e1f-b0e9-d086258d7280 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:37.129500 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e95ec-269c-47dd-b85a-6dc3f025a56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:37.129500 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e95ec-269c-47dd-b85a-6dc3f025a56a None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:37.129500 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e95ec-269c-47dd-b85a-6dc3f025a56a None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:37.129500 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e95ec-269c-47dd-b85a-6dc3f025a56a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:37.130395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e95ec-269c-47dd-b85a-6dc3f025a56a None admin] RBAC: Adding query filter params (role.id=2642213efc7d4861b3d3b4f5fbc9ad73, scope.project.id=63b323c02a614fc28aac6e7a060064ba, user.id=6bea520676244effbbe212aa62b1cc68) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:37.130782 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e95ec-269c-47dd-b85a-6dc3f025a56a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:37.132343 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e95ec-269c-47dd-b85a-6dc3f025a56a None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:37.138744 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 382/761] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:30:36 2022] GET /identity/v3/role_assignments?user.id=6bea520676244effbbe212aa62b1cc68&scope.project.id=63b323c02a614fc28aac6e7a060064ba&role.id=2642213efc7d4861b3d3b4f5fbc9ad73 => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:37.139811 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0da96f-554e-4a64-9761-27622683c468 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:37.140094 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0da96f-554e-4a64-9761-27622683c468 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:37.140367 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0da96f-554e-4a64-9761-27622683c468 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:37.141796 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 383/762] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:30:37.146978 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0da96f-554e-4a64-9761-27622683c468 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:37.221580 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:37.306140 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914474e5-d9b0-4e1f-b0e9-d086258d7280 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:37.356707 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be338c19-9f95-4263-ae5b-11ec1db48a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:37.362992 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be338c19-9f95-4263-ae5b-11ec1db48a78 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:37.362992 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be338c19-9f95-4263-ae5b-11ec1db48a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:37.362992 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be338c19-9f95-4263-ae5b-11ec1db48a78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:37.362992 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be338c19-9f95-4263-ae5b-11ec1db48a78 None admin] RBAC: Adding query filter params (role.id=83afe883a303495b966480fb9b5bb7dd, scope.project.id=63b323c02a614fc28aac6e7a060064ba, user.id=40f706f1eb2b4137afd367cb5060ced0) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:37.362992 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be338c19-9f95-4263-ae5b-11ec1db48a78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:37.362992 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be338c19-9f95-4263-ae5b-11ec1db48a78 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:37.363449 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0da96f-554e-4a64-9761-27622683c468 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:37.369882 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 380/763] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:30:37 2022] GET /identity/v3/role_assignments?user.id=40f706f1eb2b4137afd367cb5060ced0&scope.project.id=63b323c02a614fc28aac6e7a060064ba&role.id=83afe883a303495b966480fb9b5bb7dd => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:37.372282 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69401da-b691-4d1b-af33-b391c85fba7d None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:37.374983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69401da-b691-4d1b-af33-b391c85fba7d None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:37.374983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69401da-b691-4d1b-af33-b391c85fba7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:37.398146 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-c69401da-b691-4d1b-af33-b391c85fba7d None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:37.402994 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-c69401da-b691-4d1b-af33-b391c85fba7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:37.422106 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d988a4-ec43-4eef-8229-fa8dd255e445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:37.424966 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d988a4-ec43-4eef-8229-fa8dd255e445 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:37.426983 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d988a4-ec43-4eef-8229-fa8dd255e445 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:37.426983 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d988a4-ec43-4eef-8229-fa8dd255e445 None admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:37.426983 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d988a4-ec43-4eef-8229-fa8dd255e445 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:37.426983 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d988a4-ec43-4eef-8229-fa8dd255e445 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:37.430687 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d988a4-ec43-4eef-8229-fa8dd255e445 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:37.459246 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 384/764] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:37.460248 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d988a4-ec43-4eef-8229-fa8dd255e445 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:37.529225 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 381/765] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:30:37.563124 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:37.580289 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69401da-b691-4d1b-af33-b391c85fba7d None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:37.667349 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d988a4-ec43-4eef-8229-fa8dd255e445 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:37.672135 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:37.727597 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8082aa-2835-4b14-a01f-4954f8791a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:37.728245 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8082aa-2835-4b14-a01f-4954f8791a84 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:37.728524 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8082aa-2835-4b14-a01f-4954f8791a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:37.728799 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8082aa-2835-4b14-a01f-4954f8791a84 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:37.735399 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69401da-b691-4d1b-af33-b391c85fba7d None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:37.747812 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8082aa-2835-4b14-a01f-4954f8791a84 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:37.749287 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8082aa-2835-4b14-a01f-4954f8791a84 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:37.775375 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623953ef-d8b7-40af-8f3e-54b9698f015d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:37.776439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623953ef-d8b7-40af-8f3e-54b9698f015d None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:37.776925 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623953ef-d8b7-40af-8f3e-54b9698f015d None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:37.777054 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-4d8082aa-2835-4b14-a01f-4954f8791a84 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:37.777054 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:37.777054 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:37.777054 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:37.777054 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:37.777054 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:37.777054 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:37.777054 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:37.777054 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:37.777054 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:37.777054 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:37.777054 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:37.777054 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:30:37.777054 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:30:37.777054 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:30:37.777958 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:30:37.777958 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:37.777958 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:37.777958 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:37.777958 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:37.777958 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:37.777958 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:37.777958 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:37.777958 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:37.777958 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:37.777958 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:37.777958 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:37.777958 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:37.777958 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:37.777958 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:37.777958 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:37.777958 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:37.778855 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:30:37.778855 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:30:37.778855 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:30:37.778855 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:30:37.778855 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:30:37.778855 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:30:37.778855 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:37.778855 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:37.780294 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623953ef-d8b7-40af-8f3e-54b9698f015d None admin] PATH_INFO: `/v3/services/network` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:37.781139 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623953ef-d8b7-40af-8f3e-54b9698f015d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:37.782876 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623953ef-d8b7-40af-8f3e-54b9698f015d None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:37.785739 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 385/766] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:30:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:37.786532 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8082aa-2835-4b14-a01f-4954f8791a84 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:37.795833 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-623953ef-d8b7-40af-8f3e-54b9698f015d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 02:30:37.795833 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:37.795833 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:30:37.795833 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:30:37.795833 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:30:37.795833 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:30:37.795833 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:30:37.795833 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:30:37.795833 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 02:30:37.795833 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:37.795833 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:30:37.795833 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:37.795833 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:37.795833 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:37.795833 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:37.795833 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:37.795833 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:37.796833 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:37.796833 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:37.796833 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:37.796833 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:37.796833 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:37.796833 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:37.796833 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:30:37.796833 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:30:37.796833 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:30:37.796833 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:30:37.796833 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:37.796833 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:37.796833 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:37.796833 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:37.796833 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:37.796833 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:37.797698 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:37.797698 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:37.797698 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:37.797698 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:37.797698 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:37.797698 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:37.797698 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:37.797698 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:37.797698 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:37.797698 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:37.797698 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:30:37.797698 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:30:37.797698 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 02:30:37.797698 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:37.801094 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 382/767] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:30:37 2022] GET /identity/v3/services/network => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:30:37.808358 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623953ef-d8b7-40af-8f3e-54b9698f015d None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:37.991470 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623953ef-d8b7-40af-8f3e-54b9698f015d None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:38.017675 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:38.038729 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c0374-f01b-4607-95b7-8fd3de05dad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:38.039539 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c0374-f01b-4607-95b7-8fd3de05dad8 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:38.039929 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c0374-f01b-4607-95b7-8fd3de05dad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:38.040297 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c0374-f01b-4607-95b7-8fd3de05dad8 None admin] PATH_INFO: `/v3/services` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:38.046982 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9c0374-f01b-4607-95b7-8fd3de05dad8 None admin] RBAC: Adding query filter params (name=network) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:38.046982 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9c0374-f01b-4607-95b7-8fd3de05dad8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:38.046982 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9c0374-f01b-4607-95b7-8fd3de05dad8 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:38.051458 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 383/768] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Aug 5 02:30:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:38.056572 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c0374-f01b-4607-95b7-8fd3de05dad8 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:38.072399 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8082aa-2835-4b14-a01f-4954f8791a84 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:38.074276 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:38.134974 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504dba68-414c-4d3a-af05-2e5e3a4b2bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:38.134974 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504dba68-414c-4d3a-af05-2e5e3a4b2bcc None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:38.134974 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504dba68-414c-4d3a-af05-2e5e3a4b2bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:38.134974 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504dba68-414c-4d3a-af05-2e5e3a4b2bcc None admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:38.137302 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504dba68-414c-4d3a-af05-2e5e3a4b2bcc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:38.137630 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504dba68-414c-4d3a-af05-2e5e3a4b2bcc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:38.139266 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504dba68-414c-4d3a-af05-2e5e3a4b2bcc None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:38.158880 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 386/769] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 5 02:30:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:38.160322 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545c988-a787-4960-a3d2-379996dcb438 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:38.160625 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545c988-a787-4960-a3d2-379996dcb438 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:38.160898 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545c988-a787-4960-a3d2-379996dcb438 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:38.166496 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 387/770] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:30:38.167416 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545c988-a787-4960-a3d2-379996dcb438 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:38.190312 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c0374-f01b-4607-95b7-8fd3de05dad8 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:38.238972 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0f5ef-69b5-44af-9332-89eba387f944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:38.238972 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0f5ef-69b5-44af-9332-89eba387f944 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:38.239266 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0f5ef-69b5-44af-9332-89eba387f944 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:38.239349 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0f5ef-69b5-44af-9332-89eba387f944 None admin] PATH_INFO: `/v3/services` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:38.243025 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a0f5ef-69b5-44af-9332-89eba387f944 None admin] RBAC: Adding query filter params (type=network) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:38.243025 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a0f5ef-69b5-44af-9332-89eba387f944 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:38.250975 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a0f5ef-69b5-44af-9332-89eba387f944 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:38.260760 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 384/771] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Aug 5 02:30:38 2022] GET /identity/v3/services?type=network => generated 350 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:38.263504 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5f67b-747e-4964-abb0-09215cc06c18 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:38.266973 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5f67b-747e-4964-abb0-09215cc06c18 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:38.266973 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5f67b-747e-4964-abb0-09215cc06c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:38.316775 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-86c5f67b-747e-4964-abb0-09215cc06c18 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:38.317986 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-86c5f67b-747e-4964-abb0-09215cc06c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:38.373768 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545c988-a787-4960-a3d2-379996dcb438 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:38.375654 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:38.444191 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 385/772] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:30:38.445918 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c5f67b-747e-4964-abb0-09215cc06c18 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:38.467424 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a682ddb-a650-42a3-9caf-78d49893340c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:38.468471 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a682ddb-a650-42a3-9caf-78d49893340c None admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:38.468979 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a682ddb-a650-42a3-9caf-78d49893340c None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:38.469502 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a682ddb-a650-42a3-9caf-78d49893340c None admin] PATH_INFO: `/v3/projects/63b323c02a614fc28aac6e7a060064ba/users/55374d3bccd541c9a8f82da9b21c2fb8/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:38.479729 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a682ddb-a650-42a3-9caf-78d49893340c None admin] RBAC: Authorizing `identity:create_grant(project_id=63b323c02a614fc28aac6e7a060064ba, user_id=55374d3bccd541c9a8f82da9b21c2fb8, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:38.481477 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a682ddb-a650-42a3-9caf-78d49893340c None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:38.567194 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 388/773] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 5 02:30:38 2022] PUT /identity/v3/projects/63b323c02a614fc28aac6e7a060064ba/users/55374d3bccd541c9a8f82da9b21c2fb8/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:30:38.570464 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a682ddb-a650-42a3-9caf-78d49893340c None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:38.604254 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c5f67b-747e-4964-abb0-09215cc06c18 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:38.654984 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c2d7a9-c3b4-46ae-8c05-abbaf300ca09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:38.654984 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2d7a9-c3b4-46ae-8c05-abbaf300ca09 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:38.654984 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2d7a9-c3b4-46ae-8c05-abbaf300ca09 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:38.654984 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2d7a9-c3b4-46ae-8c05-abbaf300ca09 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:38.655418 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c2d7a9-c3b4-46ae-8c05-abbaf300ca09 None admin] RBAC: Adding query filter params (interface=public, service_id=c8331a34ff354d62bff63769eb7e1d54, region_id=RegionOne) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:38.655418 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c2d7a9-c3b4-46ae-8c05-abbaf300ca09 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:38.655418 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c2d7a9-c3b4-46ae-8c05-abbaf300ca09 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:38.662851 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 386/774] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Aug 5 02:30:38 2022] GET /identity/v3/endpoints?service_id=c8331a34ff354d62bff63769eb7e1d54&interface=public®ion_id=RegionOne => generated 194 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:38.667844 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c2d7a9-c3b4-46ae-8c05-abbaf300ca09 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:38.677854 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:38.712631 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:38.802448 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c2d7a9-c3b4-46ae-8c05-abbaf300ca09 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:38.863344 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facaece6-e35c-49f5-b9dd-a3d6ea815a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:38.865306 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facaece6-e35c-49f5-b9dd-a3d6ea815a15 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:38.865796 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facaece6-e35c-49f5-b9dd-a3d6ea815a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:38.866527 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facaece6-e35c-49f5-b9dd-a3d6ea815a15 None admin] PATH_INFO: `/v3/services` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:38.867991 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facaece6-e35c-49f5-b9dd-a3d6ea815a15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:38.869954 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facaece6-e35c-49f5-b9dd-a3d6ea815a15 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:38.873576 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a682ddb-a650-42a3-9caf-78d49893340c None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:38.881217 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 387/775] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Aug 5 02:30:38 2022] GET /identity/v3/services => generated 772 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:30:38.923976 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b911c06-a29c-4ea3-856b-3028b577d3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:38.924739 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b911c06-a29c-4ea3-856b-3028b577d3b5 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:38.925080 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b911c06-a29c-4ea3-856b-3028b577d3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:38.925462 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b911c06-a29c-4ea3-856b-3028b577d3b5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:38.926165 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b911c06-a29c-4ea3-856b-3028b577d3b5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:38.928028 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b911c06-a29c-4ea3-856b-3028b577d3b5 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:38.938989 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-2b911c06-a29c-4ea3-856b-3028b577d3b5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 02:30:38.938989 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:38.938989 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:30:38.938989 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:30:38.938989 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:30:38.938989 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:30:38.938989 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:30:38.938989 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:30:38.938989 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 02:30:38.938989 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:38.938989 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:30:38.938989 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:38.938989 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:38.938989 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:38.938989 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:38.938989 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:38.940173 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:38.940173 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:38.940173 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:38.940173 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:38.940173 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:38.940173 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:38.940173 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:38.940173 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:30:38.940173 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:30:38.940173 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:30:38.940173 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:30:38.940173 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:38.940173 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:38.940173 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:38.940173 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:38.940173 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:38.941253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:38.941253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:38.941253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:38.941253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:38.941253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:38.941253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:38.941253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:38.941253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:38.941253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:38.941253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:38.941253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:38.941253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:30:38.941253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:30:38.941253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 02:30:38.941253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:38.941253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 389/776] 10.222.0.42 () {56 vars in 1129 bytes} [Fri Aug 5 02:30:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:38.953973 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facaece6-e35c-49f5-b9dd-a3d6ea815a15 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:39.104584 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:39.116559 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facaece6-e35c-49f5-b9dd-a3d6ea815a15 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:39.174425 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041d4a2-9f70-49a9-96fe-50fa320efd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:39.175158 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041d4a2-9f70-49a9-96fe-50fa320efd67 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:39.175451 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041d4a2-9f70-49a9-96fe-50fa320efd67 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:39.175780 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041d4a2-9f70-49a9-96fe-50fa320efd67 None admin] PATH_INFO: `/v3/services` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:39.180639 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9041d4a2-9f70-49a9-96fe-50fa320efd67 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:39.180639 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9041d4a2-9f70-49a9-96fe-50fa320efd67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:39.180639 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9041d4a2-9f70-49a9-96fe-50fa320efd67 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:39.184881 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 388/777] 10.222.0.42 () {56 vars in 1124 bytes} [Fri Aug 5 02:30:38 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:39.193211 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b911c06-a29c-4ea3-856b-3028b577d3b5 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:39.296830 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:39.311509 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b911c06-a29c-4ea3-856b-3028b577d3b5 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:39.347958 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de6cb7-1025-41b3-b0c5-6ad1c1b0745c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:39.348823 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de6cb7-1025-41b3-b0c5-6ad1c1b0745c None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:39.349246 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de6cb7-1025-41b3-b0c5-6ad1c1b0745c None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:39.349684 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de6cb7-1025-41b3-b0c5-6ad1c1b0745c None admin] PATH_INFO: `/v3/services` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:39.350754 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de6cb7-1025-41b3-b0c5-6ad1c1b0745c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:39.351224 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de6cb7-1025-41b3-b0c5-6ad1c1b0745c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:39.353486 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de6cb7-1025-41b3-b0c5-6ad1c1b0745c None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:39.359299 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 390/778] 10.222.0.42 () {56 vars in 1124 bytes} [Fri Aug 5 02:30:39 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:39.368402 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041d4a2-9f70-49a9-96fe-50fa320efd67 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:39.524497 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b156c0-c6b3-4e71-ab54-3b2391126af4 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:39.525792 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b156c0-c6b3-4e71-ab54-3b2391126af4 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:39.526323 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b156c0-c6b3-4e71-ab54-3b2391126af4 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:39.528192 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 391/779] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:30:39.538224 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9455f-56fa-4a3a-b37c-b6558e6b1ab0 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:39.539295 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9455f-56fa-4a3a-b37c-b6558e6b1ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:39.539781 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9455f-56fa-4a3a-b37c-b6558e6b1ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:39.587574 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-0ce9455f-56fa-4a3a-b37c-b6558e6b1ab0 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:39.589133 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-0ce9455f-56fa-4a3a-b37c-b6558e6b1ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:39.600098 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041d4a2-9f70-49a9-96fe-50fa320efd67 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:39.676072 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d7ee4-6116-4849-a57c-f644be6d7cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:39.683752 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d7ee4-6116-4849-a57c-f644be6d7cdd None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:39.684349 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d7ee4-6116-4849-a57c-f644be6d7cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:39.684857 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d7ee4-6116-4849-a57c-f644be6d7cdd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:39.685917 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d7ee4-6116-4849-a57c-f644be6d7cdd None admin] RBAC: Adding query filter params (interface=public, service_id=78b5a93613ba476da1748ed8e8fd011e, region_id=RegionOne) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:39.687552 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d7ee4-6116-4849-a57c-f644be6d7cdd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:39.690509 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d7ee4-6116-4849-a57c-f644be6d7cdd None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:39.702578 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 389/780] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Aug 5 02:30:39 2022] GET /identity/v3/endpoints?service_id=78b5a93613ba476da1748ed8e8fd011e&interface=public®ion_id=RegionOne => generated 194 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:39.708579 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d7ee4-6116-4849-a57c-f644be6d7cdd None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:39.755547 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 392/781] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:30:39.760278 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:39.836261 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9455f-56fa-4a3a-b37c-b6558e6b1ab0 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:39.877159 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d7ee4-6116-4849-a57c-f644be6d7cdd None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:39.952301 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e9fb7-8eb0-47ee-aebe-4a68fd30a776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:39.952867 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e9fb7-8eb0-47ee-aebe-4a68fd30a776 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:39.953146 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e9fb7-8eb0-47ee-aebe-4a68fd30a776 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:39.953416 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e9fb7-8eb0-47ee-aebe-4a68fd30a776 None admin] PATH_INFO: `/v3/services` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:39.954070 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e9fb7-8eb0-47ee-aebe-4a68fd30a776 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:39.955471 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e9fb7-8eb0-47ee-aebe-4a68fd30a776 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:39.963402 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 390/782] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Aug 5 02:30:39 2022] GET /identity/v3/services => generated 772 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:39.969720 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:39.969914 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c046c5e-ceff-4634-b0f5-78add958d0c6 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:39.969914 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c046c5e-ceff-4634-b0f5-78add958d0c6 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:39.970053 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c046c5e-ceff-4634-b0f5-78add958d0c6 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:39.978236 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 391/783] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:39 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:30:39.979721 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54595e16-8503-4323-8641-a91e82d48cfe None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:39.980009 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54595e16-8503-4323-8641-a91e82d48cfe None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:39.980281 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54595e16-8503-4323-8641-a91e82d48cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:40.021000 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9455f-56fa-4a3a-b37c-b6558e6b1ab0 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:40.023574 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-54595e16-8503-4323-8641-a91e82d48cfe None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:40.024767 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-54595e16-8503-4323-8641-a91e82d48cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:40.107299 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8085e-bcfa-4210-960c-0b9b35da7ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:40.107869 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8085e-bcfa-4210-960c-0b9b35da7ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:40.110804 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8085e-bcfa-4210-960c-0b9b35da7ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:40.110804 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8085e-bcfa-4210-960c-0b9b35da7ba2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:40.131906 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d8085e-bcfa-4210-960c-0b9b35da7ba2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:30:40.135250 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-c5d8085e-bcfa-4210-960c-0b9b35da7ba2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:30:40.135250 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:40.135250 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:40.135250 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:40.135250 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:40.135250 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:40.135250 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:40.135250 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:40.135250 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:40.135250 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:40.135250 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:40.135250 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:40.135250 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:30:40.135250 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:30:40.135250 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:30:40.135250 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:30:40.136196 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:30:40.136196 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:30:40.136196 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:30:40.136196 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:30:40.136196 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:40.136196 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:40.136196 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:40.136196 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:40.136196 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:40.136196 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:40.136196 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:40.136196 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:40.136196 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:40.136196 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:40.136196 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:40.136196 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:40.137048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:40.137048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:40.137048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:40.137048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:40.137048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:30:40.137048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:30:40.137048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:30:40.137048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:30:40.137048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:30:40.137048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:30:40.137048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:30:40.137048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:40.137048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 393/784] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 5 02:30:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:30:40.147556 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8085e-bcfa-4210-960c-0b9b35da7ba2 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:40.204825 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 392/785] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:30:40.242972 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54595e16-8503-4323-8641-a91e82d48cfe None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:40.260988 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:40.300035 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8085e-bcfa-4210-960c-0b9b35da7ba2 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:40.355704 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d37545-a3ce-48a4-9b3a-407c154c7212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:40.356345 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d37545-a3ce-48a4-9b3a-407c154c7212 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:40.356627 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d37545-a3ce-48a4-9b3a-407c154c7212 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:40.356904 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d37545-a3ce-48a4-9b3a-407c154c7212 None admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:40.357638 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d37545-a3ce-48a4-9b3a-407c154c7212 None admin] RBAC: Adding query filter params (name=service) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:40.362974 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d37545-a3ce-48a4-9b3a-407c154c7212 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:40.362974 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d37545-a3ce-48a4-9b3a-407c154c7212 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:40.364536 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54595e16-8503-4323-8641-a91e82d48cfe None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:40.380094 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 394/786] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 5 02:30:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:40.384569 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d37545-a3ce-48a4-9b3a-407c154c7212 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:40.393444 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:40.416625 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d223a-8487-44a3-b2f8-88bcae9042f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:40.417291 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d223a-8487-44a3-b2f8-88bcae9042f0 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:40.417638 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d223a-8487-44a3-b2f8-88bcae9042f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:40.417919 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d223a-8487-44a3-b2f8-88bcae9042f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:40.437178 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d223a-8487-44a3-b2f8-88bcae9042f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:30:40.442241 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-1d6d223a-8487-44a3-b2f8-88bcae9042f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:30:40.442241 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:40.442241 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:40.442241 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:40.442241 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:40.442241 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:40.442241 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:40.442241 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:40.442241 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:40.442241 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:40.442241 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:40.442241 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:40.442241 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:30:40.442241 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:30:40.442241 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:30:40.442241 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:30:40.443201 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:30:40.443201 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:30:40.443201 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:30:40.443201 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:30:40.443201 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:40.443201 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:40.443201 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:40.443201 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:40.443201 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:40.443201 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:40.443201 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:40.443201 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:40.443201 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:40.443201 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:40.443201 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:40.443201 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:40.444070 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:40.444070 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:40.444070 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:40.444070 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:40.444070 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:30:40.444070 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:30:40.444070 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:30:40.444070 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:30:40.444070 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:30:40.444070 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:30:40.444070 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:30:40.444070 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:40.455315 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 393/787] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 5 02:30:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:40.459061 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d223a-8487-44a3-b2f8-88bcae9042f0 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:40.605353 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d37545-a3ce-48a4-9b3a-407c154c7212 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:40.624035 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:40.652581 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d223a-8487-44a3-b2f8-88bcae9042f0 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:40.696518 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c240650-79c6-4c2b-9d52-b3e06b586a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:40.697566 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c240650-79c6-4c2b-9d52-b3e06b586a73 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:40.698124 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c240650-79c6-4c2b-9d52-b3e06b586a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:40.698738 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c240650-79c6-4c2b-9d52-b3e06b586a73 None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:40.699668 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c240650-79c6-4c2b-9d52-b3e06b586a73 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:40.700126 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c240650-79c6-4c2b-9d52-b3e06b586a73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:40.701581 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7874c4c2-d3b0-44fa-b9de-2f6807039fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:40.702031 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c240650-79c6-4c2b-9d52-b3e06b586a73 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:40.702241 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7874c4c2-d3b0-44fa-b9de-2f6807039fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:40.702535 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7874c4c2-d3b0-44fa-b9de-2f6807039fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:40.702818 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7874c4c2-d3b0-44fa-b9de-2f6807039fc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:40.717216 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 394/788] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:30:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:40.721937 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7874c4c2-d3b0-44fa-b9de-2f6807039fc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:40.723185 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c240650-79c6-4c2b-9d52-b3e06b586a73 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:40.728515 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7874c4c2-d3b0-44fa-b9de-2f6807039fc5 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:40.757129 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-7874c4c2-d3b0-44fa-b9de-2f6807039fc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:40.757129 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:40.757129 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:40.757129 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:40.757129 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:40.757129 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:40.757129 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:40.757129 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:40.757129 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:40.757129 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:40.757129 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:40.757129 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:40.757129 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:40.757129 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:40.757129 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:40.758107 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:40.758107 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:40.758107 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:40.758107 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:40.758107 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:40.758107 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:40.758107 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:40.758107 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:40.758107 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:40.758107 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:40.758107 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:40.758107 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:40.758107 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:40.758107 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:40.758107 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:40.758107 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:40.758107 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:40.759053 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:40.759053 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:40.759053 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:40.759053 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:40.764125 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 395/789] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:40.768067 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7874c4c2-d3b0-44fa-b9de-2f6807039fc5 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:40.874618 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c240650-79c6-4c2b-9d52-b3e06b586a73 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:40.898670 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:40.948554 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0054c3-a383-4fd6-b379-68054ad366e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:40.949641 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0054c3-a383-4fd6-b379-68054ad366e7 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:40.950312 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0054c3-a383-4fd6-b379-68054ad366e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:40.950787 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0054c3-a383-4fd6-b379-68054ad366e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:40.969122 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:40.972658 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0054c3-a383-4fd6-b379-68054ad366e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:40.978673 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0054c3-a383-4fd6-b379-68054ad366e7 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:41.014460 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-9f0054c3-a383-4fd6-b379-68054ad366e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:41.014460 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:41.014460 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:41.014460 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:41.014460 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:41.014460 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:41.014460 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:41.014460 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:41.014460 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:41.014460 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:41.014460 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:41.014460 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:41.014460 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:41.014460 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:41.014460 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:41.015509 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:41.015509 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:41.015509 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:41.015509 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:41.015509 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:41.015509 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:41.015509 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:41.015509 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:41.015509 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:41.015509 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:41.015509 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:41.015509 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:41.015509 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:41.015509 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:41.015509 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:41.015509 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:41.015509 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:41.016413 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:41.016413 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:41.016413 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:41.016413 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:41.018832 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 395/790] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:30:41.026695 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0054c3-a383-4fd6-b379-68054ad366e7 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:41.029072 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7874c4c2-d3b0-44fa-b9de-2f6807039fc5 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:41.127042 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2d80b-f636-4b10-90e2-7bda6809817c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:41.128029 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2d80b-f636-4b10-90e2-7bda6809817c None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:41.129077 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2d80b-f636-4b10-90e2-7bda6809817c None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:41.129590 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2d80b-f636-4b10-90e2-7bda6809817c None admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:41.130572 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2d80b-f636-4b10-90e2-7bda6809817c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:41.131148 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2d80b-f636-4b10-90e2-7bda6809817c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:41.132857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2d80b-f636-4b10-90e2-7bda6809817c None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:41.161370 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 396/791] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:41.167338 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2d80b-f636-4b10-90e2-7bda6809817c None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:41.280662 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0054c3-a383-4fd6-b379-68054ad366e7 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:41.322391 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a581f7-fec8-451b-9059-ba3cc9b0a101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:41.323090 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a581f7-fec8-451b-9059-ba3cc9b0a101 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:41.323746 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a581f7-fec8-451b-9059-ba3cc9b0a101 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:41.323746 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a581f7-fec8-451b-9059-ba3cc9b0a101 None admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:41.329378 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a581f7-fec8-451b-9059-ba3cc9b0a101 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:41.329378 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a581f7-fec8-451b-9059-ba3cc9b0a101 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:41.331754 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a581f7-fec8-451b-9059-ba3cc9b0a101 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:41.353208 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 396/792] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:41.355006 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545d819-fd7c-4d8c-89c7-88cb595f8f95 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:41.355006 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545d819-fd7c-4d8c-89c7-88cb595f8f95 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:41.355229 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545d819-fd7c-4d8c-89c7-88cb595f8f95 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:41.358821 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 397/793] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:30:41.368464 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1545d819-fd7c-4d8c-89c7-88cb595f8f95 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:41.378926 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2d80b-f636-4b10-90e2-7bda6809817c None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:41.408581 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:41.463188 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464dabe6-a5e0-4730-811f-7b73a8f8288c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:41.464177 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464dabe6-a5e0-4730-811f-7b73a8f8288c None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:41.465444 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464dabe6-a5e0-4730-811f-7b73a8f8288c None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:41.466622 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464dabe6-a5e0-4730-811f-7b73a8f8288c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:41.478688 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:41.481568 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464dabe6-a5e0-4730-811f-7b73a8f8288c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:41.483683 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464dabe6-a5e0-4730-811f-7b73a8f8288c None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:41.507182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-464dabe6-a5e0-4730-811f-7b73a8f8288c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 02:30:41.507182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:41.507182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:41.507182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:41.507182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:41.507182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:41.507182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:41.507182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:41.507182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:41.507182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:41.507182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:41.507182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:41.507182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:30:41.507182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:30:41.507182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:30:41.507182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:30:41.508294 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:41.508294 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:41.508294 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:30:41.508294 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:41.508294 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:30:41.508294 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:41.508294 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:41.508294 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:41.508294 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:41.508294 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:41.508294 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:41.508294 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:41.508294 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:41.508294 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:41.508294 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:41.508294 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:41.508294 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:41.508294 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:41.509263 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:41.509263 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:41.509263 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:30:41.509263 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:30:41.509263 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:30:41.509263 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:30:41.509263 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:30:41.509263 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:30:41.509263 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 02:30:41.509263 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:41.513478 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 397/794] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Aug 5 02:30:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:41.514807 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce040b1-0b63-4773-8481-e0bc40aa5b93 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:41.515136 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce040b1-0b63-4773-8481-e0bc40aa5b93 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:41.515415 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce040b1-0b63-4773-8481-e0bc40aa5b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:41.536514 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-1ce040b1-0b63-4773-8481-e0bc40aa5b93 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:41.537647 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-1ce040b1-0b63-4773-8481-e0bc40aa5b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:41.568648 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1545d819-fd7c-4d8c-89c7-88cb595f8f95 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:41.618767 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba2cb50-1179-4d82-81f9-7299e134eb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:41.619911 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2cb50-1179-4d82-81f9-7299e134eb98 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:41.620397 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2cb50-1179-4d82-81f9-7299e134eb98 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:41.620937 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2cb50-1179-4d82-81f9-7299e134eb98 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:41.621308 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 398/795] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:30:41.622868 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28015828-d11a-4da9-9e91-914fe4f77907 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:41.623228 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28015828-d11a-4da9-9e91-914fe4f77907 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:41.623509 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28015828-d11a-4da9-9e91-914fe4f77907 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:41.624877 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 399/796] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:30:41.625486 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28015828-d11a-4da9-9e91-914fe4f77907 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:41.641956 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba2cb50-1179-4d82-81f9-7299e134eb98 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:41.644743 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba2cb50-1179-4d82-81f9-7299e134eb98 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:41.659911 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-5ba2cb50-1179-4d82-81f9-7299e134eb98 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 05 02:30:41.659911 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:41.659911 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:41.659911 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:41.659911 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:41.659911 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:41.659911 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:41.659911 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:41.659911 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:41.659911 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:41.659911 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:41.659911 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:41.659911 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:30:41.659911 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:30:41.659911 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:30:41.659911 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:30:41.660857 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:41.660857 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:41.660857 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:30:41.660857 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:41.660857 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:30:41.660857 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:41.660857 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:41.660857 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:41.660857 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:41.660857 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:41.660857 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:41.660857 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:41.660857 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:41.660857 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:41.660857 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:41.660857 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:41.660857 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:41.660857 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:41.661800 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:41.661800 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:41.661800 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:30:41.661800 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:30:41.661800 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:30:41.661800 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:30:41.661800 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:30:41.661800 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:30:41.661800 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 05 02:30:41.661800 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:41.666629 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 398/797] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 5 02:30:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:41.667800 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0144f-2275-4d5d-8711-00a611a023d9 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:41.668256 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0144f-2275-4d5d-8711-00a611a023d9 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:41.668580 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0144f-2275-4d5d-8711-00a611a023d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:41.689515 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-77c0144f-2275-4d5d-8711-00a611a023d9 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:41.690880 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-77c0144f-2275-4d5d-8711-00a611a023d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:41.760975 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28015828-d11a-4da9-9e91-914fe4f77907 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:41.763883 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:41.789878 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 399/798] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:30:41.791966 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0144f-2275-4d5d-8711-00a611a023d9 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:41.815264 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e734ed4-ee8a-41c9-9860-1133eef60282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:41.815963 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e734ed4-ee8a-41c9-9860-1133eef60282 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:41.816218 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e734ed4-ee8a-41c9-9860-1133eef60282 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:41.816531 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e734ed4-ee8a-41c9-9860-1133eef60282 None admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:41.817260 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e734ed4-ee8a-41c9-9860-1133eef60282 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:41.817587 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e734ed4-ee8a-41c9-9860-1133eef60282 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:41.819038 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e734ed4-ee8a-41c9-9860-1133eef60282 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:41.837890 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 400/799] 10.222.0.42 () {56 vars in 1149 bytes} [Fri Aug 5 02:30:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:41.842855 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e734ed4-ee8a-41c9-9860-1133eef60282 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:41.863308 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:41.940496 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0144f-2275-4d5d-8711-00a611a023d9 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:41.975851 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e734ed4-ee8a-41c9-9860-1133eef60282 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:41.985585 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb218f-6439-4524-9a11-c899dead21de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:41.986982 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb218f-6439-4524-9a11-c899dead21de None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:41.987902 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb218f-6439-4524-9a11-c899dead21de None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:41.988544 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb218f-6439-4524-9a11-c899dead21de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:42.002574 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb218f-6439-4524-9a11-c899dead21de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:30:42.009754 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-33cb218f-6439-4524-9a11-c899dead21de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:30:42.009754 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:42.009754 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:42.009754 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:42.009754 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:42.009754 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:42.009754 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:42.009754 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:42.009754 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:42.009754 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:42.009754 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:42.009754 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:42.009754 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:30:42.009754 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:30:42.009754 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:30:42.009754 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:30:42.010746 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:30:42.010746 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:30:42.010746 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:30:42.010746 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:30:42.010746 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:42.010746 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:42.010746 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:42.010746 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:42.010746 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:42.010746 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:42.010746 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:42.010746 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:42.010746 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:42.010746 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:42.010746 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:42.010746 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:42.011621 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:42.011621 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:42.011621 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:42.011621 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:42.011621 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:30:42.011621 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:30:42.011621 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:30:42.011621 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:30:42.011621 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:30:42.011621 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:30:42.011621 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:30:42.011621 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:42.012833 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 400/800] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 5 02:30:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:42.013596 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb218f-6439-4524-9a11-c899dead21de None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:42.019230 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c9459-0d85-4052-9694-8368320e1078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:42.020399 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c9459-0d85-4052-9694-8368320e1078 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:42.020399 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c9459-0d85-4052-9694-8368320e1078 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:42.020575 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c9459-0d85-4052-9694-8368320e1078 None admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:42.021413 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c9459-0d85-4052-9694-8368320e1078 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:42.021723 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c9459-0d85-4052-9694-8368320e1078 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:42.023205 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c9459-0d85-4052-9694-8368320e1078 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:42.049168 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 401/801] 10.222.0.42 () {56 vars in 1135 bytes} [Fri Aug 5 02:30:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:42.049168 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c9459-0d85-4052-9694-8368320e1078 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:42.073782 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:42.150481 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb218f-6439-4524-9a11-c899dead21de None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:42.152633 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:42.181895 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c9459-0d85-4052-9694-8368320e1078 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:42.195069 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9099124-35d9-44b5-840e-2d341ed281d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:42.195733 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9099124-35d9-44b5-840e-2d341ed281d1 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:42.196025 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9099124-35d9-44b5-840e-2d341ed281d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:42.196308 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9099124-35d9-44b5-840e-2d341ed281d1 None admin] PATH_INFO: `/v3/services/network` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:42.196950 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9099124-35d9-44b5-840e-2d341ed281d1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:42.198686 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9099124-35d9-44b5-840e-2d341ed281d1 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:42.211662 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-c9099124-35d9-44b5-840e-2d341ed281d1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 02:30:42.211662 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:42.211662 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:30:42.211662 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:30:42.211662 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:30:42.211662 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:30:42.211662 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:30:42.211662 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:30:42.211662 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 02:30:42.211662 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:42.211662 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:30:42.211662 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:42.211662 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:42.211662 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:42.211662 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:42.211662 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:42.211662 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:42.212901 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:42.212901 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:42.212901 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:42.212901 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:42.212901 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:42.212901 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:42.212901 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:30:42.212901 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:30:42.212901 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:30:42.212901 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:30:42.212901 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:42.212901 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:42.212901 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:42.212901 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:42.212901 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:42.212901 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:42.213932 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:42.213932 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:42.213932 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:42.213932 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:42.213932 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:42.213932 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:42.213932 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:42.213932 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:42.213932 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:42.213932 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:42.213932 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:30:42.213932 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:30:42.213932 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 02:30:42.213932 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:42.218190 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 401/802] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:30:42 2022] GET /identity/v3/services/network => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:42.219391 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9099124-35d9-44b5-840e-2d341ed281d1 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:42.228268 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1771387-3e80-40ba-9321-19571c6732b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:42.229138 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1771387-3e80-40ba-9321-19571c6732b3 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:42.229512 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1771387-3e80-40ba-9321-19571c6732b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:42.230243 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1771387-3e80-40ba-9321-19571c6732b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:42.241330 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1771387-3e80-40ba-9321-19571c6732b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:42.242913 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1771387-3e80-40ba-9321-19571c6732b3 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:42.259153 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-a1771387-3e80-40ba-9321-19571c6732b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:42.259153 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:42.259153 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:42.259153 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:42.259153 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:42.259153 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:42.259153 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:42.259153 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:42.259153 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:42.259153 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:42.259153 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:42.259153 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:42.259153 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:42.259153 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:42.259153 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:42.260234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:42.260234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:42.260234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:42.260234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:42.260234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:42.260234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:42.260234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:42.260234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:42.260234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:42.260234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:42.260234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:42.260234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:42.260234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:42.260234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:42.260234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:42.260234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:42.260234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:42.261331 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:42.261331 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:42.261331 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:42.261331 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:42.262394 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 402/803] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:42.262766 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1771387-3e80-40ba-9321-19571c6732b3 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:42.363965 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9099124-35d9-44b5-840e-2d341ed281d1 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:42.373902 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:42.407126 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea53be8-4d3b-4d0a-9af9-c09c278c29d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:42.408439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea53be8-4d3b-4d0a-9af9-c09c278c29d9 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:42.408439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea53be8-4d3b-4d0a-9af9-c09c278c29d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:42.408439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea53be8-4d3b-4d0a-9af9-c09c278c29d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:42.409808 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea53be8-4d3b-4d0a-9af9-c09c278c29d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:42.410194 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea53be8-4d3b-4d0a-9af9-c09c278c29d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:42.411739 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea53be8-4d3b-4d0a-9af9-c09c278c29d9 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:42.416238 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1771387-3e80-40ba-9321-19571c6732b3 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:42.426749 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 402/804] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:30:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:42.427799 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea53be8-4d3b-4d0a-9af9-c09c278c29d9 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:42.453838 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e9e69-7f78-457d-a56f-b20341d748cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:42.454474 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e9e69-7f78-457d-a56f-b20341d748cb None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:42.454753 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e9e69-7f78-457d-a56f-b20341d748cb None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:42.455062 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e9e69-7f78-457d-a56f-b20341d748cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:42.457751 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:42.467171 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2e9e69-7f78-457d-a56f-b20341d748cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:42.468607 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2e9e69-7f78-457d-a56f-b20341d748cb None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:42.483840 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-be2e9e69-7f78-457d-a56f-b20341d748cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:42.483840 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:42.483840 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:42.483840 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:42.483840 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:42.483840 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:42.483840 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:42.483840 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:42.483840 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:42.483840 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:42.483840 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:42.483840 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:42.483840 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:42.483840 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:42.483840 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:42.484748 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:42.484748 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:42.484748 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:42.484748 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:42.484748 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:42.484748 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:42.484748 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:42.484748 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:42.484748 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:42.484748 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:42.484748 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:42.484748 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:42.484748 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:42.484748 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:42.484748 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:42.484748 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:42.484748 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:42.485662 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:42.485662 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:42.485662 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:42.485662 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:42.492223 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 403/805] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:42.493274 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e9e69-7f78-457d-a56f-b20341d748cb None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:42.536153 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea53be8-4d3b-4d0a-9af9-c09c278c29d9 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:42.571155 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b50375-88d1-46c3-89f9-2ac53bfa32ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:42.571779 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b50375-88d1-46c3-89f9-2ac53bfa32ad None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:42.572066 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b50375-88d1-46c3-89f9-2ac53bfa32ad None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:42.572342 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b50375-88d1-46c3-89f9-2ac53bfa32ad None admin] PATH_INFO: `/v3/services` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:42.573012 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b50375-88d1-46c3-89f9-2ac53bfa32ad None admin] RBAC: Adding query filter params (name=network) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:42.573322 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b50375-88d1-46c3-89f9-2ac53bfa32ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:42.574686 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b50375-88d1-46c3-89f9-2ac53bfa32ad None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:42.579717 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 403/806] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Aug 5 02:30:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:42.580386 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b50375-88d1-46c3-89f9-2ac53bfa32ad None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:42.610819 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e9e69-7f78-457d-a56f-b20341d748cb None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:42.633900 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:42.645450 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e860d009-d944-4c36-b644-58bf3f095262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:42.646067 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860d009-d944-4c36-b644-58bf3f095262 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:42.646351 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860d009-d944-4c36-b644-58bf3f095262 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:42.646832 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860d009-d944-4c36-b644-58bf3f095262 None admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:42.647338 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e860d009-d944-4c36-b644-58bf3f095262 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:42.647638 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e860d009-d944-4c36-b644-58bf3f095262 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:42.655979 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e860d009-d944-4c36-b644-58bf3f095262 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:42.661233 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 404/807] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:42.662428 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea774082-df5a-48a3-b5c3-cc961adb6864 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:42.662717 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea774082-df5a-48a3-b5c3-cc961adb6864 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:42.663013 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea774082-df5a-48a3-b5c3-cc961adb6864 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:42.668292 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 405/808] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:30:42.669148 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea774082-df5a-48a3-b5c3-cc961adb6864 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:42.678893 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:42.689059 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b50375-88d1-46c3-89f9-2ac53bfa32ad None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:42.729027 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c3062-cb4f-4262-a889-b7d329143c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:42.729660 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c3062-cb4f-4262-a889-b7d329143c1c None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:42.729938 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c3062-cb4f-4262-a889-b7d329143c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:42.730211 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c3062-cb4f-4262-a889-b7d329143c1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:42.742174 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243c3062-cb4f-4262-a889-b7d329143c1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:42.743605 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243c3062-cb4f-4262-a889-b7d329143c1c None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:42.757998 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-243c3062-cb4f-4262-a889-b7d329143c1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:42.757998 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:42.757998 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:42.757998 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:42.757998 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:42.757998 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:42.757998 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:42.757998 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:42.757998 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:42.757998 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:42.757998 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:42.757998 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:42.757998 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:42.757998 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:42.757998 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:42.758977 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:42.758977 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:42.758977 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:42.758977 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:42.758977 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:42.758977 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:42.758977 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:42.758977 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:42.758977 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:42.758977 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:42.758977 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:42.758977 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:42.758977 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:42.758977 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:42.758977 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:42.758977 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:42.758977 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:42.759904 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:42.759904 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:42.759904 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:42.759904 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:42.761711 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 404/809] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:42.762503 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c3062-cb4f-4262-a889-b7d329143c1c None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:42.784065 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea774082-df5a-48a3-b5c3-cc961adb6864 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:42.818945 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a27e2e-bc80-4180-9818-596de95ef832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:42.819587 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a27e2e-bc80-4180-9818-596de95ef832 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:42.819898 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a27e2e-bc80-4180-9818-596de95ef832 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:42.820171 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a27e2e-bc80-4180-9818-596de95ef832 None admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:42.820844 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a27e2e-bc80-4180-9818-596de95ef832 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:42.821145 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a27e2e-bc80-4180-9818-596de95ef832 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:42.822506 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a27e2e-bc80-4180-9818-596de95ef832 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:42.834026 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 406/810] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:42.834803 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a27e2e-bc80-4180-9818-596de95ef832 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:42.871481 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c3062-cb4f-4262-a889-b7d329143c1c None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:42.890419 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:42.905749 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213596b5-bab6-4997-8129-4f94d930e8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:42.906380 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213596b5-bab6-4997-8129-4f94d930e8a6 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:42.906659 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213596b5-bab6-4997-8129-4f94d930e8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:42.906939 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213596b5-bab6-4997-8129-4f94d930e8a6 None admin] PATH_INFO: `/v3/services` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:42.907672 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213596b5-bab6-4997-8129-4f94d930e8a6 None admin] RBAC: Adding query filter params (type=network) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:42.907947 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213596b5-bab6-4997-8129-4f94d930e8a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:42.909353 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213596b5-bab6-4997-8129-4f94d930e8a6 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:42.914154 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 405/811] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Aug 5 02:30:42 2022] GET /identity/v3/services?type=network => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:42.915392 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6804e52-9a94-46ef-9a9a-a629f8d995fa None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:42.915678 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6804e52-9a94-46ef-9a9a-a629f8d995fa None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:42.915957 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6804e52-9a94-46ef-9a9a-a629f8d995fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:42.934660 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-a6804e52-9a94-46ef-9a9a-a629f8d995fa None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:42.936016 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-a6804e52-9a94-46ef-9a9a-a629f8d995fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:42.937918 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:42.957618 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a27e2e-bc80-4180-9818-596de95ef832 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:42.994124 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a2837-6bfa-4fd5-a00f-b01600d624e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:42.994874 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a2837-6bfa-4fd5-a00f-b01600d624e9 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:42.995252 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a2837-6bfa-4fd5-a00f-b01600d624e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:42.995533 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a2837-6bfa-4fd5-a00f-b01600d624e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:43.002390 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773a2837-6bfa-4fd5-a00f-b01600d624e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:43.004370 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773a2837-6bfa-4fd5-a00f-b01600d624e9 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:43.009086 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 406/812] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:30:43.010060 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6804e52-9a94-46ef-9a9a-a629f8d995fa None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:43.016842 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-773a2837-6bfa-4fd5-a00f-b01600d624e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:43.016842 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:43.016842 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:43.016842 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:43.016842 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:43.016842 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:43.016842 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:43.016842 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:43.016842 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:43.016842 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:43.016842 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:43.016842 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:43.016842 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:30:43.016842 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:30:43.016842 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:30:43.017751 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:30:43.017751 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:43.017751 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:43.017751 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:43.017751 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:43.017751 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:43.017751 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:43.017751 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:43.017751 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:43.017751 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:43.017751 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:43.017751 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:43.017751 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:43.017751 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:43.017751 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:43.017751 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:43.017751 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:43.018726 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:30:43.018726 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:30:43.018726 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:30:43.018726 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:30:43.018726 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:30:43.018726 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:30:43.018726 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:43.018726 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:43.023083 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 407/813] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:30:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:43.024425 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a2837-6bfa-4fd5-a00f-b01600d624e9 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:43.123494 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6804e52-9a94-46ef-9a9a-a629f8d995fa None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:43.130341 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a2837-6bfa-4fd5-a00f-b01600d624e9 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:43.132709 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:43.158845 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2429cb-5901-418f-be5c-aeb58c5e0b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:43.159540 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2429cb-5901-418f-be5c-aeb58c5e0b9c None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:43.159829 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2429cb-5901-418f-be5c-aeb58c5e0b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:43.160193 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2429cb-5901-418f-be5c-aeb58c5e0b9c None admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:43.160924 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2429cb-5901-418f-be5c-aeb58c5e0b9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:43.161230 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2429cb-5901-418f-be5c-aeb58c5e0b9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:43.162625 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2429cb-5901-418f-be5c-aeb58c5e0b9c None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:43.167404 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99895e46-53ff-418f-944c-8b4b3a42c7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:43.168033 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99895e46-53ff-418f-944c-8b4b3a42c7a6 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:43.168312 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99895e46-53ff-418f-944c-8b4b3a42c7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:43.168589 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99895e46-53ff-418f-944c-8b4b3a42c7a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:43.169060 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:43.174596 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 407/814] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:43.175993 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2429cb-5901-418f-be5c-aeb58c5e0b9c None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:43.176101 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99895e46-53ff-418f-944c-8b4b3a42c7a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:43.177653 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99895e46-53ff-418f-944c-8b4b3a42c7a6 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:43.189378 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-99895e46-53ff-418f-944c-8b4b3a42c7a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:43.189378 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:43.189378 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:43.189378 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:43.189378 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:43.189378 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:43.189378 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:43.189378 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:43.189378 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:43.189378 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:43.189378 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:43.189378 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:43.189378 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:30:43.189378 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:30:43.189378 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:30:43.190403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:30:43.190403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:43.190403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:43.190403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:43.190403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:43.190403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:43.190403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:43.190403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:43.190403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:43.190403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:43.190403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:43.190403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:43.190403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:43.190403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:43.190403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:43.190403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:43.190403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:43.191929 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:30:43.191929 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:30:43.191929 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:30:43.191929 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:30:43.191929 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:30:43.191929 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:30:43.191929 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:43.191929 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:43.191929 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 408/815] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:30:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:43.191929 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99895e46-53ff-418f-944c-8b4b3a42c7a6 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:43.294234 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2429cb-5901-418f-be5c-aeb58c5e0b9c None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:43.311415 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99895e46-53ff-418f-944c-8b4b3a42c7a6 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:43.332166 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e43eb-c4e9-453b-ae12-ace6a1ced21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:43.333065 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e43eb-c4e9-453b-ae12-ace6a1ced21e None admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:43.333341 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e43eb-c4e9-453b-ae12-ace6a1ced21e None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:43.333627 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e43eb-c4e9-453b-ae12-ace6a1ced21e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:43.334468 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e43eb-c4e9-453b-ae12-ace6a1ced21e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:43.336331 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e43eb-c4e9-453b-ae12-ace6a1ced21e None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:43.345303 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37ac25-5869-4acc-bb67-9af3fad54653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:43.345913 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37ac25-5869-4acc-bb67-9af3fad54653 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:43.346186 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37ac25-5869-4acc-bb67-9af3fad54653 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:43.346459 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37ac25-5869-4acc-bb67-9af3fad54653 None admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:43.347251 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37ac25-5869-4acc-bb67-9af3fad54653 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:43.347558 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37ac25-5869-4acc-bb67-9af3fad54653 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:43.348985 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37ac25-5869-4acc-bb67-9af3fad54653 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:43.360473 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 409/816] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 5 02:30:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:43.366191 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37ac25-5869-4acc-bb67-9af3fad54653 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:43.386520 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:43.441641 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 408/817] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:30:43 2022] POST /identity/v3/endpoints => generated 337 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:30:43.442399 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e43eb-c4e9-453b-ae12-ace6a1ced21e None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:43.459303 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37ac25-5869-4acc-bb67-9af3fad54653 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:43.505884 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:43.508467 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d1dd8-f2bb-47d2-95d8-bfae444b66f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:43.509136 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d1dd8-f2bb-47d2-95d8-bfae444b66f0 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:43.509416 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d1dd8-f2bb-47d2-95d8-bfae444b66f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:43.509692 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d1dd8-f2bb-47d2-95d8-bfae444b66f0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:43.510754 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d1dd8-f2bb-47d2-95d8-bfae444b66f0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:43.513338 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d1dd8-f2bb-47d2-95d8-bfae444b66f0 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:43.524616 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-b23d1dd8-f2bb-47d2-95d8-bfae444b66f0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 02:30:43.524616 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:43.524616 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:30:43.524616 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:30:43.524616 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:30:43.524616 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:30:43.524616 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:30:43.524616 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:30:43.524616 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 02:30:43.524616 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:43.524616 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:30:43.524616 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:43.524616 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:43.524616 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:43.524616 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:43.524616 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:43.525638 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:43.525638 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:43.525638 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:43.525638 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:43.525638 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:43.525638 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:43.525638 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:43.525638 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:30:43.525638 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:30:43.525638 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:30:43.525638 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:30:43.525638 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:43.525638 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:43.525638 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:43.525638 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:43.525638 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:43.526533 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:43.526533 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:43.526533 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:43.526533 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:43.526533 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:43.526533 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:43.526533 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:43.526533 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:43.526533 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:43.526533 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:43.526533 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:43.526533 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:30:43.526533 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:30:43.526533 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 02:30:43.526533 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:43.526533 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 410/818] 10.222.0.42 () {56 vars in 1129 bytes} [Fri Aug 5 02:30:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:43.527514 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d1dd8-f2bb-47d2-95d8-bfae444b66f0 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:43.566188 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e43eb-c4e9-453b-ae12-ace6a1ced21e None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:43.608634 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c549f2f-0c67-43a2-945d-9b7d75199503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:43.609310 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c549f2f-0c67-43a2-945d-9b7d75199503 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:43.609598 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c549f2f-0c67-43a2-945d-9b7d75199503 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:43.609878 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c549f2f-0c67-43a2-945d-9b7d75199503 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:43.619039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c549f2f-0c67-43a2-945d-9b7d75199503 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:43.621006 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c549f2f-0c67-43a2-945d-9b7d75199503 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:43.626183 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:43.635780 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-9c549f2f-0c67-43a2-945d-9b7d75199503 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 02:30:43.635780 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:43.635780 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:43.635780 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:43.635780 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:43.635780 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:43.635780 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:43.635780 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:43.635780 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:43.635780 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:43.635780 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:43.635780 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:43.635780 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:30:43.635780 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:30:43.635780 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:30:43.635780 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:30:43.640206 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:43.640206 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:43.640206 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:30:43.640206 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:43.640206 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:30:43.640206 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:43.640206 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:43.640206 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:43.640206 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:43.640206 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:43.640206 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:43.640206 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:43.640206 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:43.640206 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:43.640206 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:43.640206 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:43.640206 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:43.640206 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:43.641424 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:43.641424 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:43.641424 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:30:43.641424 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:30:43.641424 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:30:43.641424 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:30:43.641424 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:30:43.641424 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:30:43.641424 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 02:30:43.641424 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:43.641424 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 409/819] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Aug 5 02:30:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:43.641424 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c549f2f-0c67-43a2-945d-9b7d75199503 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:43.642767 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d1dd8-f2bb-47d2-95d8-bfae444b66f0 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:43.686734 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb927c81-07d7-4135-8ad4-62ce2f20b33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:43.687398 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb927c81-07d7-4135-8ad4-62ce2f20b33c None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:43.687676 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb927c81-07d7-4135-8ad4-62ce2f20b33c None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:43.687946 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb927c81-07d7-4135-8ad4-62ce2f20b33c None admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:43.688686 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb927c81-07d7-4135-8ad4-62ce2f20b33c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:43.689807 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb927c81-07d7-4135-8ad4-62ce2f20b33c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:43.690416 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb927c81-07d7-4135-8ad4-62ce2f20b33c None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:43.702937 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 411/820] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 5 02:30:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:43.703809 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb927c81-07d7-4135-8ad4-62ce2f20b33c None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:43.751368 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c549f2f-0c67-43a2-945d-9b7d75199503 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:43.764439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:43.783500 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a5cf8-f533-4f8b-9cc4-9ca4f9a5852e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:43.784164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a5cf8-f533-4f8b-9cc4-9ca4f9a5852e None admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:43.784979 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a5cf8-f533-4f8b-9cc4-9ca4f9a5852e None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:43.785255 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a5cf8-f533-4f8b-9cc4-9ca4f9a5852e None admin] PATH_INFO: `/v3/projects/63b323c02a614fc28aac6e7a060064ba/users/6bea520676244effbbe212aa62b1cc68/roles/2642213efc7d4861b3d3b4f5fbc9ad73` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:43.798925 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a5cf8-f533-4f8b-9cc4-9ca4f9a5852e None admin] RBAC: Authorizing `identity:create_grant(project_id=63b323c02a614fc28aac6e7a060064ba, user_id=6bea520676244effbbe212aa62b1cc68, role_id=2642213efc7d4861b3d3b4f5fbc9ad73)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:43.800982 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a5cf8-f533-4f8b-9cc4-9ca4f9a5852e None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:43.802075 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb927c81-07d7-4135-8ad4-62ce2f20b33c None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:43.839562 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151008f-b2de-4fea-8742-64cd35890fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:43.840195 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151008f-b2de-4fea-8742-64cd35890fde None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:43.840479 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151008f-b2de-4fea-8742-64cd35890fde None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:43.840752 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151008f-b2de-4fea-8742-64cd35890fde None admin] PATH_INFO: `/v3/services` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:43.841529 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a151008f-b2de-4fea-8742-64cd35890fde None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:43.841837 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a151008f-b2de-4fea-8742-64cd35890fde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:43.843248 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a151008f-b2de-4fea-8742-64cd35890fde None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:43.854029 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 412/821] 10.222.0.42 () {56 vars in 1124 bytes} [Fri Aug 5 02:30:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:43.854029 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151008f-b2de-4fea-8742-64cd35890fde None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:43.864828 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:43.901902 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 410/822] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 5 02:30:43 2022] PUT /identity/v3/projects/63b323c02a614fc28aac6e7a060064ba/users/6bea520676244effbbe212aa62b1cc68/roles/2642213efc7d4861b3d3b4f5fbc9ad73 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:30:43.902799 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a5cf8-f533-4f8b-9cc4-9ca4f9a5852e None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:43.975392 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151008f-b2de-4fea-8742-64cd35890fde None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:44.012564 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89779aae-acf4-46a6-b8c0-fb34a0c79430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:44.013203 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89779aae-acf4-46a6-b8c0-fb34a0c79430 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:44.013482 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89779aae-acf4-46a6-b8c0-fb34a0c79430 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:44.013756 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89779aae-acf4-46a6-b8c0-fb34a0c79430 None admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:44.014565 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89779aae-acf4-46a6-b8c0-fb34a0c79430 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:44.014868 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89779aae-acf4-46a6-b8c0-fb34a0c79430 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:44.016381 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89779aae-acf4-46a6-b8c0-fb34a0c79430 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:44.030264 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a5cf8-f533-4f8b-9cc4-9ca4f9a5852e None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:44.037594 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 413/823] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Aug 5 02:30:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:44.038352 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89779aae-acf4-46a6-b8c0-fb34a0c79430 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:44.087702 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b9ce9-3bbf-43ce-aaf4-dc7ff5c8cc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:44.088425 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b9ce9-3bbf-43ce-aaf4-dc7ff5c8cc21 None admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:44.088711 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b9ce9-3bbf-43ce-aaf4-dc7ff5c8cc21 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:44.089350 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b9ce9-3bbf-43ce-aaf4-dc7ff5c8cc21 None admin] PATH_INFO: `/v3/projects/63b323c02a614fc28aac6e7a060064ba/users/40f706f1eb2b4137afd367cb5060ced0/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:44.091979 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b9ce9-3bbf-43ce-aaf4-dc7ff5c8cc21 None admin] RBAC: Authorizing `identity:create_grant(project_id=63b323c02a614fc28aac6e7a060064ba, user_id=40f706f1eb2b4137afd367cb5060ced0, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:44.094145 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b9ce9-3bbf-43ce-aaf4-dc7ff5c8cc21 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:44.113753 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:44.150644 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89779aae-acf4-46a6-b8c0-fb34a0c79430 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:44.160168 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 411/824] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 5 02:30:43 2022] PUT /identity/v3/projects/63b323c02a614fc28aac6e7a060064ba/users/40f706f1eb2b4137afd367cb5060ced0/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:30:44.161500 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b9ce9-3bbf-43ce-aaf4-dc7ff5c8cc21 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:44.224872 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:44.226470 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93396fa-e910-407e-bdc3-f4ac813f988b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:44.227381 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93396fa-e910-407e-bdc3-f4ac813f988b None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:44.227734 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93396fa-e910-407e-bdc3-f4ac813f988b None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:44.228084 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93396fa-e910-407e-bdc3-f4ac813f988b None admin] PATH_INFO: `/v3/services` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:44.228856 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93396fa-e910-407e-bdc3-f4ac813f988b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:44.229336 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93396fa-e910-407e-bdc3-f4ac813f988b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:44.230907 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93396fa-e910-407e-bdc3-f4ac813f988b None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:44.241674 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 414/825] 10.222.0.42 () {56 vars in 1124 bytes} [Fri Aug 5 02:30:44 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:44.243393 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93396fa-e910-407e-bdc3-f4ac813f988b None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:44.346233 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b9ce9-3bbf-43ce-aaf4-dc7ff5c8cc21 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:44.374546 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93396fa-e910-407e-bdc3-f4ac813f988b None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:44.389054 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89886cc9-3938-4c40-807d-677e34eb53b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:44.389673 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89886cc9-3938-4c40-807d-677e34eb53b2 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:44.389953 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89886cc9-3938-4c40-807d-677e34eb53b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:44.390229 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89886cc9-3938-4c40-807d-677e34eb53b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:44.415030 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:44.422741 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97356f66-d1bc-4cc6-99fa-ea9892bfad19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:44.423863 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97356f66-d1bc-4cc6-99fa-ea9892bfad19 None admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:44.424315 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97356f66-d1bc-4cc6-99fa-ea9892bfad19 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:44.425009 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97356f66-d1bc-4cc6-99fa-ea9892bfad19 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:44.426287 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97356f66-d1bc-4cc6-99fa-ea9892bfad19 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:44.428513 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97356f66-d1bc-4cc6-99fa-ea9892bfad19 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:44.476573 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89886cc9-3938-4c40-807d-677e34eb53b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:44.478020 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89886cc9-3938-4c40-807d-677e34eb53b2 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:44.505609 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:44.533830 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 415/826] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:30:44 2022] POST /identity/v3/endpoints => generated 346 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:30:44.594932 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 412/827] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:30:44 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 02:30:44.600618 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97356f66-d1bc-4cc6-99fa-ea9892bfad19 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:44.766967 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97356f66-d1bc-4cc6-99fa-ea9892bfad19 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:44.806882 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03fd6fb-c441-4d37-9d84-bcf756c18280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:44.807562 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fd6fb-c441-4d37-9d84-bcf756c18280 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:44.807847 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fd6fb-c441-4d37-9d84-bcf756c18280 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:44.808123 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fd6fb-c441-4d37-9d84-bcf756c18280 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:44.826828 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03fd6fb-c441-4d37-9d84-bcf756c18280 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:44.828342 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03fd6fb-c441-4d37-9d84-bcf756c18280 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:44.846290 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-e03fd6fb-c441-4d37-9d84-bcf756c18280 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:44.846290 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:44.846290 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:44.846290 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:44.846290 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:44.846290 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:44.846290 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:44.846290 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:44.846290 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:44.846290 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:44.846290 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:44.846290 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:44.846290 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:44.846290 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:44.846290 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:44.847298 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:44.847298 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:44.847298 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:44.847298 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:44.847298 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:44.847298 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:44.847298 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:44.847298 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:44.847298 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:44.847298 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:44.847298 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:44.847298 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:44.847298 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:44.847298 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:44.847298 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:44.847298 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:44.847298 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:44.848206 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:44.848206 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:44.848206 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:44.848206 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:44.848206 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 416/828] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:44.853950 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89886cc9-3938-4c40-807d-677e34eb53b2 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:44.974988 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89886cc9-3938-4c40-807d-677e34eb53b2 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:45.007509 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:45.020176 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce63fd3-385c-4338-9e1c-a7292f8edcdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:45.020799 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce63fd3-385c-4338-9e1c-a7292f8edcdf None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:45.021088 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce63fd3-385c-4338-9e1c-a7292f8edcdf None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:45.021367 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce63fd3-385c-4338-9e1c-a7292f8edcdf None admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:45.022070 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce63fd3-385c-4338-9e1c-a7292f8edcdf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:45.022376 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce63fd3-385c-4338-9e1c-a7292f8edcdf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:45.023809 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce63fd3-385c-4338-9e1c-a7292f8edcdf None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:45.040902 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 413/829] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:45.047387 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03fd6fb-c441-4d37-9d84-bcf756c18280 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:45.091375 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:45.155996 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03fd6fb-c441-4d37-9d84-bcf756c18280 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:45.191981 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e4ef9-8c9a-4773-ae57-9b561b344688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:45.192631 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e4ef9-8c9a-4773-ae57-9b561b344688 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:45.192914 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e4ef9-8c9a-4773-ae57-9b561b344688 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:45.193214 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e4ef9-8c9a-4773-ae57-9b561b344688 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:45.200050 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e4ef9-8c9a-4773-ae57-9b561b344688 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:45.207594 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e4ef9-8c9a-4773-ae57-9b561b344688 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:45.213042 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-e50e4ef9-8c9a-4773-ae57-9b561b344688 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:45.213042 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:45.213042 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:45.213042 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:45.213042 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:45.213042 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:45.213042 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:45.213042 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:45.213042 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:45.213042 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:45.213042 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:45.213042 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:45.213042 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:30:45.213042 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:30:45.213042 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:30:45.213937 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:30:45.213937 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:45.213937 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:45.213937 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:45.213937 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:45.213937 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:45.213937 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:45.213937 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:45.213937 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:45.213937 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:45.213937 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:45.213937 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:45.213937 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:45.213937 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:45.213937 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:45.213937 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:45.213937 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:45.214843 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:30:45.214843 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:30:45.214843 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:30:45.214843 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:30:45.214843 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:30:45.214843 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:30:45.214843 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:45.214843 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:45.214843 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 417/830] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:30:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:45.220134 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce63fd3-385c-4338-9e1c-a7292f8edcdf None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:45.326904 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce63fd3-385c-4338-9e1c-a7292f8edcdf None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:45.361602 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce623ba0-aff4-4276-be6d-dc91b812a5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:45.362240 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce623ba0-aff4-4276-be6d-dc91b812a5f3 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:45.363158 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce623ba0-aff4-4276-be6d-dc91b812a5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:45.363433 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce623ba0-aff4-4276-be6d-dc91b812a5f3 None admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:45.364196 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce623ba0-aff4-4276-be6d-dc91b812a5f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:45.364501 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce623ba0-aff4-4276-be6d-dc91b812a5f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:45.366000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce623ba0-aff4-4276-be6d-dc91b812a5f3 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:45.385400 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 414/831] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 5 02:30:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:45.386769 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e4ef9-8c9a-4773-ae57-9b561b344688 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:45.483635 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:45.490408 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e4ef9-8c9a-4773-ae57-9b561b344688 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:45.524515 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf10e1-b883-41a4-b39e-4a3f0c441f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:45.525169 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf10e1-b883-41a4-b39e-4a3f0c441f29 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:45.525658 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf10e1-b883-41a4-b39e-4a3f0c441f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:45.525937 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf10e1-b883-41a4-b39e-4a3f0c441f29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:45.526726 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf10e1-b883-41a4-b39e-4a3f0c441f29 None admin] RBAC: Adding query filter params (role.id=83afe883a303495b966480fb9b5bb7dd, scope.project.id=63b323c02a614fc28aac6e7a060064ba, user.id=55374d3bccd541c9a8f82da9b21c2fb8) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:45.527058 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf10e1-b883-41a4-b39e-4a3f0c441f29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:45.528500 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf10e1-b883-41a4-b39e-4a3f0c441f29 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:45.535396 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 418/832] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:30:45 2022] GET /identity/v3/role_assignments?user.id=55374d3bccd541c9a8f82da9b21c2fb8&scope.project.id=63b323c02a614fc28aac6e7a060064ba&role.id=83afe883a303495b966480fb9b5bb7dd => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:46.124117 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0d564-16a9-453e-ac24-7d602610c4ef None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:46.124651 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0d564-16a9-453e-ac24-7d602610c4ef None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:46.124948 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0d564-16a9-453e-ac24-7d602610c4ef None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:46.126654 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 415/833] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:30:46.132481 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8675a-5437-4079-acce-425cff003956 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:46.132905 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8675a-5437-4079-acce-425cff003956 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:46.133287 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8675a-5437-4079-acce-425cff003956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:46.152313 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-e6e8675a-5437-4079-acce-425cff003956 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:46.153504 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-e6e8675a-5437-4079-acce-425cff003956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:46.226062 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 419/834] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:46 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:30:46.249302 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0d564-16a9-453e-ac24-7d602610c4ef None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:46.284126 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a3229b-7f67-4090-bdea-2159471e0f40 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:46.284425 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a3229b-7f67-4090-bdea-2159471e0f40 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:46.284705 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a3229b-7f67-4090-bdea-2159471e0f40 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:46.286044 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 420/835] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:30:46.291094 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8675b-89be-49ad-acc3-07c2004f3c33 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:46.291383 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8675b-89be-49ad-acc3-07c2004f3c33 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:46.291663 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8675b-89be-49ad-acc3-07c2004f3c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:46.305449 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:46.310270 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-6cf8675b-89be-49ad-acc3-07c2004f3c33 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:46.311558 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-6cf8675b-89be-49ad-acc3-07c2004f3c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:46.374023 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0d564-16a9-453e-ac24-7d602610c4ef None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:46.384051 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 421/836] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:46 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 02:30:46.411614 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8675b-89be-49ad-acc3-07c2004f3c33 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:46.417674 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da15308-192b-4afd-9b64-5018a71d92f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:46.418292 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da15308-192b-4afd-9b64-5018a71d92f3 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:46.418576 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da15308-192b-4afd-9b64-5018a71d92f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:46.418852 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da15308-192b-4afd-9b64-5018a71d92f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:46.432732 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da15308-192b-4afd-9b64-5018a71d92f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:30:46.439908 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-0da15308-192b-4afd-9b64-5018a71d92f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:30:46.439908 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:46.439908 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:46.439908 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:46.439908 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:46.439908 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:46.439908 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:46.439908 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:46.439908 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:46.439908 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:46.439908 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:46.439908 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:46.439908 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:30:46.439908 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:30:46.439908 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:30:46.439908 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:30:46.442570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:30:46.442570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:30:46.442570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:30:46.442570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:30:46.442570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:46.442570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:46.442570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:46.442570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:46.442570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:46.442570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:46.442570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:46.442570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:46.442570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:46.442570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:46.442570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:46.442570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:46.444612 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:46.444612 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:46.444612 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:46.444612 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:46.444612 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:30:46.444612 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:30:46.444612 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:30:46.444612 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:30:46.444612 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:30:46.444612 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:30:46.444612 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:30:46.444612 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:46.444612 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 416/837] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 5 02:30:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:46.446243 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:46.448387 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da15308-192b-4afd-9b64-5018a71d92f3 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:46.525519 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8675b-89be-49ad-acc3-07c2004f3c33 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:46.571062 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9154840-a496-4b6e-a166-7d0b3bfb92fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:46.572432 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9154840-a496-4b6e-a166-7d0b3bfb92fc None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:46.572560 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da15308-192b-4afd-9b64-5018a71d92f3 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:46.573061 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9154840-a496-4b6e-a166-7d0b3bfb92fc None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:46.573533 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9154840-a496-4b6e-a166-7d0b3bfb92fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:46.575830 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:46.588578 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9154840-a496-4b6e-a166-7d0b3bfb92fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:30:46.594996 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-a9154840-a496-4b6e-a166-7d0b3bfb92fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:30:46.594996 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:46.594996 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:46.594996 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:46.594996 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:46.594996 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:46.594996 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:46.594996 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:46.594996 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:46.594996 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:46.594996 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:46.594996 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:46.594996 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:30:46.594996 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:30:46.594996 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:30:46.594996 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:30:46.596025 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:30:46.596025 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:30:46.596025 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:30:46.596025 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:30:46.596025 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:46.596025 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:46.596025 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:46.596025 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:46.596025 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:46.596025 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:46.596025 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:46.596025 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:46.596025 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:46.596025 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:46.596025 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:46.596025 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:46.597398 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:46.597398 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:46.597398 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:46.597398 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:46.597398 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:30:46.597398 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:30:46.597398 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:30:46.597398 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:30:46.597398 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:30:46.597398 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:30:46.597398 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:30:46.597398 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:46.603215 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 422/838] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 5 02:30:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:30:46.606422 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9154840-a496-4b6e-a166-7d0b3bfb92fc None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:46.618801 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26232dc9-bea0-44dd-a0ba-ca30d60e1f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:46.619456 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26232dc9-bea0-44dd-a0ba-ca30d60e1f65 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:46.619749 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26232dc9-bea0-44dd-a0ba-ca30d60e1f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:46.620335 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26232dc9-bea0-44dd-a0ba-ca30d60e1f65 None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:46.620734 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26232dc9-bea0-44dd-a0ba-ca30d60e1f65 None admin] RBAC: Adding query filter params (name=service) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:46.621099 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26232dc9-bea0-44dd-a0ba-ca30d60e1f65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:46.622545 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26232dc9-bea0-44dd-a0ba-ca30d60e1f65 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:46.635827 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 417/839] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 5 02:30:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:46.636765 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26232dc9-bea0-44dd-a0ba-ca30d60e1f65 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:46.704362 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:46.729499 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9154840-a496-4b6e-a166-7d0b3bfb92fc None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:46.767751 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4e5dd-1de5-4b80-9f86-ef13c8cf7ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:46.768365 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4e5dd-1de5-4b80-9f86-ef13c8cf7ca4 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:46.768683 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4e5dd-1de5-4b80-9f86-ef13c8cf7ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:46.768963 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4e5dd-1de5-4b80-9f86-ef13c8cf7ca4 None admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:46.769678 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4e5dd-1de5-4b80-9f86-ef13c8cf7ca4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:46.769987 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4e5dd-1de5-4b80-9f86-ef13c8cf7ca4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:46.771410 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4e5dd-1de5-4b80-9f86-ef13c8cf7ca4 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:46.774182 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26232dc9-bea0-44dd-a0ba-ca30d60e1f65 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:46.780449 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 423/840] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:30:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:30:46.781769 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10eac8-862e-4b56-84fe-615cfbc5c813 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:46.782067 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10eac8-862e-4b56-84fe-615cfbc5c813 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:46.782346 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10eac8-862e-4b56-84fe-615cfbc5c813 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:46.783721 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 424/841] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:30:46.789682 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48230e2f-53a5-4dba-8c4e-cc6050760b77 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:46.789973 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48230e2f-53a5-4dba-8c4e-cc6050760b77 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:46.790263 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48230e2f-53a5-4dba-8c4e-cc6050760b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:46.809182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-48230e2f-53a5-4dba-8c4e-cc6050760b77 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:46.810937 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-48230e2f-53a5-4dba-8c4e-cc6050760b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:46.816943 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf955f-82fc-42b5-9ea0-35c1b84836a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:46.817595 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf955f-82fc-42b5-9ea0-35c1b84836a6 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:46.817879 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf955f-82fc-42b5-9ea0-35c1b84836a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:46.818156 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf955f-82fc-42b5-9ea0-35c1b84836a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:46.829693 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cf955f-82fc-42b5-9ea0-35c1b84836a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:46.831248 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cf955f-82fc-42b5-9ea0-35c1b84836a6 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:46.845538 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-45cf955f-82fc-42b5-9ea0-35c1b84836a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:46.845538 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:46.845538 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:46.845538 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:46.845538 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:46.845538 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:46.845538 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:46.845538 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:46.845538 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:46.845538 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:46.845538 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:46.845538 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:46.845538 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:46.845538 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:46.845538 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:46.846415 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:46.846415 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:46.846415 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:46.846415 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:46.846415 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:46.846415 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:46.846415 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:46.846415 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:46.846415 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:46.846415 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:46.846415 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:46.846415 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:46.846415 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:46.846415 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:46.846415 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:46.846415 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:46.846415 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:46.848284 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:46.848284 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:46.848284 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:46.848284 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:46.848284 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 418/842] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:46.848284 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf955f-82fc-42b5-9ea0-35c1b84836a6 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:46.869606 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:46.886471 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 425/843] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:46 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:30:46.887283 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48230e2f-53a5-4dba-8c4e-cc6050760b77 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:46.960240 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf955f-82fc-42b5-9ea0-35c1b84836a6 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:46.972743 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:46.995901 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591585b-12e0-4e09-a279-19999b1156ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:46.996826 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591585b-12e0-4e09-a279-19999b1156ec None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:46.997116 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591585b-12e0-4e09-a279-19999b1156ec None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:46.997397 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591585b-12e0-4e09-a279-19999b1156ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:47.006918 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48230e2f-53a5-4dba-8c4e-cc6050760b77 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:47.008472 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591585b-12e0-4e09-a279-19999b1156ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:47.009929 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591585b-12e0-4e09-a279-19999b1156ec None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:47.024928 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-5591585b-12e0-4e09-a279-19999b1156ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:47.024928 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:47.024928 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:47.024928 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:47.024928 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:47.024928 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:47.024928 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:47.024928 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:47.024928 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:47.024928 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:47.024928 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:47.024928 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:47.024928 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:47.024928 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:47.024928 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:47.025854 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:47.025854 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:47.025854 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:47.025854 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:47.025854 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:47.025854 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:47.025854 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:47.025854 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:47.025854 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:47.025854 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:47.025854 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:47.025854 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:47.025854 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:47.025854 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:47.025854 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:47.025854 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:47.025854 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:47.026737 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:47.026737 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:47.026737 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:47.026737 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:47.026737 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 419/844] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:47.027482 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591585b-12e0-4e09-a279-19999b1156ec None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:47.048362 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7175846-b0a1-4b8e-b148-6637d02ff3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:47.048981 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7175846-b0a1-4b8e-b148-6637d02ff3e2 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:47.049262 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7175846-b0a1-4b8e-b148-6637d02ff3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:47.049533 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7175846-b0a1-4b8e-b148-6637d02ff3e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:47.050426 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7175846-b0a1-4b8e-b148-6637d02ff3e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:47.050536 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7175846-b0a1-4b8e-b148-6637d02ff3e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:47.051967 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7175846-b0a1-4b8e-b148-6637d02ff3e2 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:47.063781 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 426/845] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:47.069033 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7175846-b0a1-4b8e-b148-6637d02ff3e2 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:47.105382 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:47.139557 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591585b-12e0-4e09-a279-19999b1156ec None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:47.175325 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7175846-b0a1-4b8e-b148-6637d02ff3e2 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:47.179229 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b8ae3-6aea-45ce-a4ba-8b38e2c5d8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:47.179946 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b8ae3-6aea-45ce-a4ba-8b38e2c5d8e8 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:47.180230 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b8ae3-6aea-45ce-a4ba-8b38e2c5d8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:47.180506 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b8ae3-6aea-45ce-a4ba-8b38e2c5d8e8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:47.181192 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b8ae3-6aea-45ce-a4ba-8b38e2c5d8e8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:47.182574 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b8ae3-6aea-45ce-a4ba-8b38e2c5d8e8 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:47.192313 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-fb8b8ae3-6aea-45ce-a4ba-8b38e2c5d8e8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 02:30:47.192313 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:47.192313 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:30:47.192313 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:30:47.192313 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:30:47.192313 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:30:47.192313 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:30:47.192313 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:30:47.192313 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 02:30:47.192313 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:47.192313 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:30:47.192313 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:47.192313 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:47.192313 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:47.192313 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:47.192313 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:47.192313 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:47.193312 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:47.193312 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:47.193312 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:47.193312 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:47.193312 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:47.193312 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:47.193312 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:30:47.193312 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:30:47.193312 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:30:47.193312 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:30:47.193312 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:47.193312 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:47.193312 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:47.193312 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:47.193312 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:47.193312 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:47.194249 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:47.194249 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:47.194249 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:47.194249 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:47.194249 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:47.194249 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:47.194249 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:47.194249 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:47.194249 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:47.194249 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:47.194249 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:30:47.194249 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:30:47.194249 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 02:30:47.194249 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:47.194249 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 420/846] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 5 02:30:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:47.198128 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b8ae3-6aea-45ce-a4ba-8b38e2c5d8e8 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:47.211731 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:47.217210 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83a2ef-bf57-4c21-a228-95cc7eb1b031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:47.217832 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83a2ef-bf57-4c21-a228-95cc7eb1b031 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:47.218110 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83a2ef-bf57-4c21-a228-95cc7eb1b031 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:47.218380 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83a2ef-bf57-4c21-a228-95cc7eb1b031 None admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:47.219088 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83a2ef-bf57-4c21-a228-95cc7eb1b031 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:47.219441 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83a2ef-bf57-4c21-a228-95cc7eb1b031 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:47.220808 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83a2ef-bf57-4c21-a228-95cc7eb1b031 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:47.233127 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 427/847] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:47.233941 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83a2ef-bf57-4c21-a228-95cc7eb1b031 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:47.312644 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b8ae3-6aea-45ce-a4ba-8b38e2c5d8e8 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:47.348782 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a61fa7-3793-4d27-99b8-c0289e6b1ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:47.349420 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a61fa7-3793-4d27-99b8-c0289e6b1ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:47.349951 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a61fa7-3793-4d27-99b8-c0289e6b1ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:47.350222 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a61fa7-3793-4d27-99b8-c0289e6b1ca2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:47.351286 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83a2ef-bf57-4c21-a228-95cc7eb1b031 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:47.352236 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:47.359010 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a61fa7-3793-4d27-99b8-c0289e6b1ca2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:47.368181 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a61fa7-3793-4d27-99b8-c0289e6b1ca2 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:47.372279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-69a61fa7-3793-4d27-99b8-c0289e6b1ca2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 02:30:47.372279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:47.372279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:47.372279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:47.372279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:47.372279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:47.372279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:47.372279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:47.372279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:47.372279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:47.372279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:47.372279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:47.372279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:30:47.372279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:30:47.372279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:30:47.372279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:30:47.373205 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:47.373205 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:47.373205 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:30:47.373205 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:47.373205 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:30:47.373205 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:47.373205 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:47.373205 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:47.373205 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:47.373205 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:47.373205 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:47.373205 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:47.373205 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:47.373205 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:47.373205 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:47.373205 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:47.373205 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:47.373205 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:47.374136 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:47.374136 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:47.374136 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:30:47.374136 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:30:47.374136 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:30:47.374136 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:30:47.374136 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:30:47.374136 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:30:47.374136 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 02:30:47.374136 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:47.374136 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 421/848] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Aug 5 02:30:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:47.374714 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a61fa7-3793-4d27-99b8-c0289e6b1ca2 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:47.390628 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e92a3-ddc3-4051-b20f-4b2e671ef4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:47.391215 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e92a3-ddc3-4051-b20f-4b2e671ef4df None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:47.391498 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e92a3-ddc3-4051-b20f-4b2e671ef4df None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:47.391832 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e92a3-ddc3-4051-b20f-4b2e671ef4df None admin] PATH_INFO: `/v3/services` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:47.392513 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e92a3-ddc3-4051-b20f-4b2e671ef4df None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:47.392816 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e92a3-ddc3-4051-b20f-4b2e671ef4df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:47.394821 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e92a3-ddc3-4051-b20f-4b2e671ef4df None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:47.399560 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 428/849] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 5 02:30:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:47.400351 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e92a3-ddc3-4051-b20f-4b2e671ef4df None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:47.459033 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:47.493517 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a61fa7-3793-4d27-99b8-c0289e6b1ca2 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:47.507476 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e92a3-ddc3-4051-b20f-4b2e671ef4df None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:47.530392 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec9c30-d4ba-48ed-8aeb-302f15c25e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:47.531348 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec9c30-d4ba-48ed-8aeb-302f15c25e8e None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:47.531638 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec9c30-d4ba-48ed-8aeb-302f15c25e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:47.531915 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec9c30-d4ba-48ed-8aeb-302f15c25e8e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:47.539644 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec9c30-d4ba-48ed-8aeb-302f15c25e8e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:47.541167 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec9c30-d4ba-48ed-8aeb-302f15c25e8e None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:47.546865 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c3777-14ea-4eb7-b178-459ad05606a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:47.548009 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c3777-14ea-4eb7-b178-459ad05606a7 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:47.548479 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c3777-14ea-4eb7-b178-459ad05606a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:47.548966 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c3777-14ea-4eb7-b178-459ad05606a7 None admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:47.549975 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0c3777-14ea-4eb7-b178-459ad05606a7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:47.550468 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0c3777-14ea-4eb7-b178-459ad05606a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:47.552113 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0c3777-14ea-4eb7-b178-459ad05606a7 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:47.552801 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-b6ec9c30-d4ba-48ed-8aeb-302f15c25e8e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 05 02:30:47.552801 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:47.552801 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:47.552801 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:47.552801 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:47.552801 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:47.552801 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:47.552801 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:47.552801 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:47.552801 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:47.552801 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:47.552801 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:47.552801 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:30:47.552801 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:30:47.552801 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:30:47.552801 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:30:47.553723 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:47.553723 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:47.553723 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:30:47.553723 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:47.553723 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:30:47.553723 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:47.553723 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:47.553723 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:47.553723 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:47.553723 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:47.553723 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:47.553723 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:47.553723 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:47.553723 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:47.553723 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:47.553723 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:47.553723 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:47.553723 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:47.554659 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:47.554659 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:47.554659 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:30:47.554659 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:30:47.554659 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:30:47.554659 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:30:47.554659 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:30:47.554659 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:30:47.554659 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 05 02:30:47.554659 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:47.554659 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 422/850] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 5 02:30:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:47.555386 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec9c30-d4ba-48ed-8aeb-302f15c25e8e None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:47.575201 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 429/851] 10.222.0.42 () {56 vars in 1149 bytes} [Fri Aug 5 02:30:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:47.576573 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c3777-14ea-4eb7-b178-459ad05606a7 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:47.620492 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:47.664401 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec9c30-d4ba-48ed-8aeb-302f15c25e8e None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:47.675615 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c3777-14ea-4eb7-b178-459ad05606a7 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:47.688264 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:47.697626 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bfdad1-7b4c-4eec-9f13-e561d55a33cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:47.698251 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfdad1-7b4c-4eec-9f13-e561d55a33cf None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:47.699963 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfdad1-7b4c-4eec-9f13-e561d55a33cf None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:47.699963 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfdad1-7b4c-4eec-9f13-e561d55a33cf None admin] PATH_INFO: `/v3/services` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:47.699963 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bfdad1-7b4c-4eec-9f13-e561d55a33cf None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:47.699963 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bfdad1-7b4c-4eec-9f13-e561d55a33cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:47.701133 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bfdad1-7b4c-4eec-9f13-e561d55a33cf None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:47.705526 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 423/852] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 5 02:30:47 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:47.706423 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bfdad1-7b4c-4eec-9f13-e561d55a33cf None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:47.709326 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7392fb-4b13-44f4-af89-b2f81f7fbd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:47.709960 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7392fb-4b13-44f4-af89-b2f81f7fbd33 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:47.710242 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7392fb-4b13-44f4-af89-b2f81f7fbd33 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:47.710516 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7392fb-4b13-44f4-af89-b2f81f7fbd33 None admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:47.711367 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7392fb-4b13-44f4-af89-b2f81f7fbd33 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:47.711677 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7392fb-4b13-44f4-af89-b2f81f7fbd33 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:47.713276 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7392fb-4b13-44f4-af89-b2f81f7fbd33 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:47.734478 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 430/853] 10.222.0.42 () {56 vars in 1135 bytes} [Fri Aug 5 02:30:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:47.735821 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825eb7d-1ea1-4c41-9773-db1f1e9ca86f None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:47.736110 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825eb7d-1ea1-4c41-9773-db1f1e9ca86f None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:47.736386 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825eb7d-1ea1-4c41-9773-db1f1e9ca86f None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:47.738989 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 431/854] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:30:47.740559 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825eb7d-1ea1-4c41-9773-db1f1e9ca86f None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:47.831819 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bfdad1-7b4c-4eec-9f13-e561d55a33cf None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:47.851809 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:47.855452 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825eb7d-1ea1-4c41-9773-db1f1e9ca86f None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:47.871578 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165476dc-5313-4ca1-83a3-85f071aae340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:47.872208 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165476dc-5313-4ca1-83a3-85f071aae340 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:47.872486 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165476dc-5313-4ca1-83a3-85f071aae340 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:47.872756 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165476dc-5313-4ca1-83a3-85f071aae340 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:47.894739 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e3118-f1f8-4898-a4d0-b298ea0b2aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:47.895436 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e3118-f1f8-4898-a4d0-b298ea0b2aff None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:47.895828 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e3118-f1f8-4898-a4d0-b298ea0b2aff None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:47.896106 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e3118-f1f8-4898-a4d0-b298ea0b2aff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:47.938921 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:47.943519 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165476dc-5313-4ca1-83a3-85f071aae340 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:47.945034 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165476dc-5313-4ca1-83a3-85f071aae340 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:47.969897 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81e3118-f1f8-4898-a4d0-b298ea0b2aff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:47.971894 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81e3118-f1f8-4898-a4d0-b298ea0b2aff None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:48.042943 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 424/855] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:30:47 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 02:30:48.044304 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88819239-1fa8-42d3-9678-3185ab0a24fd None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:48.044650 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88819239-1fa8-42d3-9678-3185ab0a24fd None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:48.044990 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88819239-1fa8-42d3-9678-3185ab0a24fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:48.063585 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-88819239-1fa8-42d3-9678-3185ab0a24fd None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:48.064765 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-88819239-1fa8-42d3-9678-3185ab0a24fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:48.083700 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 432/856] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:30:47 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 02:30:48.084802 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e3118-f1f8-4898-a4d0-b298ea0b2aff None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:48.090567 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:48.144441 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 425/857] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:48 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:30:48.145283 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88819239-1fa8-42d3-9678-3185ab0a24fd None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:48.168808 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:48.200897 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e3118-f1f8-4898-a4d0-b298ea0b2aff None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:48.239604 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb1932-594e-45f1-964c-6669ae7f65f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:48.240250 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb1932-594e-45f1-964c-6669ae7f65f9 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:48.240531 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb1932-594e-45f1-964c-6669ae7f65f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:48.240808 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb1932-594e-45f1-964c-6669ae7f65f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:48.251695 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb1932-594e-45f1-964c-6669ae7f65f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:48.253176 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb1932-594e-45f1-964c-6669ae7f65f9 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:48.267612 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-b9bb1932-594e-45f1-964c-6669ae7f65f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:48.267612 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:48.267612 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:48.267612 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:48.267612 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:48.267612 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:48.267612 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:48.267612 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:48.267612 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:48.267612 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:48.267612 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:48.267612 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:48.267612 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:48.267612 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:48.267612 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:48.268583 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:48.268583 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:48.268583 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:48.268583 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:48.268583 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:48.268583 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:48.268583 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:48.268583 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:48.268583 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:48.268583 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:48.268583 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:48.268583 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:48.268583 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:48.268583 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:48.268583 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:48.268583 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:48.268583 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:48.269491 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:48.269491 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:48.269491 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:48.269491 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:48.273888 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 433/858] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:48.274571 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb1932-594e-45f1-964c-6669ae7f65f9 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:48.278030 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88819239-1fa8-42d3-9678-3185ab0a24fd None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:48.313662 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351ec9b-0294-4c2e-9b50-3f3cae7307d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:48.314393 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351ec9b-0294-4c2e-9b50-3f3cae7307d3 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:48.314686 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351ec9b-0294-4c2e-9b50-3f3cae7307d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:48.314982 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351ec9b-0294-4c2e-9b50-3f3cae7307d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:48.325449 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0351ec9b-0294-4c2e-9b50-3f3cae7307d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:48.326900 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0351ec9b-0294-4c2e-9b50-3f3cae7307d3 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:48.335909 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:48.342279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-0351ec9b-0294-4c2e-9b50-3f3cae7307d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:48.342279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:48.342279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:48.342279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:48.342279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:48.342279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:48.342279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:48.342279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:48.342279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:48.342279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:48.342279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:48.342279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:48.342279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:48.342279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:48.342279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:48.343442 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:48.343442 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:48.343442 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:48.343442 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:48.343442 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:48.343442 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:48.343442 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:48.343442 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:48.343442 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:48.343442 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:48.343442 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:48.343442 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:48.343442 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:48.343442 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:48.343442 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:48.343442 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:48.343442 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:48.344547 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:48.344547 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:48.344547 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:48.344547 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:48.348682 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 426/859] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:48.349787 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351ec9b-0294-4c2e-9b50-3f3cae7307d3 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:48.393139 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb1932-594e-45f1-964c-6669ae7f65f9 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:48.418109 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:48.431888 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a86cc-3342-4c85-9298-ebc1c4681788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:48.432533 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a86cc-3342-4c85-9298-ebc1c4681788 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:48.433118 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a86cc-3342-4c85-9298-ebc1c4681788 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:48.433409 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a86cc-3342-4c85-9298-ebc1c4681788 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:48.434416 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a86cc-3342-4c85-9298-ebc1c4681788 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:48.436184 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a86cc-3342-4c85-9298-ebc1c4681788 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:48.447945 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-a39a86cc-3342-4c85-9298-ebc1c4681788 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 02:30:48.447945 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:48.447945 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:30:48.447945 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:30:48.447945 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:30:48.447945 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:30:48.447945 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:30:48.447945 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:30:48.447945 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 02:30:48.447945 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:48.447945 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:30:48.447945 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:48.447945 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:48.447945 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:48.447945 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:48.447945 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:48.448904 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:48.448904 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:48.448904 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:48.448904 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:48.448904 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:48.448904 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:48.448904 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:48.448904 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:30:48.448904 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:30:48.448904 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:30:48.448904 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:30:48.448904 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:48.448904 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:48.448904 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:48.448904 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:48.448904 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:48.449833 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:48.449833 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:48.449833 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:48.449833 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:48.449833 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:48.449833 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:48.449833 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:48.449833 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:48.449833 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:48.449833 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:48.449833 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:48.449833 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:30:48.449833 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:30:48.449833 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 02:30:48.449833 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:48.450702 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 434/860] 10.222.0.42 () {56 vars in 1132 bytes} [Fri Aug 5 02:30:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:48.451467 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a86cc-3342-4c85-9298-ebc1c4681788 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:48.456856 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351ec9b-0294-4c2e-9b50-3f3cae7307d3 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:48.491364 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044f97c-f814-46c4-a885-80bae81379a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:48.492017 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044f97c-f814-46c4-a885-80bae81379a6 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:48.492296 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044f97c-f814-46c4-a885-80bae81379a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:48.492567 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044f97c-f814-46c4-a885-80bae81379a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:48.493255 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044f97c-f814-46c4-a885-80bae81379a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:48.493558 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044f97c-f814-46c4-a885-80bae81379a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:48.494917 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044f97c-f814-46c4-a885-80bae81379a6 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:48.506814 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 427/861] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:48.507462 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044f97c-f814-46c4-a885-80bae81379a6 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:48.568320 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a86cc-3342-4c85-9298-ebc1c4681788 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:48.571904 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:48.610398 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3fc9b9-c367-4211-807b-37218ceeef52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:48.610908 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044f97c-f814-46c4-a885-80bae81379a6 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:48.611191 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3fc9b9-c367-4211-807b-37218ceeef52 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:48.611345 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3fc9b9-c367-4211-807b-37218ceeef52 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:48.611589 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3fc9b9-c367-4211-807b-37218ceeef52 None admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:48.613051 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3fc9b9-c367-4211-807b-37218ceeef52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:48.614144 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3fc9b9-c367-4211-807b-37218ceeef52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:48.615714 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3fc9b9-c367-4211-807b-37218ceeef52 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:48.632515 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 435/862] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:48.633462 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3fc9b9-c367-4211-807b-37218ceeef52 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:48.648945 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808660fc-2756-4049-a568-10f0e0530d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:48.649570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808660fc-2756-4049-a568-10f0e0530d7a None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:48.649849 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808660fc-2756-4049-a568-10f0e0530d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:48.650120 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808660fc-2756-4049-a568-10f0e0530d7a None admin] PATH_INFO: `/v3/services` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:48.650791 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808660fc-2756-4049-a568-10f0e0530d7a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:48.651120 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808660fc-2756-4049-a568-10f0e0530d7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:48.652631 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808660fc-2756-4049-a568-10f0e0530d7a None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:48.661684 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 428/863] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Aug 5 02:30:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:48.661684 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808660fc-2756-4049-a568-10f0e0530d7a None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:48.688030 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:48.745617 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3fc9b9-c367-4211-807b-37218ceeef52 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:48.768024 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808660fc-2756-4049-a568-10f0e0530d7a None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:48.781172 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ec1c3-730c-4cbe-b393-9d27f3665220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:48.781811 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ec1c3-730c-4cbe-b393-9d27f3665220 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:48.782093 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ec1c3-730c-4cbe-b393-9d27f3665220 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:48.782373 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ec1c3-730c-4cbe-b393-9d27f3665220 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:48.789661 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5ec1c3-730c-4cbe-b393-9d27f3665220 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:48.791139 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5ec1c3-730c-4cbe-b393-9d27f3665220 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:48.793077 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:48.803537 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-fa5ec1c3-730c-4cbe-b393-9d27f3665220 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:48.803537 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:48.803537 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:48.803537 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:48.803537 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:48.803537 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:48.803537 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:48.803537 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:48.803537 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:48.803537 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:48.803537 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:48.803537 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:48.803537 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:30:48.803537 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:30:48.803537 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:30:48.810275 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:30:48.810275 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:48.810275 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:48.810275 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:48.810275 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:48.810275 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:48.810275 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:48.810275 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:48.810275 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:48.810275 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:48.810275 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:48.810275 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:48.810275 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:48.810275 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:48.810275 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:48.810275 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:48.810275 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:48.811272 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:30:48.811272 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:30:48.811272 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:30:48.811272 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:30:48.811272 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:30:48.811272 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:30:48.811272 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:48.811272 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:48.811715 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116796d-c0c5-48ab-bd74-ddc35a2e9585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:48.811715 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116796d-c0c5-48ab-bd74-ddc35a2e9585 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:48.811875 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 436/864] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:30:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:48.811945 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116796d-c0c5-48ab-bd74-ddc35a2e9585 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:48.811945 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116796d-c0c5-48ab-bd74-ddc35a2e9585 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:48.812067 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ec1c3-730c-4cbe-b393-9d27f3665220 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:48.818168 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a116796d-c0c5-48ab-bd74-ddc35a2e9585 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:48.819704 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a116796d-c0c5-48ab-bd74-ddc35a2e9585 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:48.833218 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-a116796d-c0c5-48ab-bd74-ddc35a2e9585 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:48.833218 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:48.833218 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:48.833218 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:48.833218 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:48.833218 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:48.833218 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:48.833218 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:48.833218 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:48.833218 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:48.833218 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:48.833218 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:48.833218 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:30:48.833218 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:30:48.833218 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:30:48.834164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:30:48.834164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:48.834164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:48.834164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:48.834164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:48.834164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:48.834164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:48.834164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:48.834164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:48.834164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:48.834164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:48.834164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:48.834164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:48.834164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:48.834164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:48.834164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:48.834164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:48.835098 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:30:48.835098 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:30:48.835098 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:30:48.835098 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:30:48.835098 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:30:48.835098 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:30:48.835098 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:48.835098 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:48.835098 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 429/865] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:30:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:48.835613 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116796d-c0c5-48ab-bd74-ddc35a2e9585 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:48.919767 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ec1c3-730c-4cbe-b393-9d27f3665220 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:48.927385 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:48.953853 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116796d-c0c5-48ab-bd74-ddc35a2e9585 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:48.966773 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d11124-c1ec-4a54-b544-fa74b95f4ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:48.967544 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d11124-c1ec-4a54-b544-fa74b95f4ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:48.967830 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d11124-c1ec-4a54-b544-fa74b95f4ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:48.968227 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d11124-c1ec-4a54-b544-fa74b95f4ff7 None admin] PATH_INFO: `/v3/services` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:48.968907 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d11124-c1ec-4a54-b544-fa74b95f4ff7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:48.969213 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d11124-c1ec-4a54-b544-fa74b95f4ff7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:48.970708 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d11124-c1ec-4a54-b544-fa74b95f4ff7 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:48.976353 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 437/866] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Aug 5 02:30:48 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:48.977151 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d11124-c1ec-4a54-b544-fa74b95f4ff7 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:49.004678 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd159b-c67b-453f-a5cb-de37e6ab1ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:49.005852 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd159b-c67b-453f-a5cb-de37e6ab1ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:49.006721 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd159b-c67b-453f-a5cb-de37e6ab1ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:49.007534 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd159b-c67b-453f-a5cb-de37e6ab1ba2 None admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:49.008608 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd159b-c67b-453f-a5cb-de37e6ab1ba2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:49.009252 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd159b-c67b-453f-a5cb-de37e6ab1ba2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:49.011740 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd159b-c67b-453f-a5cb-de37e6ab1ba2 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:49.028847 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 430/867] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 5 02:30:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:49.035273 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd159b-c67b-453f-a5cb-de37e6ab1ba2 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:49.094940 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d11124-c1ec-4a54-b544-fa74b95f4ff7 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:49.097244 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:49.146491 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b785b9-7096-4ce1-b24b-80f0d5302d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:49.147525 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b785b9-7096-4ce1-b24b-80f0d5302d77 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:49.147525 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b785b9-7096-4ce1-b24b-80f0d5302d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:49.147737 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b785b9-7096-4ce1-b24b-80f0d5302d77 None admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:49.148946 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b785b9-7096-4ce1-b24b-80f0d5302d77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:49.148946 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b785b9-7096-4ce1-b24b-80f0d5302d77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:49.151297 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b785b9-7096-4ce1-b24b-80f0d5302d77 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:49.164729 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 438/868] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 5 02:30:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:49.170626 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b785b9-7096-4ce1-b24b-80f0d5302d77 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:49.171713 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd159b-c67b-453f-a5cb-de37e6ab1ba2 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:49.212733 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:49.220003 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14ff1f-3e3f-43c1-b1a5-84a31fa4dbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:49.220644 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14ff1f-3e3f-43c1-b1a5-84a31fa4dbd3 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:49.220983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14ff1f-3e3f-43c1-b1a5-84a31fa4dbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:49.221268 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14ff1f-3e3f-43c1-b1a5-84a31fa4dbd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:49.222744 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b14ff1f-3e3f-43c1-b1a5-84a31fa4dbd3 None admin] RBAC: Adding query filter params (role.id=2642213efc7d4861b3d3b4f5fbc9ad73, scope.project.id=63b323c02a614fc28aac6e7a060064ba, user.id=6bea520676244effbbe212aa62b1cc68) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:49.223099 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b14ff1f-3e3f-43c1-b1a5-84a31fa4dbd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:49.224797 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b14ff1f-3e3f-43c1-b1a5-84a31fa4dbd3 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:49.233214 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 431/869] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:30:49 2022] GET /identity/v3/role_assignments?user.id=6bea520676244effbbe212aa62b1cc68&scope.project.id=63b323c02a614fc28aac6e7a060064ba&role.id=2642213efc7d4861b3d3b4f5fbc9ad73 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:30:49.302230 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b785b9-7096-4ce1-b24b-80f0d5302d77 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:49.347116 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927a90b-dd91-43a0-8b39-a4d92e47b529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:49.348088 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927a90b-dd91-43a0-8b39-a4d92e47b529 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:49.348599 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927a90b-dd91-43a0-8b39-a4d92e47b529 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:49.349060 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927a90b-dd91-43a0-8b39-a4d92e47b529 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:49.350309 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3927a90b-dd91-43a0-8b39-a4d92e47b529 None admin] RBAC: Adding query filter params (role.id=83afe883a303495b966480fb9b5bb7dd, scope.project.id=63b323c02a614fc28aac6e7a060064ba, user.id=40f706f1eb2b4137afd367cb5060ced0) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:49.350809 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3927a90b-dd91-43a0-8b39-a4d92e47b529 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:49.352488 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3927a90b-dd91-43a0-8b39-a4d92e47b529 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:49.360056 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 439/870] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:30:49 2022] GET /identity/v3/role_assignments?user.id=40f706f1eb2b4137afd367cb5060ced0&scope.project.id=63b323c02a614fc28aac6e7a060064ba&role.id=83afe883a303495b966480fb9b5bb7dd => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:30:49.770620 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94a3ad-1206-4618-9ea7-7f47b2b6bba8 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:49.771034 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94a3ad-1206-4618-9ea7-7f47b2b6bba8 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:49.771216 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94a3ad-1206-4618-9ea7-7f47b2b6bba8 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:49.772786 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 432/871] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:30:49.778149 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457b13c-58b5-413b-939c-9680f876fbf1 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:49.778682 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457b13c-58b5-413b-939c-9680f876fbf1 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:49.778682 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457b13c-58b5-413b-939c-9680f876fbf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:49.796656 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-2457b13c-58b5-413b-939c-9680f876fbf1 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:49.799389 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-2457b13c-58b5-413b-939c-9680f876fbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:49.871120 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 440/872] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:49 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:30:49.890015 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94a3ad-1206-4618-9ea7-7f47b2b6bba8 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:49.997241 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94a3ad-1206-4618-9ea7-7f47b2b6bba8 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:50.007705 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:50.037719 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06973e3-eb7f-430d-a813-2d85f095e668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:50.037719 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06973e3-eb7f-430d-a813-2d85f095e668 None admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:50.037719 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06973e3-eb7f-430d-a813-2d85f095e668 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:50.037719 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06973e3-eb7f-430d-a813-2d85f095e668 None admin] PATH_INFO: `/v3/services` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:50.038106 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06973e3-eb7f-430d-a813-2d85f095e668 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:50.038106 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06973e3-eb7f-430d-a813-2d85f095e668 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:50.111213 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 433/873] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Aug 5 02:30:49 2022] POST /identity/v3/services => generated 251 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:30:51.054372 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587445c-9e20-4e07-93f1-c68aeab0c283 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:51.054899 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587445c-9e20-4e07-93f1-c68aeab0c283 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:51.054995 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587445c-9e20-4e07-93f1-c68aeab0c283 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:51.056564 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 441/874] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:30:51.061788 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403463e8-ecd2-46dd-bd7f-d2d38780e45c None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:51.062208 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403463e8-ecd2-46dd-bd7f-d2d38780e45c None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:51.062379 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403463e8-ecd2-46dd-bd7f-d2d38780e45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:51.081727 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-403463e8-ecd2-46dd-bd7f-d2d38780e45c None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:51.082925 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-403463e8-ecd2-46dd-bd7f-d2d38780e45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:51.158221 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 434/875] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:51 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:30:51.180210 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587445c-9e20-4e07-93f1-c68aeab0c283 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:51.209443 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:51.317144 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587445c-9e20-4e07-93f1-c68aeab0c283 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:51.352879 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c277793-2629-4ad2-bc29-941e7f386da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:51.353513 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c277793-2629-4ad2-bc29-941e7f386da8 None admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:51.353799 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c277793-2629-4ad2-bc29-941e7f386da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:51.354078 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c277793-2629-4ad2-bc29-941e7f386da8 None admin] PATH_INFO: `/v3/services` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:51.354789 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c277793-2629-4ad2-bc29-941e7f386da8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:51.356200 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c277793-2629-4ad2-bc29-941e7f386da8 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:51.370428 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a432770-daa9-482f-b1cc-7c744fc7e28e None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:51.370722 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a432770-daa9-482f-b1cc-7c744fc7e28e None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:51.371034 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a432770-daa9-482f-b1cc-7c744fc7e28e None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:51.372645 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 435/876] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:30:51.377248 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b5a57-7a11-4586-b0e2-c04d2df991df None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:51.378059 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b5a57-7a11-4586-b0e2-c04d2df991df None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:51.378341 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b5a57-7a11-4586-b0e2-c04d2df991df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:51.396960 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-ff3b5a57-7a11-4586-b0e2-c04d2df991df None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:51.398141 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-ff3b5a57-7a11-4586-b0e2-c04d2df991df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:51.432227 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 442/877] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Aug 5 02:30:51 2022] POST /identity/v3/services => generated 269 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:30:51.485262 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 436/878] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:51 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 02:30:51.510122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c277793-2629-4ad2-bc29-941e7f386da8 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:51.518665 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5fc63-5138-45e5-884c-312daa7431d1 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:51.518990 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5fc63-5138-45e5-884c-312daa7431d1 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:51.519249 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5fc63-5138-45e5-884c-312daa7431d1 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:51.520921 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 437/879] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:30:51.526371 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7418528-40f1-442b-9c8a-fc05fcf99f45 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:51.526654 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7418528-40f1-442b-9c8a-fc05fcf99f45 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:51.526933 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7418528-40f1-442b-9c8a-fc05fcf99f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:51.546746 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-e7418528-40f1-442b-9c8a-fc05fcf99f45 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:51.547981 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-e7418528-40f1-442b-9c8a-fc05fcf99f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:51.564198 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:51.623875 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:51.645159 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c277793-2629-4ad2-bc29-941e7f386da8 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:51.645850 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 438/880] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:51 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 02:30:51.661684 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7418528-40f1-442b-9c8a-fc05fcf99f45 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:51.697641 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5aad51-ce27-4ff5-af3c-c6742f263c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:51.698398 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5aad51-ce27-4ff5-af3c-c6742f263c52 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:51.698588 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5aad51-ce27-4ff5-af3c-c6742f263c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:51.698830 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5aad51-ce27-4ff5-af3c-c6742f263c52 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:51.713020 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5aad51-ce27-4ff5-af3c-c6742f263c52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:30:51.720868 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-bb5aad51-ce27-4ff5-af3c-c6742f263c52 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 02:30:51.720868 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:51.720868 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:51.720868 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:51.720868 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:51.720868 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:51.720868 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:51.720868 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:51.720868 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:51.720868 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:51.720868 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:51.720868 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:51.720868 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:30:51.720868 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:30:51.720868 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:30:51.720868 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:30:51.721888 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:30:51.721888 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:30:51.721888 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:30:51.721888 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:30:51.721888 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:51.721888 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:51.721888 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:51.721888 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:51.721888 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:51.721888 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:51.721888 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:51.721888 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:51.721888 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:51.721888 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:51.721888 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:51.721888 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:51.722741 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:51.722741 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:51.722741 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:51.722741 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:51.722741 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:30:51.722741 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:30:51.722741 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:30:51.722741 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:30:51.722741 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:30:51.722741 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:30:51.722741 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 02:30:51.722741 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:51.726002 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 443/881] 10.222.0.42 () {56 vars in 1120 bytes} [Fri Aug 5 02:30:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:51.732070 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5aad51-ce27-4ff5-af3c-c6742f263c52 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:51.774931 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7418528-40f1-442b-9c8a-fc05fcf99f45 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:51.811270 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71e5a7-f41f-4c36-a6c5-ecf75a37c906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:51.812103 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71e5a7-f41f-4c36-a6c5-ecf75a37c906 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:51.812488 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71e5a7-f41f-4c36-a6c5-ecf75a37c906 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:51.812856 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71e5a7-f41f-4c36-a6c5-ecf75a37c906 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:51.813581 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b71e5a7-f41f-4c36-a6c5-ecf75a37c906 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:51.815138 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b71e5a7-f41f-4c36-a6c5-ecf75a37c906 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:51.824494 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-4b71e5a7-f41f-4c36-a6c5-ecf75a37c906 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 02:30:51.824494 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:51.824494 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:30:51.824494 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:30:51.824494 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:30:51.824494 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:30:51.824494 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:30:51.824494 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:30:51.824494 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 02:30:51.824494 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:51.824494 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:30:51.824494 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:51.824494 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:51.824494 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:51.824494 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:51.824494 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:51.824494 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:51.825603 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:51.825603 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:51.825603 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:51.825603 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:51.825603 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:51.825603 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:51.825603 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:30:51.825603 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:30:51.825603 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:30:51.825603 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:30:51.825603 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:51.825603 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:51.825603 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:51.825603 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:51.825603 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:51.825603 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:51.826471 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:51.826471 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:51.826471 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:51.826471 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:51.826471 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:51.826471 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:51.826471 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:51.826471 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:51.826471 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:51.826471 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:51.826471 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:30:51.826471 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:30:51.826471 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 02:30:51.826471 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:51.831546 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 439/882] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Aug 5 02:30:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:30:51.832421 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71e5a7-f41f-4c36-a6c5-ecf75a37c906 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:51.844541 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5aad51-ce27-4ff5-af3c-c6742f263c52 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:51.849783 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:51.881857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa5a15-00bc-45ab-abec-e01978515c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:51.882835 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa5a15-00bc-45ab-abec-e01978515c53 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:51.883375 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa5a15-00bc-45ab-abec-e01978515c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:51.883866 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa5a15-00bc-45ab-abec-e01978515c53 None admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:51.884788 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa5a15-00bc-45ab-abec-e01978515c53 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:51.885297 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa5a15-00bc-45ab-abec-e01978515c53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:51.886905 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa5a15-00bc-45ab-abec-e01978515c53 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:51.900868 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 444/883] 10.222.0.42 () {56 vars in 1115 bytes} [Fri Aug 5 02:30:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:30:51.902023 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa5a15-00bc-45ab-abec-e01978515c53 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:51.911813 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:51.940694 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71e5a7-f41f-4c36-a6c5-ecf75a37c906 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:51.978398 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcb9dc-aee3-4de1-b267-23edac01487d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:51.979066 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcb9dc-aee3-4de1-b267-23edac01487d None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:51.979350 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcb9dc-aee3-4de1-b267-23edac01487d None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:51.979623 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcb9dc-aee3-4de1-b267-23edac01487d None admin] PATH_INFO: `/v3/services` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:51.980298 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fcb9dc-aee3-4de1-b267-23edac01487d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:51.980601 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fcb9dc-aee3-4de1-b267-23edac01487d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:51.981965 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fcb9dc-aee3-4de1-b267-23edac01487d None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:51.992278 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 440/884] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Aug 5 02:30:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:51.993591 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcb9dc-aee3-4de1-b267-23edac01487d None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:52.014125 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa5a15-00bc-45ab-abec-e01978515c53 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:52.050874 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f720937-3b5f-4155-ba6c-6cd458f69c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:52.051927 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f720937-3b5f-4155-ba6c-6cd458f69c75 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:52.052460 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f720937-3b5f-4155-ba6c-6cd458f69c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:52.052937 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f720937-3b5f-4155-ba6c-6cd458f69c75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:52.066886 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f720937-3b5f-4155-ba6c-6cd458f69c75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:52.068375 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f720937-3b5f-4155-ba6c-6cd458f69c75 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:52.081260 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:52.084378 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-6f720937-3b5f-4155-ba6c-6cd458f69c75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:52.084378 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:52.084378 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:52.084378 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:52.084378 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:52.084378 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:52.084378 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:52.084378 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:52.084378 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:52.084378 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:52.084378 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:52.084378 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:52.084378 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:52.084378 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:52.084378 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:52.085253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:52.085253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:52.085253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:52.085253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:52.085253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:52.085253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:52.085253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:52.085253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:52.085253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:52.085253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:52.085253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:52.085253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:52.085253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:52.085253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:52.085253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:52.085253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:52.085253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:52.086236 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:52.086236 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:52.086236 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:52.086236 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:52.090610 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 445/885] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:52.091528 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f720937-3b5f-4155-ba6c-6cd458f69c75 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:52.113840 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcb9dc-aee3-4de1-b267-23edac01487d None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:52.156575 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:52.160588 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af65302-1840-4dd7-bd8d-475dca306f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:52.162135 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af65302-1840-4dd7-bd8d-475dca306f5e None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:52.162882 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af65302-1840-4dd7-bd8d-475dca306f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:52.167542 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af65302-1840-4dd7-bd8d-475dca306f5e None admin] PATH_INFO: `/v3/services` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:52.167542 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af65302-1840-4dd7-bd8d-475dca306f5e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:52.167542 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af65302-1840-4dd7-bd8d-475dca306f5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:52.167542 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af65302-1840-4dd7-bd8d-475dca306f5e None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:52.178337 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 441/886] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Aug 5 02:30:51 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:52.202576 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96f9f5-2cc5-414b-a25c-afb66f45dd33 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:52.204853 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96f9f5-2cc5-414b-a25c-afb66f45dd33 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:52.204853 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96f9f5-2cc5-414b-a25c-afb66f45dd33 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:52.204853 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 442/887] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:30:52.210737 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6a809-153f-4d2d-b4fe-091278be7831 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:52.211059 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6a809-153f-4d2d-b4fe-091278be7831 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:52.211345 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6a809-153f-4d2d-b4fe-091278be7831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:52.213535 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f720937-3b5f-4155-ba6c-6cd458f69c75 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:52.232086 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-67c6a809-153f-4d2d-b4fe-091278be7831 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:52.233410 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-67c6a809-153f-4d2d-b4fe-091278be7831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:52.256581 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e712ed-fb99-4e5f-a41c-5b781257379c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:52.257215 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e712ed-fb99-4e5f-a41c-5b781257379c None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:52.257497 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e712ed-fb99-4e5f-a41c-5b781257379c None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:52.257806 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e712ed-fb99-4e5f-a41c-5b781257379c None admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:52.258508 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e712ed-fb99-4e5f-a41c-5b781257379c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:52.258813 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e712ed-fb99-4e5f-a41c-5b781257379c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:52.260262 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e712ed-fb99-4e5f-a41c-5b781257379c None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:52.278383 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 446/888] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:52.285288 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e712ed-fb99-4e5f-a41c-5b781257379c None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:52.343161 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 443/889] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:52 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 02:30:52.369640 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6a809-153f-4d2d-b4fe-091278be7831 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:52.422875 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e712ed-fb99-4e5f-a41c-5b781257379c None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:52.448466 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:52.459397 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:52.473501 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a24639-cbaa-46cd-8c25-dcf655a48040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:52.474151 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a24639-cbaa-46cd-8c25-dcf655a48040 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:52.474697 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a24639-cbaa-46cd-8c25-dcf655a48040 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:52.475014 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a24639-cbaa-46cd-8c25-dcf655a48040 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:52.485069 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a24639-cbaa-46cd-8c25-dcf655a48040 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:52.487703 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a24639-cbaa-46cd-8c25-dcf655a48040 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:52.492393 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6a809-153f-4d2d-b4fe-091278be7831 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:52.504036 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-83a24639-cbaa-46cd-8c25-dcf655a48040 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 02:30:52.504036 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:52.504036 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:52.504036 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:52.504036 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:52.504036 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:52.504036 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:52.504036 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:52.504036 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:52.504036 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:52.504036 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:52.504036 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:52.504036 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:30:52.504036 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:30:52.504036 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:30:52.504036 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:30:52.505000 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:52.505000 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:52.505000 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:30:52.505000 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:52.505000 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:30:52.505000 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:52.505000 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:52.505000 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:52.505000 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:52.505000 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:52.505000 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:52.505000 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:52.505000 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:52.505000 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:52.505000 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:52.505000 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:52.505000 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:52.505000 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:52.505973 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:52.505973 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:52.505973 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:30:52.505973 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:30:52.505973 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:30:52.505973 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:30:52.505973 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:30:52.505973 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:30:52.505973 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 02:30:52.505973 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:52.505973 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 447/890] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Aug 5 02:30:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:30:52.511924 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a24639-cbaa-46cd-8c25-dcf655a48040 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:52.543177 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a9bde9-a830-4047-bd78-eb6f898d9090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:52.544203 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9bde9-a830-4047-bd78-eb6f898d9090 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:52.544694 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9bde9-a830-4047-bd78-eb6f898d9090 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:52.545175 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9bde9-a830-4047-bd78-eb6f898d9090 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:52.546013 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a9bde9-a830-4047-bd78-eb6f898d9090 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:52.547626 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a9bde9-a830-4047-bd78-eb6f898d9090 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:52.558000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-46a9bde9-a830-4047-bd78-eb6f898d9090 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 02:30:52.558000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:52.558000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:30:52.558000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:30:52.558000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:30:52.558000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:30:52.558000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:30:52.558000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:30:52.558000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 02:30:52.558000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:52.558000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:30:52.558000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:52.558000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:52.558000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:52.558000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:52.558000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:52.558000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:52.559023 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:52.559023 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:52.559023 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:52.559023 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:52.559023 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:52.559023 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:52.559023 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:30:52.559023 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:30:52.559023 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:30:52.559023 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:30:52.559023 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:52.559023 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:52.559023 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:52.559023 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:52.559023 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:52.559023 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:52.559871 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:52.559871 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:52.559871 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:52.559871 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:52.559871 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:52.559871 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:52.559871 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:52.559871 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:52.559871 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:52.559871 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:52.559871 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:30:52.559871 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:30:52.559871 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 02:30:52.559871 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:52.567215 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 444/891] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 5 02:30:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:30:52.568594 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a9bde9-a830-4047-bd78-eb6f898d9090 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:52.631272 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a24639-cbaa-46cd-8c25-dcf655a48040 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:52.667285 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a5752-4fea-4dfc-9a9b-32dd8fc8fd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:52.668365 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a5752-4fea-4dfc-9a9b-32dd8fc8fd4a None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:52.668365 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a5752-4fea-4dfc-9a9b-32dd8fc8fd4a None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:52.668816 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a5752-4fea-4dfc-9a9b-32dd8fc8fd4a None admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:52.669821 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a5752-4fea-4dfc-9a9b-32dd8fc8fd4a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:52.670261 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a5752-4fea-4dfc-9a9b-32dd8fc8fd4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:52.671887 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a5752-4fea-4dfc-9a9b-32dd8fc8fd4a None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:52.685890 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a9bde9-a830-4047-bd78-eb6f898d9090 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:52.696005 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 448/892] 10.222.0.42 () {56 vars in 1149 bytes} [Fri Aug 5 02:30:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:52.697147 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a5752-4fea-4dfc-9a9b-32dd8fc8fd4a None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:52.729218 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0239a7-e79a-47fe-82a4-47ef8e2bad57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:52.730200 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0239a7-e79a-47fe-82a4-47ef8e2bad57 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:52.730684 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0239a7-e79a-47fe-82a4-47ef8e2bad57 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:52.731225 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0239a7-e79a-47fe-82a4-47ef8e2bad57 None admin] PATH_INFO: `/v3/services` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:52.732106 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0239a7-e79a-47fe-82a4-47ef8e2bad57 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:52.732612 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0239a7-e79a-47fe-82a4-47ef8e2bad57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:52.734251 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0239a7-e79a-47fe-82a4-47ef8e2bad57 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:52.736347 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:52.741008 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 445/893] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 5 02:30:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:52.741634 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:52.747324 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0239a7-e79a-47fe-82a4-47ef8e2bad57 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:52.815368 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a5752-4fea-4dfc-9a9b-32dd8fc8fd4a None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:52.857679 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874a36c-5f3d-493e-b2fe-01b5eb4a9d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:52.858410 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874a36c-5f3d-493e-b2fe-01b5eb4a9d7e None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:52.858760 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874a36c-5f3d-493e-b2fe-01b5eb4a9d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:52.859144 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874a36c-5f3d-493e-b2fe-01b5eb4a9d7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:52.874633 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0239a7-e79a-47fe-82a4-47ef8e2bad57 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:52.917640 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c074f-f33f-4003-97c2-ba21bc76c514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:52.918570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c074f-f33f-4003-97c2-ba21bc76c514 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:52.919241 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c074f-f33f-4003-97c2-ba21bc76c514 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:52.919703 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c074f-f33f-4003-97c2-ba21bc76c514 None admin] PATH_INFO: `/v3/services` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:52.920836 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c074f-f33f-4003-97c2-ba21bc76c514 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:52.921365 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c074f-f33f-4003-97c2-ba21bc76c514 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:52.923413 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c074f-f33f-4003-97c2-ba21bc76c514 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:52.935309 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 446/894] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 5 02:30:52 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:52.936930 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c074f-f33f-4003-97c2-ba21bc76c514 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:52.942325 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3874a36c-5f3d-493e-b2fe-01b5eb4a9d7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:52.943908 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3874a36c-5f3d-493e-b2fe-01b5eb4a9d7e None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:52.995986 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:53.021936 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:53.064931 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c074f-f33f-4003-97c2-ba21bc76c514 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:53.078995 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 449/895] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:30:52 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 02:30:53.083519 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874a36c-5f3d-493e-b2fe-01b5eb4a9d7e None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:53.107908 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11917c8-5b0f-4cc3-8233-bd3e21014fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:53.108621 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11917c8-5b0f-4cc3-8233-bd3e21014fab None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:53.108976 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11917c8-5b0f-4cc3-8233-bd3e21014fab None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:53.109329 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11917c8-5b0f-4cc3-8233-bd3e21014fab None admin] PATH_INFO: `/v3/endpoints` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:53.110160 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11917c8-5b0f-4cc3-8233-bd3e21014fab None admin] RBAC: Adding query filter params (interface=public, service_id=a29b50bdf6b444cc91a431cf2591d4f8, region_id=RegionOne) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:53.110593 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11917c8-5b0f-4cc3-8233-bd3e21014fab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:53.112252 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11917c8-5b0f-4cc3-8233-bd3e21014fab None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:53.122629 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 447/896] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Aug 5 02:30:52 2022] GET /identity/v3/endpoints?service_id=a29b50bdf6b444cc91a431cf2591d4f8&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:30:53.123700 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11917c8-5b0f-4cc3-8233-bd3e21014fab None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:53.198048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874a36c-5f3d-493e-b2fe-01b5eb4a9d7e None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:53.236412 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1050ee7-5982-4cb7-a03f-f980cd6d6d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:53.237418 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1050ee7-5982-4cb7-a03f-f980cd6d6d1c None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:53.237630 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1050ee7-5982-4cb7-a03f-f980cd6d6d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:53.237888 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1050ee7-5982-4cb7-a03f-f980cd6d6d1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:53.241065 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:53.247506 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11917c8-5b0f-4cc3-8233-bd3e21014fab None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:53.251248 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1050ee7-5982-4cb7-a03f-f980cd6d6d1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:53.252240 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1050ee7-5982-4cb7-a03f-f980cd6d6d1c None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:53.269112 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-c1050ee7-5982-4cb7-a03f-f980cd6d6d1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:53.269112 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:53.269112 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:53.269112 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:53.269112 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:53.269112 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:53.269112 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:53.269112 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:53.269112 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:53.269112 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:53.269112 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:53.269112 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:53.269112 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:53.269112 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:53.269112 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:53.270641 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:53.270641 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:53.270641 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:53.270641 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:53.270641 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:53.270641 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:53.270641 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:53.270641 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:53.270641 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:53.270641 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:53.270641 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:53.270641 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:53.270641 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:53.270641 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:53.270641 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:53.270641 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:53.270641 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:53.271768 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:53.271768 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:53.271768 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:53.271768 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:53.277058 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 450/897] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:53.278069 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1050ee7-5982-4cb7-a03f-f980cd6d6d1c None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:53.282707 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:53.292765 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945a0d7-1c99-4eff-b33e-3988b781681e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:53.293522 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945a0d7-1c99-4eff-b33e-3988b781681e None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:53.293869 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945a0d7-1c99-4eff-b33e-3988b781681e None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:53.294332 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945a0d7-1c99-4eff-b33e-3988b781681e None admin] PATH_INFO: `/v3/services` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:53.295517 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d945a0d7-1c99-4eff-b33e-3988b781681e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:53.297324 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d945a0d7-1c99-4eff-b33e-3988b781681e None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:53.308157 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 448/898] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Aug 5 02:30:53 2022] GET /identity/v3/services => generated 1268 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:30:53.401912 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1050ee7-5982-4cb7-a03f-f980cd6d6d1c None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:53.438930 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3079f2-42c7-46ad-b942-73ae12fca8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:53.439587 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3079f2-42c7-46ad-b942-73ae12fca8c5 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:53.439867 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3079f2-42c7-46ad-b942-73ae12fca8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:53.440724 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3079f2-42c7-46ad-b942-73ae12fca8c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:53.441428 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3079f2-42c7-46ad-b942-73ae12fca8c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:53.441731 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3079f2-42c7-46ad-b942-73ae12fca8c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:53.443160 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3079f2-42c7-46ad-b942-73ae12fca8c5 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:53.457412 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 451/899] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:53.464076 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945a0d7-1c99-4eff-b33e-3988b781681e None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:53.577699 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945a0d7-1c99-4eff-b33e-3988b781681e None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:53.584358 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b561e7-fd6d-433e-8602-9966d07a4e3b None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:53.584652 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b561e7-fd6d-433e-8602-9966d07a4e3b None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:53.584930 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b561e7-fd6d-433e-8602-9966d07a4e3b None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:53.586601 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 452/900] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:30:53.591435 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7925a8d-42d9-40d3-89bf-b4edb7b3df62 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:53.591779 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7925a8d-42d9-40d3-89bf-b4edb7b3df62 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:53.592060 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7925a8d-42d9-40d3-89bf-b4edb7b3df62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:53.612792 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-f7925a8d-42d9-40d3-89bf-b4edb7b3df62 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:53.614185 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-f7925a8d-42d9-40d3-89bf-b4edb7b3df62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:53.617321 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41445437-071b-4878-9869-b99830bbb8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:53.618226 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41445437-071b-4878-9869-b99830bbb8f8 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:53.618715 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41445437-071b-4878-9869-b99830bbb8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:53.619228 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41445437-071b-4878-9869-b99830bbb8f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:53.626495 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41445437-071b-4878-9869-b99830bbb8f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:53.628760 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41445437-071b-4878-9869-b99830bbb8f8 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:53.640761 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-41445437-071b-4878-9869-b99830bbb8f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:53.640761 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:53.640761 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:53.640761 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:53.640761 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:53.640761 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:53.640761 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:53.640761 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:53.640761 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:53.640761 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:53.640761 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:53.640761 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:53.640761 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:30:53.640761 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:30:53.640761 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:30:53.641646 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:30:53.641646 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:53.641646 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:53.641646 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:53.641646 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:53.641646 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:53.641646 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:53.641646 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:53.641646 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:53.641646 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:53.641646 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:53.641646 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:53.641646 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:53.641646 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:53.641646 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:53.641646 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:53.641646 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:53.642541 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:30:53.642541 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:30:53.642541 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:30:53.642541 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:30:53.642541 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:30:53.642541 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:30:53.642541 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:53.642541 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:53.645543 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 449/901] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:30:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:53.654878 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41445437-071b-4878-9869-b99830bbb8f8 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:53.664532 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:53.703108 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 453/902] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:53 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 02:30:53.716673 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:53.722823 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7925a8d-42d9-40d3-89bf-b4edb7b3df62 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:53.788496 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41445437-071b-4878-9869-b99830bbb8f8 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:53.832893 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ffe4cc-7d69-43b7-b55d-0c03cdd2c7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:53.833675 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ffe4cc-7d69-43b7-b55d-0c03cdd2c7bb None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:53.833958 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ffe4cc-7d69-43b7-b55d-0c03cdd2c7bb None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:53.834231 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ffe4cc-7d69-43b7-b55d-0c03cdd2c7bb None admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:53.835301 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ffe4cc-7d69-43b7-b55d-0c03cdd2c7bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:53.835607 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ffe4cc-7d69-43b7-b55d-0c03cdd2c7bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:53.837039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ffe4cc-7d69-43b7-b55d-0c03cdd2c7bb None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:53.851976 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7925a8d-42d9-40d3-89bf-b4edb7b3df62 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:53.853055 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 450/903] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 5 02:30:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:53.858907 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ffe4cc-7d69-43b7-b55d-0c03cdd2c7bb None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:53.893662 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b6bbe-cbc3-42bb-a90e-5e56f21246aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:53.894306 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b6bbe-cbc3-42bb-a90e-5e56f21246aa None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:53.894591 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b6bbe-cbc3-42bb-a90e-5e56f21246aa None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:53.894865 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b6bbe-cbc3-42bb-a90e-5e56f21246aa None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:53.895522 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b6bbe-cbc3-42bb-a90e-5e56f21246aa None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:53.896903 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b6bbe-cbc3-42bb-a90e-5e56f21246aa None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:53.906834 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-ae5b6bbe-cbc3-42bb-a90e-5e56f21246aa None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 02:30:53.906834 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:53.906834 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:30:53.906834 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:30:53.906834 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:30:53.906834 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:30:53.906834 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:30:53.906834 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:30:53.906834 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 02:30:53.906834 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:53.906834 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:30:53.906834 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:53.906834 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:53.906834 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:53.906834 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:53.906834 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:53.907866 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:53.907866 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:53.907866 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:53.907866 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:53.907866 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:53.907866 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:53.907866 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:53.907866 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:30:53.907866 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:30:53.907866 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:30:53.907866 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:30:53.907866 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:53.907866 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:53.907866 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:53.907866 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:53.907866 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:53.908770 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:53.908770 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:53.908770 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:53.908770 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:53.908770 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:53.908770 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:53.908770 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:53.908770 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:53.908770 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:53.908770 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:53.908770 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:53.908770 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:30:53.908770 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:30:53.908770 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 02:30:53.908770 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:53.908770 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 454/904] 10.222.0.42 () {56 vars in 1132 bytes} [Fri Aug 5 02:30:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:53.913881 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b6bbe-cbc3-42bb-a90e-5e56f21246aa None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:53.961099 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:53.978352 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ffe4cc-7d69-43b7-b55d-0c03cdd2c7bb None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:53.999550 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:54.023034 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810910b-1eaa-4d08-877d-a5573e78d080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:54.023736 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810910b-1eaa-4d08-877d-a5573e78d080 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:54.023996 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810910b-1eaa-4d08-877d-a5573e78d080 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:54.024286 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810910b-1eaa-4d08-877d-a5573e78d080 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:54.025073 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1810910b-1eaa-4d08-877d-a5573e78d080 None admin] RBAC: Adding query filter params (role.id=c14dbbd7897245a18070be9be19c278b, scope.project.id=63b323c02a614fc28aac6e7a060064ba, user.id=6bea520676244effbbe212aa62b1cc68) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:54.025384 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1810910b-1eaa-4d08-877d-a5573e78d080 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:54.026962 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1810910b-1eaa-4d08-877d-a5573e78d080 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:54.043196 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 451/905] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:30:53 2022] GET /identity/v3/role_assignments?user.id=6bea520676244effbbe212aa62b1cc68&scope.project.id=63b323c02a614fc28aac6e7a060064ba&role.id=c14dbbd7897245a18070be9be19c278b => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:54.056767 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b6bbe-cbc3-42bb-a90e-5e56f21246aa None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:54.094353 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ad61d-4506-48bd-b07f-48ce917d6f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:54.095041 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ad61d-4506-48bd-b07f-48ce917d6f6e None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:54.095286 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ad61d-4506-48bd-b07f-48ce917d6f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:54.095563 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ad61d-4506-48bd-b07f-48ce917d6f6e None admin] PATH_INFO: `/v3/services` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:54.096788 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ad61d-4506-48bd-b07f-48ce917d6f6e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:54.097093 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ad61d-4506-48bd-b07f-48ce917d6f6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:54.098512 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ad61d-4506-48bd-b07f-48ce917d6f6e None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:54.104881 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 455/906] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Aug 5 02:30:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:54.110796 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810910b-1eaa-4d08-877d-a5573e78d080 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:54.221721 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810910b-1eaa-4d08-877d-a5573e78d080 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:54.262052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a586090-5ee4-4844-8401-4e179369491c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:54.262687 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a586090-5ee4-4844-8401-4e179369491c None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:54.262997 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a586090-5ee4-4844-8401-4e179369491c None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:54.264911 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a586090-5ee4-4844-8401-4e179369491c None admin] PATH_INFO: `/v3/services` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:54.264911 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a586090-5ee4-4844-8401-4e179369491c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:54.264911 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a586090-5ee4-4844-8401-4e179369491c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:54.265578 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a586090-5ee4-4844-8401-4e179369491c None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:54.274007 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 452/907] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Aug 5 02:30:54 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:54.279755 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ad61d-4506-48bd-b07f-48ce917d6f6e None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:54.290746 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56ec59-44d6-4a61-842f-395a21834cdc None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:54.291060 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56ec59-44d6-4a61-842f-395a21834cdc None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:54.291330 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56ec59-44d6-4a61-842f-395a21834cdc None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:54.293871 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 453/908] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:30:54.297877 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166c683-1a37-4df8-9df9-6a03d915603a None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:54.298162 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166c683-1a37-4df8-9df9-6a03d915603a None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:54.298439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166c683-1a37-4df8-9df9-6a03d915603a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:54.316890 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-a166c683-1a37-4df8-9df9-6a03d915603a None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:54.318069 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-a166c683-1a37-4df8-9df9-6a03d915603a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:54.356751 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:54.396020 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 454/909] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:54 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 02:30:54.413123 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ad61d-4506-48bd-b07f-48ce917d6f6e None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:54.414664 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166c683-1a37-4df8-9df9-6a03d915603a None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:54.423914 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:54.462879 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93101d-b50d-4b66-853d-152930793324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:54.467116 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93101d-b50d-4b66-853d-152930793324 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:54.467116 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93101d-b50d-4b66-853d-152930793324 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:54.467116 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93101d-b50d-4b66-853d-152930793324 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:54.467116 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d93101d-b50d-4b66-853d-152930793324 None admin] RBAC: Adding query filter params (interface=public, service_id=6eb7cddb8a774dbbabfbe96f3fbc2586, region_id=RegionOne) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:54.467116 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d93101d-b50d-4b66-853d-152930793324 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:54.467116 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d93101d-b50d-4b66-853d-152930793324 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:54.480651 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 456/910] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Aug 5 02:30:54 2022] GET /identity/v3/endpoints?service_id=6eb7cddb8a774dbbabfbe96f3fbc2586&interface=public®ion_id=RegionOne => generated 194 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:30:54.485661 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93101d-b50d-4b66-853d-152930793324 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:54.529929 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166c683-1a37-4df8-9df9-6a03d915603a None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:54.568523 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc3457-a2c1-4122-956d-c398a6b4f119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:54.569309 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc3457-a2c1-4122-956d-c398a6b4f119 None admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:54.569705 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc3457-a2c1-4122-956d-c398a6b4f119 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:54.570180 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc3457-a2c1-4122-956d-c398a6b4f119 None admin] PATH_INFO: `/v3/services` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:54.571152 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc3457-a2c1-4122-956d-c398a6b4f119 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:54.572771 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc3457-a2c1-4122-956d-c398a6b4f119 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:54.608377 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93101d-b50d-4b66-853d-152930793324 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:54.639208 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 455/911] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Aug 5 02:30:54 2022] POST /identity/v3/services => generated 241 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:30:54.660863 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f7910-ad5e-4228-b6bd-3fc5bb2a789c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:54.661497 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f7910-ad5e-4228-b6bd-3fc5bb2a789c None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:54.661932 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f7910-ad5e-4228-b6bd-3fc5bb2a789c None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:54.662213 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f7910-ad5e-4228-b6bd-3fc5bb2a789c None admin] PATH_INFO: `/v3/services` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:54.662879 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f7910-ad5e-4228-b6bd-3fc5bb2a789c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:54.664416 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f7910-ad5e-4228-b6bd-3fc5bb2a789c None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:54.672080 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 457/912] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Aug 5 02:30:54 2022] GET /identity/v3/services => generated 1497 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:30:55.453242 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b44d4-55ef-479c-996f-ebc5af789e63 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:55.453754 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b44d4-55ef-479c-996f-ebc5af789e63 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:55.453829 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b44d4-55ef-479c-996f-ebc5af789e63 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:55.455973 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 456/913] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:30:55.461086 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a38c2d-d2bb-4e54-aed7-d613227292df None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:55.461473 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a38c2d-d2bb-4e54-aed7-d613227292df None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:55.461654 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a38c2d-d2bb-4e54-aed7-d613227292df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:55.480795 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-b7a38c2d-d2bb-4e54-aed7-d613227292df None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:55.481980 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-b7a38c2d-d2bb-4e54-aed7-d613227292df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:55.506368 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:55.551858 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 458/914] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:30:55.574396 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b44d4-55ef-479c-996f-ebc5af789e63 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:55.606295 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:55.685175 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b44d4-55ef-479c-996f-ebc5af789e63 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:55.720747 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc55e23-f149-4193-b538-9af684100ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:55.721775 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc55e23-f149-4193-b538-9af684100ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:55.722278 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc55e23-f149-4193-b538-9af684100ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:55.722747 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc55e23-f149-4193-b538-9af684100ad8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:55.723597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc55e23-f149-4193-b538-9af684100ad8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:55.725535 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc55e23-f149-4193-b538-9af684100ad8 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:55.734770 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-2dc55e23-f149-4193-b538-9af684100ad8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 02:30:55.734770 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:55.734770 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:30:55.734770 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:30:55.734770 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:30:55.734770 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:30:55.734770 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:30:55.734770 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:30:55.734770 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 02:30:55.734770 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:55.734770 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:30:55.734770 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:55.734770 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:55.734770 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:55.734770 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:55.734770 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:55.734770 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:55.735922 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:55.735922 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:55.735922 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:55.735922 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:55.735922 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:55.735922 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:55.735922 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:30:55.735922 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:30:55.735922 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:30:55.735922 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:30:55.735922 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:55.735922 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:55.735922 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:55.735922 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:55.735922 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:55.735922 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:55.737006 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:55.737006 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:55.737006 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:55.737006 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:55.737006 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:55.737006 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:55.737006 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:55.737006 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:55.737006 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:55.737006 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:55.737006 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:30:55.737006 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:30:55.737006 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 02:30:55.737006 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:55.739470 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 457/915] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 5 02:30:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:55.751027 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a38c2d-d2bb-4e54-aed7-d613227292df None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:55.855351 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a38c2d-d2bb-4e54-aed7-d613227292df None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:55.892819 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd612e0d-a277-4986-ae10-a20ae52976a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:55.894011 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd612e0d-a277-4986-ae10-a20ae52976a2 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:55.894292 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd612e0d-a277-4986-ae10-a20ae52976a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:55.894566 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd612e0d-a277-4986-ae10-a20ae52976a2 None admin] PATH_INFO: `/v3/services` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:55.895276 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd612e0d-a277-4986-ae10-a20ae52976a2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:55.895580 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd612e0d-a277-4986-ae10-a20ae52976a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:55.896964 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd612e0d-a277-4986-ae10-a20ae52976a2 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:55.902189 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 459/916] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 5 02:30:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:55.907775 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc55e23-f149-4193-b538-9af684100ad8 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:56.006433 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:56.014219 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc55e23-f149-4193-b538-9af684100ad8 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:56.048562 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7350548-cf35-431c-b55a-aeac76591dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:56.049983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7350548-cf35-431c-b55a-aeac76591dce None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:56.050477 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7350548-cf35-431c-b55a-aeac76591dce None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:56.050936 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7350548-cf35-431c-b55a-aeac76591dce None admin] PATH_INFO: `/v3/services` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:56.051824 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7350548-cf35-431c-b55a-aeac76591dce None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:56.052311 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7350548-cf35-431c-b55a-aeac76591dce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:56.053910 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7350548-cf35-431c-b55a-aeac76591dce None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:56.059420 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 458/917] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 5 02:30:55 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:56.065857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd612e0d-a277-4986-ae10-a20ae52976a2 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:56.091410 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:56.100854 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab133296-bcaa-431a-99e8-e6f94542dc69 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:56.101147 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab133296-bcaa-431a-99e8-e6f94542dc69 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:56.104506 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab133296-bcaa-431a-99e8-e6f94542dc69 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:56.104506 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 459/918] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:30:56.111333 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931924b-db24-45fe-8200-4fedc0788eab None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:56.112200 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931924b-db24-45fe-8200-4fedc0788eab None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:56.112584 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931924b-db24-45fe-8200-4fedc0788eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:56.133536 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-9931924b-db24-45fe-8200-4fedc0788eab None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:56.135066 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-9931924b-db24-45fe-8200-4fedc0788eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:56.184997 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd612e0d-a277-4986-ae10-a20ae52976a2 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:56.205834 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 460/919] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 02:30:56.228695 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb04fd-bbeb-4f97-960f-9370ab5f68ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:56.229641 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb04fd-bbeb-4f97-960f-9370ab5f68ff None admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:56.230131 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb04fd-bbeb-4f97-960f-9370ab5f68ff None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:56.230694 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb04fd-bbeb-4f97-960f-9370ab5f68ff None admin] PATH_INFO: `/v3/endpoints` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:56.231811 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931924b-db24-45fe-8200-4fedc0788eab None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:56.235291 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb04fd-bbeb-4f97-960f-9370ab5f68ff None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:56.239925 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb04fd-bbeb-4f97-960f-9370ab5f68ff None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:56.326164 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 460/920] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:30:56 2022] POST /identity/v3/endpoints => generated 346 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:30:56.339371 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:56.353595 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931924b-db24-45fe-8200-4fedc0788eab None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:56.398660 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df231177-be90-4b14-a237-36edbce31626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:56.399269 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df231177-be90-4b14-a237-36edbce31626 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:56.399590 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df231177-be90-4b14-a237-36edbce31626 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:56.399868 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df231177-be90-4b14-a237-36edbce31626 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:56.418570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df231177-be90-4b14-a237-36edbce31626 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:30:56.424144 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-df231177-be90-4b14-a237-36edbce31626 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 02:30:56.424144 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:56.424144 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:56.424144 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:56.424144 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:56.424144 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:56.424144 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:56.424144 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:56.424144 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:56.424144 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:56.424144 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:56.424144 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:56.424144 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:30:56.424144 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:30:56.424144 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:30:56.424144 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:30:56.425877 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:30:56.425877 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:30:56.425877 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:30:56.425877 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:30:56.425877 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:56.425877 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:56.425877 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:56.425877 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:56.425877 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:56.425877 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:56.425877 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:56.425877 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:56.425877 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:56.425877 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:56.425877 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:56.425877 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:56.427397 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:56.427397 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:56.427397 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:56.427397 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:56.427397 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:30:56.427397 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:30:56.427397 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:30:56.427397 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:30:56.427397 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:30:56.427397 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:30:56.427397 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 02:30:56.427397 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:56.435509 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 461/921] 10.222.0.42 () {56 vars in 1120 bytes} [Fri Aug 5 02:30:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:30:56.437881 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb04fd-bbeb-4f97-960f-9370ab5f68ff None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:56.528350 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:56.549720 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb04fd-bbeb-4f97-960f-9370ab5f68ff None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:56.598783 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4419a1-4b63-4d4c-81ca-6ad4be3f83f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:56.598783 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4419a1-4b63-4d4c-81ca-6ad4be3f83f0 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:56.598783 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4419a1-4b63-4d4c-81ca-6ad4be3f83f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:56.598783 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4419a1-4b63-4d4c-81ca-6ad4be3f83f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:56.599694 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4419a1-4b63-4d4c-81ca-6ad4be3f83f0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:56.599878 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4419a1-4b63-4d4c-81ca-6ad4be3f83f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:56.601273 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4419a1-4b63-4d4c-81ca-6ad4be3f83f0 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:56.610141 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 461/922] 10.222.0.42 () {56 vars in 1115 bytes} [Fri Aug 5 02:30:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:56.616174 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df231177-be90-4b14-a237-36edbce31626 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:56.719989 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df231177-be90-4b14-a237-36edbce31626 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:56.760072 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d02a6b-16cc-4e0d-a7ff-827c8a9c9fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:56.760723 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d02a6b-16cc-4e0d-a7ff-827c8a9c9fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:56.761004 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d02a6b-16cc-4e0d-a7ff-827c8a9c9fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:56.761276 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d02a6b-16cc-4e0d-a7ff-827c8a9c9fb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:56.772054 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc9574-2c84-4085-a158-5da7050aa147 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:56.772681 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc9574-2c84-4085-a158-5da7050aa147 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:56.773158 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc9574-2c84-4085-a158-5da7050aa147 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:56.773263 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d02a6b-16cc-4e0d-a7ff-827c8a9c9fb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:56.774656 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d02a6b-16cc-4e0d-a7ff-827c8a9c9fb1 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:56.775267 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 462/923] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:30:56.779069 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:56.780569 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c264fc-58e8-4091-a7ea-c594257f3dc5 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:56.780863 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c264fc-58e8-4091-a7ea-c594257f3dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:56.782201 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c264fc-58e8-4091-a7ea-c594257f3dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:56.791063 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-21d02a6b-16cc-4e0d-a7ff-827c8a9c9fb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:56.791063 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:56.791063 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:56.791063 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:56.791063 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:56.791063 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:56.791063 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:56.791063 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:56.791063 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:56.791063 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:56.791063 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:56.791063 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:56.791063 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:56.791063 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:56.791063 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:56.797019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:56.797019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:56.797019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:56.797019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:56.797019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:56.797019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:56.797019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:56.797019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:56.797019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:56.797019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:56.797019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:56.797019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:56.797019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:56.797019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:56.797019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:56.797019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:56.797019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:56.797903 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:56.797903 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:56.797903 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:56.797903 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:56.797903 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 462/924] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:30:56.798187 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d02a6b-16cc-4e0d-a7ff-827c8a9c9fb1 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:56.803646 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-98c264fc-58e8-4091-a7ea-c594257f3dc5 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:56.805037 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-98c264fc-58e8-4091-a7ea-c594257f3dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:56.890106 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 463/925] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:30:56.896556 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fef277-6d25-4f7d-b54e-76d73469bf01 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:56.897170 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fef277-6d25-4f7d-b54e-76d73469bf01 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:56.897170 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fef277-6d25-4f7d-b54e-76d73469bf01 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:56.898771 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 464/926] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:30:56.904402 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91e193-b3b8-4931-8f3e-fd06bfc70f51 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:56.904642 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91e193-b3b8-4931-8f3e-fd06bfc70f51 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:56.905091 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91e193-b3b8-4931-8f3e-fd06bfc70f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:56.923755 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d02a6b-16cc-4e0d-a7ff-827c8a9c9fb1 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:56.924406 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-9b91e193-b3b8-4931-8f3e-fd06bfc70f51 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:56.925592 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-9b91e193-b3b8-4931-8f3e-fd06bfc70f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:56.961057 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2cce6-7a34-466a-940d-52b2d02d2b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:56.961685 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2cce6-7a34-466a-940d-52b2d02d2b3d None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:56.961974 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2cce6-7a34-466a-940d-52b2d02d2b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:56.962249 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2cce6-7a34-466a-940d-52b2d02d2b3d None admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:56.962942 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2cce6-7a34-466a-940d-52b2d02d2b3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:56.963271 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2cce6-7a34-466a-940d-52b2d02d2b3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:56.964648 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2cce6-7a34-466a-940d-52b2d02d2b3d None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:56.982987 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 463/927] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:30:56.983845 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2cce6-7a34-466a-940d-52b2d02d2b3d None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:57.016166 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 465/928] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:30:57.017087 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91e193-b3b8-4931-8f3e-fd06bfc70f51 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:57.020573 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:57.058648 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:57.104424 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2cce6-7a34-466a-940d-52b2d02d2b3d None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:57.134639 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91e193-b3b8-4931-8f3e-fd06bfc70f51 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:57.140588 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f398f390-572c-4fa4-8dde-b8a2f4f1ab60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:57.141240 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398f390-572c-4fa4-8dde-b8a2f4f1ab60 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:57.141525 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398f390-572c-4fa4-8dde-b8a2f4f1ab60 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:57.141805 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398f390-572c-4fa4-8dde-b8a2f4f1ab60 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:57.142904 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f398f390-572c-4fa4-8dde-b8a2f4f1ab60 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:57.145167 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f398f390-572c-4fa4-8dde-b8a2f4f1ab60 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:57.155095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-f398f390-572c-4fa4-8dde-b8a2f4f1ab60 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 02:30:57.155095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:57.155095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:30:57.155095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:30:57.155095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:30:57.155095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:30:57.155095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:30:57.155095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:30:57.155095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 02:30:57.155095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:57.155095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:30:57.155095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:57.155095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:57.155095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:57.155095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:57.155095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:57.156002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:57.156002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:57.156002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:57.156002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:57.156002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:57.156002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:57.156002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:57.156002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:30:57.156002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:30:57.156002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:30:57.156002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:30:57.156002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:57.156002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:57.156002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:57.156002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:57.156002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:57.156831 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:57.156831 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:57.156831 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:57.156831 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:57.156831 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:57.156831 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:57.156831 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:57.156831 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:57.156831 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:57.156831 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:57.156831 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:57.156831 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:30:57.156831 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:30:57.156831 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 02:30:57.156831 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:57.161567 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 464/929] 10.222.0.42 () {56 vars in 1132 bytes} [Fri Aug 5 02:30:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:57.162431 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f398f390-572c-4fa4-8dde-b8a2f4f1ab60 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:57.172255 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb560d0-82a7-40f7-847f-18db0c38f99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:57.173155 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb560d0-82a7-40f7-847f-18db0c38f99f None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:57.173623 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb560d0-82a7-40f7-847f-18db0c38f99f None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:57.174442 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb560d0-82a7-40f7-847f-18db0c38f99f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:57.181587 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb560d0-82a7-40f7-847f-18db0c38f99f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:57.183084 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb560d0-82a7-40f7-847f-18db0c38f99f None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:57.195667 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-0bb560d0-82a7-40f7-847f-18db0c38f99f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 02:30:57.195667 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:57.195667 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:57.195667 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:57.195667 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:57.195667 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:57.195667 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:57.195667 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:57.195667 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:57.195667 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:57.195667 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:57.195667 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:57.195667 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:30:57.195667 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:30:57.195667 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:30:57.195667 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:30:57.196611 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:57.196611 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:57.196611 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:30:57.196611 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:57.196611 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:30:57.196611 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:30:57.196611 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:57.196611 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:57.196611 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:57.196611 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:57.196611 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:57.196611 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:57.196611 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:57.196611 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:57.196611 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:57.196611 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:57.196611 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:57.196611 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:57.197528 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:57.197528 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:57.197528 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:30:57.197528 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:30:57.197528 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:30:57.197528 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:30:57.197528 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:30:57.197528 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:30:57.197528 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 02:30:57.197528 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:57.197528 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 466/930] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Aug 5 02:30:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:57.198112 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb560d0-82a7-40f7-847f-18db0c38f99f None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:57.275578 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f398f390-572c-4fa4-8dde-b8a2f4f1ab60 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:57.277724 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:57.299980 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:57.316196 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942c0d5-5498-42bd-881d-741ba88bc54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:57.316964 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942c0d5-5498-42bd-881d-741ba88bc54e None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:57.317123 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942c0d5-5498-42bd-881d-741ba88bc54e None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:57.317396 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942c0d5-5498-42bd-881d-741ba88bc54e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:57.318031 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942c0d5-5498-42bd-881d-741ba88bc54e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:57.319451 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942c0d5-5498-42bd-881d-741ba88bc54e None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:57.320165 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb560d0-82a7-40f7-847f-18db0c38f99f None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:57.328316 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-7942c0d5-5498-42bd-881d-741ba88bc54e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 02:30:57.328316 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:57.328316 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:30:57.328316 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:30:57.328316 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:30:57.328316 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:30:57.328316 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:30:57.328316 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:30:57.328316 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 02:30:57.328316 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:57.328316 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:30:57.328316 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:57.328316 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:57.328316 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:57.328316 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:57.328316 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:57.328316 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:57.329282 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:57.329282 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:57.329282 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:57.329282 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:57.329282 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:57.329282 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:57.329282 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:30:57.329282 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:30:57.329282 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:30:57.329282 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:30:57.329282 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:57.329282 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:57.329282 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:57.329282 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:57.329282 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:57.329282 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:57.330112 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:57.330112 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:57.330112 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:57.330112 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:57.330112 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:57.330112 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:57.330112 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:57.330112 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:57.330112 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:57.330112 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:57.330112 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:30:57.330112 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:30:57.330112 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 02:30:57.330112 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:57.330112 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 465/931] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Aug 5 02:30:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:57.331672 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942c0d5-5498-42bd-881d-741ba88bc54e None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:57.363512 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f9bd8-bfd5-444d-b737-65ed4052dd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:57.364380 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f9bd8-bfd5-444d-b737-65ed4052dd8a None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:57.364813 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f9bd8-bfd5-444d-b737-65ed4052dd8a None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:57.365085 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f9bd8-bfd5-444d-b737-65ed4052dd8a None admin] PATH_INFO: `/v3/services` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:57.365753 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f9bd8-bfd5-444d-b737-65ed4052dd8a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:57.366055 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f9bd8-bfd5-444d-b737-65ed4052dd8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:57.367464 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f9bd8-bfd5-444d-b737-65ed4052dd8a None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:57.375072 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 467/932] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Aug 5 02:30:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:57.375072 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f9bd8-bfd5-444d-b737-65ed4052dd8a None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:57.443046 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942c0d5-5498-42bd-881d-741ba88bc54e None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:57.479528 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb865fd-a409-4669-959d-1b8a38740d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:57.480152 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb865fd-a409-4669-959d-1b8a38740d38 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:57.480431 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb865fd-a409-4669-959d-1b8a38740d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:57.480699 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb865fd-a409-4669-959d-1b8a38740d38 None admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:57.481488 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb865fd-a409-4669-959d-1b8a38740d38 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:57.481794 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb865fd-a409-4669-959d-1b8a38740d38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:57.483214 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f9bd8-bfd5-444d-b737-65ed4052dd8a None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:57.483325 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb865fd-a409-4669-959d-1b8a38740d38 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:57.503700 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 466/933] 10.222.0.42 () {56 vars in 1149 bytes} [Fri Aug 5 02:30:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:57.508891 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb865fd-a409-4669-959d-1b8a38740d38 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:57.511739 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:57.520366 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86358e8-866f-40ea-8d1b-983cbfd3d1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:57.520994 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86358e8-866f-40ea-8d1b-983cbfd3d1a3 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:57.521276 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86358e8-866f-40ea-8d1b-983cbfd3d1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:57.521613 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86358e8-866f-40ea-8d1b-983cbfd3d1a3 None admin] PATH_INFO: `/v3/services` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:57.522271 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86358e8-866f-40ea-8d1b-983cbfd3d1a3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:57.522577 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86358e8-866f-40ea-8d1b-983cbfd3d1a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:57.528103 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86358e8-866f-40ea-8d1b-983cbfd3d1a3 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:57.528716 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 468/934] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Aug 5 02:30:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:57.529505 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86358e8-866f-40ea-8d1b-983cbfd3d1a3 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:57.559649 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:57.619871 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb865fd-a409-4669-959d-1b8a38740d38 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:57.642510 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86358e8-866f-40ea-8d1b-983cbfd3d1a3 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:57.653582 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540d610-34df-4af5-9f61-43ff98c5c802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:57.654223 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540d610-34df-4af5-9f61-43ff98c5c802 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:57.654504 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540d610-34df-4af5-9f61-43ff98c5c802 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:57.654775 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540d610-34df-4af5-9f61-43ff98c5c802 None admin] PATH_INFO: `/v3/services` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:57.655470 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540d610-34df-4af5-9f61-43ff98c5c802 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:57.655767 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540d610-34df-4af5-9f61-43ff98c5c802 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:57.657132 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540d610-34df-4af5-9f61-43ff98c5c802 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:57.666370 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 467/935] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Aug 5 02:30:57 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:57.666370 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540d610-34df-4af5-9f61-43ff98c5c802 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:57.682295 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d7486-ac56-44e5-ad61-41796ed2e737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:57.682940 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d7486-ac56-44e5-ad61-41796ed2e737 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:57.683258 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d7486-ac56-44e5-ad61-41796ed2e737 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:57.683537 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d7486-ac56-44e5-ad61-41796ed2e737 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:57.695764 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d7486-ac56-44e5-ad61-41796ed2e737 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:57.697336 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d7486-ac56-44e5-ad61-41796ed2e737 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:57.711434 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-c24d7486-ac56-44e5-ad61-41796ed2e737 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:57.711434 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:57.711434 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:57.711434 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:57.711434 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:57.711434 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:57.711434 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:57.711434 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:57.711434 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:57.711434 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:57.711434 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:57.711434 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:57.711434 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:30:57.711434 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:30:57.711434 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:30:57.712395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:30:57.712395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:57.712395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:57.712395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:57.712395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:57.712395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:57.712395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:57.712395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:57.712395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:57.712395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:57.712395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:57.712395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:57.712395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:57.712395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:57.712395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:57.712395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:57.712395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:57.713329 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:30:57.713329 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:30:57.713329 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:30:57.713329 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:57.713329 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 469/936] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:30:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:57.713329 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d7486-ac56-44e5-ad61-41796ed2e737 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:57.756829 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:57.773650 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540d610-34df-4af5-9f61-43ff98c5c802 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:57.780889 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:57.810566 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f4b42b-77c4-4e4f-89d7-854169a30e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:57.811478 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4b42b-77c4-4e4f-89d7-854169a30e01 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:57.811757 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4b42b-77c4-4e4f-89d7-854169a30e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:57.812039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4b42b-77c4-4e4f-89d7-854169a30e01 None admin] PATH_INFO: `/v3/services` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:57.812729 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f4b42b-77c4-4e4f-89d7-854169a30e01 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:57.813033 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f4b42b-77c4-4e4f-89d7-854169a30e01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:57.814538 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f4b42b-77c4-4e4f-89d7-854169a30e01 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:57.819424 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d7486-ac56-44e5-ad61-41796ed2e737 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:57.819542 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 468/937] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Aug 5 02:30:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:57.820243 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f4b42b-77c4-4e4f-89d7-854169a30e01 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:57.861423 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24edca0-103a-41bd-93dc-1c0ff46b67bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:57.863054 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24edca0-103a-41bd-93dc-1c0ff46b67bd None admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:57.863564 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24edca0-103a-41bd-93dc-1c0ff46b67bd None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:57.864029 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24edca0-103a-41bd-93dc-1c0ff46b67bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:57.865032 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24edca0-103a-41bd-93dc-1c0ff46b67bd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:57.866625 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24edca0-103a-41bd-93dc-1c0ff46b67bd None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:57.919511 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f4b42b-77c4-4e4f-89d7-854169a30e01 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:57.927792 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 470/938] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:30:57 2022] POST /identity/v3/endpoints => generated 347 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:30:57.928682 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24edca0-103a-41bd-93dc-1c0ff46b67bd None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:57.984077 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf3242-1002-4377-953f-af0b9fec0367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:57.984725 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf3242-1002-4377-953f-af0b9fec0367 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:57.985054 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf3242-1002-4377-953f-af0b9fec0367 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:57.985337 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf3242-1002-4377-953f-af0b9fec0367 None admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:57.986109 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bf3242-1002-4377-953f-af0b9fec0367 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:57.986418 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bf3242-1002-4377-953f-af0b9fec0367 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:57.988596 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bf3242-1002-4377-953f-af0b9fec0367 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:58.006730 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 469/939] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:30:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:58.007928 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf3242-1002-4377-953f-af0b9fec0367 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:58.047031 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:58.057007 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:58.066318 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24edca0-103a-41bd-93dc-1c0ff46b67bd None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:58.110485 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f8383-379d-400c-8099-f35fbce2384f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:58.111267 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f8383-379d-400c-8099-f35fbce2384f None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:58.111602 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f8383-379d-400c-8099-f35fbce2384f None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:58.112392 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f8383-379d-400c-8099-f35fbce2384f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:58.113157 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f8383-379d-400c-8099-f35fbce2384f None admin] RBAC: Adding query filter params (interface=public, service_id=e0281380c6dd474dbb00f5ed52997ba7, region_id=RegionOne) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:58.113469 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f8383-379d-400c-8099-f35fbce2384f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:58.118230 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f8383-379d-400c-8099-f35fbce2384f None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:58.122290 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 471/940] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Aug 5 02:30:57 2022] GET /identity/v3/endpoints?service_id=e0281380c6dd474dbb00f5ed52997ba7&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:58.128305 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f8383-379d-400c-8099-f35fbce2384f None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:58.147755 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf3242-1002-4377-953f-af0b9fec0367 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:58.189944 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a582eaa-c475-4b44-9dc7-37ea7ff0c295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:58.191149 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a582eaa-c475-4b44-9dc7-37ea7ff0c295 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:58.191440 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a582eaa-c475-4b44-9dc7-37ea7ff0c295 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:58.192042 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a582eaa-c475-4b44-9dc7-37ea7ff0c295 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:58.201483 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a582eaa-c475-4b44-9dc7-37ea7ff0c295 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:58.203680 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a582eaa-c475-4b44-9dc7-37ea7ff0c295 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:58.220265 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-3a582eaa-c475-4b44-9dc7-37ea7ff0c295 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:58.220265 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:58.220265 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:58.220265 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:58.220265 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:58.220265 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:58.220265 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:58.220265 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:58.220265 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:58.220265 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:58.220265 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:58.220265 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:58.220265 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:30:58.220265 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:30:58.220265 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:30:58.221765 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:30:58.221765 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:58.221765 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:58.221765 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:58.221765 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:58.221765 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:58.221765 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:58.221765 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:58.221765 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:58.221765 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:58.221765 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:58.221765 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:58.221765 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:58.221765 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:58.221765 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:58.221765 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:58.221765 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:58.222659 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:30:58.222659 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:30:58.222659 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:30:58.222659 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:30:58.222659 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:30:58.222659 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:30:58.222659 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:58.222659 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:58.222659 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 470/941] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:30:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:58.230557 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a582eaa-c475-4b44-9dc7-37ea7ff0c295 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:58.251646 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f8383-379d-400c-8099-f35fbce2384f None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:58.292140 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44356c98-d3ab-40b4-8a28-f934df206ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:58.292802 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44356c98-d3ab-40b4-8a28-f934df206ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:58.293043 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44356c98-d3ab-40b4-8a28-f934df206ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:58.293335 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44356c98-d3ab-40b4-8a28-f934df206ab0 None admin] PATH_INFO: `/v3/services` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:58.293961 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44356c98-d3ab-40b4-8a28-f934df206ab0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:58.296522 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44356c98-d3ab-40b4-8a28-f934df206ab0 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:58.303359 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 472/942] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Aug 5 02:30:58 2022] GET /identity/v3/services => generated 1497 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:30:58.347506 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:58.366649 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a582eaa-c475-4b44-9dc7-37ea7ff0c295 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:58.409990 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48749e38-2c8d-42ea-8069-4f38604cb6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:58.410623 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48749e38-2c8d-42ea-8069-4f38604cb6af None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:58.410909 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48749e38-2c8d-42ea-8069-4f38604cb6af None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:58.411239 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48749e38-2c8d-42ea-8069-4f38604cb6af None admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:58.412004 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48749e38-2c8d-42ea-8069-4f38604cb6af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:58.412314 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48749e38-2c8d-42ea-8069-4f38604cb6af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:58.413779 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48749e38-2c8d-42ea-8069-4f38604cb6af None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:58.428486 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 471/943] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 5 02:30:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:30:58.434098 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44356c98-d3ab-40b4-8a28-f934df206ab0 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:58.457105 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ebc50-f1e1-4216-bd02-6363e67a1df9 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:58.457422 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ebc50-f1e1-4216-bd02-6363e67a1df9 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:58.457665 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ebc50-f1e1-4216-bd02-6363e67a1df9 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:58.459187 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 472/944] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:30:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:30:58.464805 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2169848-b7fe-4570-b43d-b519550bd8c2 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:58.464805 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2169848-b7fe-4570-b43d-b519550bd8c2 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:58.464805 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2169848-b7fe-4570-b43d-b519550bd8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:58.467560 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:58.486718 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-d2169848-b7fe-4570-b43d-b519550bd8c2 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:58.488268 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-d2169848-b7fe-4570-b43d-b519550bd8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:58.561547 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44356c98-d3ab-40b4-8a28-f934df206ab0 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:58.578981 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 473/945] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:30:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 02:30:58.603397 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2169848-b7fe-4570-b43d-b519550bd8c2 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:58.606484 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed12a1f-3d01-4928-b605-f8b0006cb5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:58.607484 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed12a1f-3d01-4928-b605-f8b0006cb5e0 None admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:58.608026 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed12a1f-3d01-4928-b605-f8b0006cb5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:58.608504 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed12a1f-3d01-4928-b605-f8b0006cb5e0 None admin] PATH_INFO: `/v3/projects/63b323c02a614fc28aac6e7a060064ba/users/6bea520676244effbbe212aa62b1cc68/roles/c14dbbd7897245a18070be9be19c278b` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:58.611086 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed12a1f-3d01-4928-b605-f8b0006cb5e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=63b323c02a614fc28aac6e7a060064ba, user_id=6bea520676244effbbe212aa62b1cc68, role_id=c14dbbd7897245a18070be9be19c278b)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:58.612769 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed12a1f-3d01-4928-b605-f8b0006cb5e0 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:58.685883 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:58.687039 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 473/946] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 5 02:30:58 2022] PUT /identity/v3/projects/63b323c02a614fc28aac6e7a060064ba/users/6bea520676244effbbe212aa62b1cc68/roles/c14dbbd7897245a18070be9be19c278b => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:30:58.719171 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2169848-b7fe-4570-b43d-b519550bd8c2 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:58.760174 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef923f6b-0cb4-4d07-bb21-813db8aeac53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:58.760878 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef923f6b-0cb4-4d07-bb21-813db8aeac53 None admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:58.761171 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef923f6b-0cb4-4d07-bb21-813db8aeac53 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:58.761458 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef923f6b-0cb4-4d07-bb21-813db8aeac53 None admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:58.762169 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef923f6b-0cb4-4d07-bb21-813db8aeac53 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:58.763736 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef923f6b-0cb4-4d07-bb21-813db8aeac53 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:58.766620 dv-cinder-815582-13-smb devstack@keystone.service[80822]: WARNING keystone.server.flask.common [None req-ef923f6b-0cb4-4d07-bb21-813db8aeac53 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 05 02:30:58.812718 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.sql.core [None req-ef923f6b-0cb4-4d07-bb21-813db8aeac53 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 05 02:30:58.812718 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 05 02:30:58.812718 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [parameters: {'id': 'b115fddcb85a4501866d55edfb492079', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 05 02:30:58.812718 dv-cinder-815582-13-smb devstack@keystone.service[80822]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80822) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 05 02:30:58.822774 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-ef923f6b-0cb4-4d07-bb21-813db8aeac53 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b115fddcb85a4501866d55edfb492079.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b115fddcb85a4501866d55edfb492079. Aug 05 02:30:58.822774 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:58.822774 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 05 02:30:58.822774 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 05 02:30:58.822774 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 05 02:30:58.822774 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 05 02:30:58.822774 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 05 02:30:58.822774 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application result = self._query(query) Aug 05 02:30:58.822774 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 05 02:30:58.822774 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application conn.query(q) Aug 05 02:30:58.822774 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 05 02:30:58.822774 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 05 02:30:58.822774 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 05 02:30:58.823711 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application result.read() Aug 05 02:30:58.823711 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 05 02:30:58.823711 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 05 02:30:58.823711 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 05 02:30:58.823711 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 05 02:30:58.823711 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 05 02:30:58.823711 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 05 02:30:58.823711 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 05 02:30:58.823711 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 05 02:30:58.823711 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 05 02:30:58.823711 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:58.823711 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 05 02:30:58.823711 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:58.823711 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:58.823711 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 05 02:30:58.823711 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 05 02:30:58.823711 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 05 02:30:58.823711 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 05 02:30:58.824656 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 05 02:30:58.824656 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application next(self.gen) Aug 05 02:30:58.824656 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 05 02:30:58.824656 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application yield resource Aug 05 02:30:58.824656 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 05 02:30:58.824656 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application next(self.gen) Aug 05 02:30:58.824656 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 05 02:30:58.824656 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self.session.rollback() Aug 05 02:30:58.824656 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 05 02:30:58.824656 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self.force_reraise() Aug 05 02:30:58.824656 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 05 02:30:58.824656 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise self.value Aug 05 02:30:58.824656 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 05 02:30:58.824656 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 05 02:30:58.824656 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 05 02:30:58.824656 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application session.commit() Aug 05 02:30:58.824656 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 05 02:30:58.825553 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 05 02:30:58.825553 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 05 02:30:58.825553 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self._prepare_impl() Aug 05 02:30:58.825553 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 05 02:30:58.825553 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self.session.flush() Aug 05 02:30:58.825553 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 05 02:30:58.825553 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self._flush(objects) Aug 05 02:30:58.825553 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 05 02:30:58.825553 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 05 02:30:58.825553 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 05 02:30:58.825553 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application compat.raise_( Aug 05 02:30:58.825553 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 05 02:30:58.825553 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception Aug 05 02:30:58.825553 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 05 02:30:58.825553 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application flush_context.execute() Aug 05 02:30:58.825553 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 05 02:30:58.825553 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rec.execute(self) Aug 05 02:30:58.826908 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 05 02:30:58.826908 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 05 02:30:58.826908 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 05 02:30:58.826908 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 05 02:30:58.826908 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 05 02:30:58.826908 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 05 02:30:58.826908 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 05 02:30:58.826908 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 05 02:30:58.826908 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 05 02:30:58.826908 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 05 02:30:58.826908 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 05 02:30:58.826908 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 05 02:30:58.826908 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 05 02:30:58.826908 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 05 02:30:58.826908 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 05 02:30:58.827888 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 05 02:30:58.827888 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 05 02:30:58.827888 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception Aug 05 02:30:58.827888 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 05 02:30:58.827888 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 05 02:30:58.827888 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 05 02:30:58.827888 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 05 02:30:58.827888 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 05 02:30:58.827888 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application result = self._query(query) Aug 05 02:30:58.827888 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 05 02:30:58.827888 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application conn.query(q) Aug 05 02:30:58.827888 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 05 02:30:58.827888 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 05 02:30:58.827888 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 05 02:30:58.827888 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application result.read() Aug 05 02:30:58.827888 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 05 02:30:58.827888 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 05 02:30:58.828795 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 05 02:30:58.828795 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 05 02:30:58.828795 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 05 02:30:58.828795 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 05 02:30:58.828795 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 05 02:30:58.828795 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 05 02:30:58.828795 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 05 02:30:58.828795 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 05 02:30:58.828795 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [parameters: {'id': 'b115fddcb85a4501866d55edfb492079', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 05 02:30:58.828795 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 05 02:30:58.828795 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:58.828795 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:30:58.828795 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:58.828795 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:58.828795 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 05 02:30:58.829625 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 05 02:30:58.829625 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 05 02:30:58.829625 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 05 02:30:58.829625 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 05 02:30:58.829625 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:58.829625 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:30:58.829625 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:58.829625 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:58.829625 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:58.829625 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:58.829625 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:58.829625 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:58.829625 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:58.829625 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:58.829625 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:58.829625 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:58.829625 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:58.832990 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:58.832990 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 05 02:30:58.832990 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 05 02:30:58.832990 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:58.832990 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:58.832990 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 05 02:30:58.832990 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 05 02:30:58.832990 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b115fddcb85a4501866d55edfb492079. Aug 05 02:30:58.832990 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:30:58.832990 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 474/947] 10.222.0.42 () {60 vars in 1140 bytes} [Fri Aug 5 02:30:58 2022] POST /identity/v3/projects => generated 262 bytes in 223 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:30:58.835646 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed12a1f-3d01-4928-b605-f8b0006cb5e0 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:58.943077 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:58.957714 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed12a1f-3d01-4928-b605-f8b0006cb5e0 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:58.992360 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ccf10e-b402-43b1-8158-8f70e4b6929d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:58.993007 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ccf10e-b402-43b1-8158-8f70e4b6929d None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:58.993290 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ccf10e-b402-43b1-8158-8f70e4b6929d None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:58.993564 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ccf10e-b402-43b1-8158-8f70e4b6929d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:59.000474 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ccf10e-b402-43b1-8158-8f70e4b6929d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:59.001991 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ccf10e-b402-43b1-8158-8f70e4b6929d None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:59.015234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-f0ccf10e-b402-43b1-8158-8f70e4b6929d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:59.015234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:30:59.015234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:30:59.015234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:30:59.015234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:30:59.015234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:30:59.015234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:30:59.015234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:30:59.015234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:30:59.015234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:30:59.015234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:30:59.015234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:30:59.015234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:30:59.015234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:30:59.015234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:30:59.016252 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:30:59.016252 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:30:59.016252 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:30:59.016252 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:30:59.016252 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:30:59.016252 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:30:59.016252 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:30:59.016252 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:30:59.016252 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:30:59.016252 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:30:59.016252 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:30:59.016252 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:30:59.016252 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:30:59.016252 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:30:59.016252 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:30:59.016252 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:30:59.016252 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:30:59.017445 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:30:59.017445 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:30:59.017445 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:30:59.017445 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:30:59.017445 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:30:59.017445 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:30:59.017445 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:30:59.017445 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:30:59.017445 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 474/948] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:30:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:30:59.026091 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef923f6b-0cb4-4d07-bb21-813db8aeac53 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:59.136338 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef923f6b-0cb4-4d07-bb21-813db8aeac53 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:59.167605 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:59.172857 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a01ffe-255a-4917-b93f-e5de18150de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:59.179142 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a01ffe-255a-4917-b93f-e5de18150de3 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:59.179142 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a01ffe-255a-4917-b93f-e5de18150de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:59.179142 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a01ffe-255a-4917-b93f-e5de18150de3 None admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:59.179142 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a01ffe-255a-4917-b93f-e5de18150de3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:59.179142 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a01ffe-255a-4917-b93f-e5de18150de3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:59.179142 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a01ffe-255a-4917-b93f-e5de18150de3 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:59.199015 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 475/949] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Aug 5 02:30:59 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:00.091652 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c70d6-6b36-4d35-b389-6f15ab5d4251 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:00.092704 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c70d6-6b36-4d35-b389-6f15ab5d4251 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:00.093218 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c70d6-6b36-4d35-b389-6f15ab5d4251 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:00.095099 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 475/950] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:31:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:31:00.100916 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00651d5-5f3b-4784-b54b-7abc6dcde4b6 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:00.101721 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00651d5-5f3b-4784-b54b-7abc6dcde4b6 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:00.102236 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00651d5-5f3b-4784-b54b-7abc6dcde4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:00.121353 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-b00651d5-5f3b-4784-b54b-7abc6dcde4b6 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:00.123236 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-b00651d5-5f3b-4784-b54b-7abc6dcde4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:00.195306 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 476/951] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:31:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:31:00.217528 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c70d6-6b36-4d35-b389-6f15ab5d4251 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:00.326894 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c70d6-6b36-4d35-b389-6f15ab5d4251 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:00.363358 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967cbc7-9708-43db-8b47-1df2cd6f9269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:00.363936 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967cbc7-9708-43db-8b47-1df2cd6f9269 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:00.364218 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967cbc7-9708-43db-8b47-1df2cd6f9269 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:00.364491 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967cbc7-9708-43db-8b47-1df2cd6f9269 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:00.365139 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7967cbc7-9708-43db-8b47-1df2cd6f9269 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:00.366582 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7967cbc7-9708-43db-8b47-1df2cd6f9269 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:00.376695 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-7967cbc7-9708-43db-8b47-1df2cd6f9269 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 02:31:00.376695 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:00.376695 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:31:00.376695 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:31:00.376695 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:31:00.376695 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:31:00.376695 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:31:00.376695 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:31:00.376695 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 02:31:00.376695 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:31:00.376695 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:31:00.376695 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:31:00.376695 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:00.376695 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:31:00.376695 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:31:00.376695 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:31:00.376695 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:31:00.378473 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:31:00.378473 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:31:00.378473 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:31:00.378473 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:31:00.378473 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:31:00.378473 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:31:00.378473 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:31:00.378473 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:31:00.378473 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:31:00.378473 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:31:00.378473 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:31:00.378473 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:31:00.378473 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:31:00.378473 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:31:00.378473 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:31:00.378473 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:31:00.379908 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:31:00.379908 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:31:00.379908 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:31:00.379908 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:31:00.379908 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:31:00.379908 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:31:00.379908 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:31:00.379908 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:31:00.379908 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:31:00.379908 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:31:00.379908 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:31:00.379908 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:31:00.379908 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 02:31:00.379908 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:31:00.379908 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 476/952] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:31:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:31:00.387223 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00651d5-5f3b-4784-b54b-7abc6dcde4b6 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:00.463068 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7e1ca-1b47-44d7-a2ac-b6bd75269869 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:00.463419 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7e1ca-1b47-44d7-a2ac-b6bd75269869 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:00.463635 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7e1ca-1b47-44d7-a2ac-b6bd75269869 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:00.465233 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 477/953] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:31:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:31:00.471028 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a52bb9-1181-4737-b21a-e6ec9c2dd889 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:00.471323 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a52bb9-1181-4737-b21a-e6ec9c2dd889 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:00.471914 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a52bb9-1181-4737-b21a-e6ec9c2dd889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:00.494865 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00651d5-5f3b-4784-b54b-7abc6dcde4b6 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:00.495101 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-a5a52bb9-1181-4737-b21a-e6ec9c2dd889 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:00.496272 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-a5a52bb9-1181-4737-b21a-e6ec9c2dd889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:00.500222 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:00.525786 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:00.541503 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee360ea-799c-4b0b-be0e-2a1b46371bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:00.542141 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee360ea-799c-4b0b-be0e-2a1b46371bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:00.542426 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee360ea-799c-4b0b-be0e-2a1b46371bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:00.542698 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee360ea-799c-4b0b-be0e-2a1b46371bf2 None admin] PATH_INFO: `/v3/services` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:00.543416 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee360ea-799c-4b0b-be0e-2a1b46371bf2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:00.543715 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee360ea-799c-4b0b-be0e-2a1b46371bf2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:00.546106 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee360ea-799c-4b0b-be0e-2a1b46371bf2 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:00.556787 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 477/954] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Aug 5 02:31:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:00.559305 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee360ea-799c-4b0b-be0e-2a1b46371bf2 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:00.592300 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 478/955] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:31:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 02:31:00.615771 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a52bb9-1181-4737-b21a-e6ec9c2dd889 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:00.697021 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee360ea-799c-4b0b-be0e-2a1b46371bf2 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:00.723637 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a52bb9-1181-4737-b21a-e6ec9c2dd889 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:00.742832 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d1cf02-2156-4972-be21-16f4bdb2011f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:00.743504 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1cf02-2156-4972-be21-16f4bdb2011f None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:00.743791 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1cf02-2156-4972-be21-16f4bdb2011f None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:00.744069 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1cf02-2156-4972-be21-16f4bdb2011f None admin] PATH_INFO: `/v3/services` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:00.744756 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d1cf02-2156-4972-be21-16f4bdb2011f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:00.745062 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d1cf02-2156-4972-be21-16f4bdb2011f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:00.746441 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d1cf02-2156-4972-be21-16f4bdb2011f None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:00.754997 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 478/956] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Aug 5 02:31:00 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:00.773217 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857e8c3-c184-4a76-a9f2-bb5215ec4c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:00.773880 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857e8c3-c184-4a76-a9f2-bb5215ec4c7a None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:00.774161 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857e8c3-c184-4a76-a9f2-bb5215ec4c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:00.774502 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857e8c3-c184-4a76-a9f2-bb5215ec4c7a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:00.775183 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857e8c3-c184-4a76-a9f2-bb5215ec4c7a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:00.776664 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857e8c3-c184-4a76-a9f2-bb5215ec4c7a None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:00.787565 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-b857e8c3-c184-4a76-a9f2-bb5215ec4c7a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 02:31:00.787565 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:00.787565 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:31:00.787565 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:31:00.787565 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:31:00.787565 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:31:00.787565 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:31:00.787565 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:31:00.787565 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 02:31:00.787565 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:31:00.787565 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:31:00.787565 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:31:00.787565 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:00.787565 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:31:00.787565 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:31:00.787565 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:31:00.787565 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:31:00.788692 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:31:00.788692 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:31:00.788692 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:31:00.788692 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:31:00.788692 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:31:00.788692 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:31:00.788692 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:31:00.788692 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:31:00.788692 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:31:00.788692 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:31:00.788692 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:31:00.788692 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:31:00.788692 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:31:00.788692 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:31:00.788692 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:31:00.788692 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:31:00.790021 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:31:00.790021 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:31:00.790021 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:31:00.790021 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:31:00.790021 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:31:00.790021 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:31:00.790021 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:31:00.790021 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:31:00.790021 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:31:00.790021 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:31:00.790021 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:31:00.790021 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:31:00.790021 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 02:31:00.790021 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:31:00.790021 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 479/957] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Aug 5 02:31:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:31:00.795518 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d1cf02-2156-4972-be21-16f4bdb2011f None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:00.810016 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b15f1-0787-45c5-a356-db239e4e4aac None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:00.810256 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b15f1-0787-45c5-a356-db239e4e4aac None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:00.810505 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b15f1-0787-45c5-a356-db239e4e4aac None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:00.812234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 480/958] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:31:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:31:00.818378 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3433c5a-7318-4522-8f9c-8d5e3d49a288 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:00.818735 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3433c5a-7318-4522-8f9c-8d5e3d49a288 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:00.818925 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3433c5a-7318-4522-8f9c-8d5e3d49a288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:00.833430 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:00.839772 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-b3433c5a-7318-4522-8f9c-8d5e3d49a288 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:00.842260 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-b3433c5a-7318-4522-8f9c-8d5e3d49a288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:00.860126 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:00.924137 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d1cf02-2156-4972-be21-16f4bdb2011f None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:00.947795 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 481/959] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:31:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 02:31:00.966845 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cddda4-d2ea-42b4-ba69-f373274e2072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:00.967496 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cddda4-d2ea-42b4-ba69-f373274e2072 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:00.967778 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cddda4-d2ea-42b4-ba69-f373274e2072 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:00.968052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cddda4-d2ea-42b4-ba69-f373274e2072 None admin] PATH_INFO: `/v3/services` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:00.968732 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cddda4-d2ea-42b4-ba69-f373274e2072 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:00.969035 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cddda4-d2ea-42b4-ba69-f373274e2072 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:00.970403 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cddda4-d2ea-42b4-ba69-f373274e2072 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:00.973644 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3433c5a-7318-4522-8f9c-8d5e3d49a288 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:00.979503 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 479/960] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Aug 5 02:31:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:00.986593 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cddda4-d2ea-42b4-ba69-f373274e2072 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:01.087583 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3433c5a-7318-4522-8f9c-8d5e3d49a288 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:01.094646 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cddda4-d2ea-42b4-ba69-f373274e2072 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:01.109132 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:01.125014 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a9d1f-bb59-469f-a164-ac1463dfbe98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:01.126678 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a9d1f-bb59-469f-a164-ac1463dfbe98 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:01.127720 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a9d1f-bb59-469f-a164-ac1463dfbe98 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:01.128244 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a9d1f-bb59-469f-a164-ac1463dfbe98 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:01.130420 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a55b0a2-0776-4c4f-8451-e88cfa86865d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:01.130850 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:01.131056 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55b0a2-0776-4c4f-8451-e88cfa86865d None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:01.131334 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55b0a2-0776-4c4f-8451-e88cfa86865d None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:01.131603 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55b0a2-0776-4c4f-8451-e88cfa86865d None admin] PATH_INFO: `/v3/services` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:01.132287 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a55b0a2-0776-4c4f-8451-e88cfa86865d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:01.132816 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a55b0a2-0776-4c4f-8451-e88cfa86865d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:01.133942 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a55b0a2-0776-4c4f-8451-e88cfa86865d None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:01.142088 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a9d1f-bb59-469f-a164-ac1463dfbe98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:31:01.143514 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 480/961] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Aug 5 02:31:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:31:01.145431 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a55b0a2-0776-4c4f-8451-e88cfa86865d None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:01.151189 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-f23a9d1f-bb59-469f-a164-ac1463dfbe98 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 02:31:01.151189 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:01.151189 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:31:01.151189 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:31:01.151189 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:31:01.151189 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:31:01.151189 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:31:01.151189 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:31:01.151189 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:31:01.151189 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:31:01.151189 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:31:01.151189 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:31:01.151189 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:31:01.151189 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:31:01.151189 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:31:01.151189 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:31:01.154726 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:31:01.154726 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:31:01.154726 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:31:01.154726 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:31:01.154726 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:31:01.154726 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:31:01.154726 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:31:01.154726 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:31:01.154726 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:31:01.154726 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:31:01.154726 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:31:01.154726 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:31:01.154726 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:31:01.154726 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:31:01.154726 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:31:01.154726 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:31:01.155639 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:31:01.155639 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:31:01.155639 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:31:01.155639 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:31:01.155639 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:31:01.155639 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:31:01.155639 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:31:01.155639 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:31:01.155639 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:31:01.155639 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:31:01.155639 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 02:31:01.155639 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:31:01.155639 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 482/962] 10.222.0.42 () {56 vars in 1120 bytes} [Fri Aug 5 02:31:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:31:01.158767 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a9d1f-bb59-469f-a164-ac1463dfbe98 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:01.250568 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a55b0a2-0776-4c4f-8451-e88cfa86865d None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:01.270328 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a9d1f-bb59-469f-a164-ac1463dfbe98 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:01.289948 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd02f296-b7ea-49a2-9b73-3132f6ddb8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:01.290586 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02f296-b7ea-49a2-9b73-3132f6ddb8ad None admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:01.291067 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02f296-b7ea-49a2-9b73-3132f6ddb8ad None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:01.291196 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02f296-b7ea-49a2-9b73-3132f6ddb8ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:01.292088 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd02f296-b7ea-49a2-9b73-3132f6ddb8ad None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:01.293242 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd02f296-b7ea-49a2-9b73-3132f6ddb8ad None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:01.311237 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961aae90-33a3-4181-a3a1-ef8c581d0ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:01.311933 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961aae90-33a3-4181-a3a1-ef8c581d0ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:01.313773 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961aae90-33a3-4181-a3a1-ef8c581d0ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:01.313773 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961aae90-33a3-4181-a3a1-ef8c581d0ad0 None admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:01.313773 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961aae90-33a3-4181-a3a1-ef8c581d0ad0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:01.313773 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961aae90-33a3-4181-a3a1-ef8c581d0ad0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:01.315815 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961aae90-33a3-4181-a3a1-ef8c581d0ad0 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:01.324281 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 483/963] 10.222.0.42 () {56 vars in 1115 bytes} [Fri Aug 5 02:31:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:31:01.325646 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1afb1-c6fd-4915-bf9d-817c6c4c141a None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:01.325907 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1afb1-c6fd-4915-bf9d-817c6c4c141a None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:01.326190 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1afb1-c6fd-4915-bf9d-817c6c4c141a None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:01.327547 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 484/964] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:31:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:31:01.329599 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1afb1-c6fd-4915-bf9d-817c6c4c141a None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:01.360850 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 481/965] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:31:01 2022] POST /identity/v3/endpoints => generated 349 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:31:01.363112 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58cf190-0184-4c32-a384-8cf6dcb5a2a7 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:01.363642 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58cf190-0184-4c32-a384-8cf6dcb5a2a7 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:01.364127 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58cf190-0184-4c32-a384-8cf6dcb5a2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:01.386526 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-f58cf190-0184-4c32-a384-8cf6dcb5a2a7 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:01.388898 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-f58cf190-0184-4c32-a384-8cf6dcb5a2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:01.403268 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:01.438270 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:01.467104 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1afb1-c6fd-4915-bf9d-817c6c4c141a None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:01.504093 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 482/966] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:31:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:31:01.512740 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11702d63-845f-4811-ac8e-02f29ccf4fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:01.513786 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11702d63-845f-4811-ac8e-02f29ccf4fb4 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:01.514617 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11702d63-845f-4811-ac8e-02f29ccf4fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:01.515257 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11702d63-845f-4811-ac8e-02f29ccf4fb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:01.527865 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58cf190-0184-4c32-a384-8cf6dcb5a2a7 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:01.532456 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11702d63-845f-4811-ac8e-02f29ccf4fb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:01.534823 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11702d63-845f-4811-ac8e-02f29ccf4fb4 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:01.552435 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-11702d63-845f-4811-ac8e-02f29ccf4fb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:31:01.552435 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:01.552435 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:31:01.552435 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:31:01.552435 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:31:01.552435 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:31:01.552435 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:31:01.552435 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:31:01.552435 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:31:01.552435 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:31:01.552435 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:31:01.552435 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:31:01.552435 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:31:01.552435 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:31:01.552435 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:31:01.553411 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:31:01.553411 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:31:01.553411 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:31:01.553411 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:31:01.553411 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:31:01.553411 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:31:01.553411 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:31:01.553411 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:31:01.553411 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:31:01.553411 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:31:01.553411 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:31:01.553411 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:31:01.553411 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:31:01.553411 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:31:01.553411 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:31:01.553411 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:31:01.553411 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:31:01.554937 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:31:01.554937 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:31:01.554937 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:31:01.554937 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:31:01.554937 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 485/967] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:31:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:31:01.559569 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11702d63-845f-4811-ac8e-02f29ccf4fb4 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:01.651235 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58cf190-0184-4c32-a384-8cf6dcb5a2a7 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:01.675915 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11702d63-845f-4811-ac8e-02f29ccf4fb4 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:01.678580 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:01.693316 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2d23e-cdbd-4d31-acb6-5e00938c49b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:01.694143 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2d23e-cdbd-4d31-acb6-5e00938c49b7 None admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:01.694705 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2d23e-cdbd-4d31-acb6-5e00938c49b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:01.695028 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2d23e-cdbd-4d31-acb6-5e00938c49b7 None admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:01.695715 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d2d23e-cdbd-4d31-acb6-5e00938c49b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:01.697657 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d2d23e-cdbd-4d31-acb6-5e00938c49b7 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:01.712274 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f3a7e-33b9-4254-b110-3885217302bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:01.712894 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f3a7e-33b9-4254-b110-3885217302bf None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:01.713173 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f3a7e-33b9-4254-b110-3885217302bf None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:01.713449 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f3a7e-33b9-4254-b110-3885217302bf None admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:01.714129 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f3a7e-33b9-4254-b110-3885217302bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:01.714431 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f3a7e-33b9-4254-b110-3885217302bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:01.715842 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f3a7e-33b9-4254-b110-3885217302bf None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:01.728841 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 486/968] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:31:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:31:01.734038 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f3a7e-33b9-4254-b110-3885217302bf None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:01.739448 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.sql.core [None req-90d2d23e-cdbd-4d31-acb6-5e00938c49b7 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 05 02:31:01.739448 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 05 02:31:01.739448 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [parameters: {'user_id': 'c652034bd42547f48de3622eb8938636', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 05 02:31:01.739448 dv-cinder-815582-13-smb devstack@keystone.service[80822]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80822) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 05 02:31:01.746525 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-90d2d23e-cdbd-4d31-acb6-5e00938c49b7 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 05 02:31:01.746525 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:01.746525 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 05 02:31:01.746525 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 05 02:31:01.746525 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 05 02:31:01.746525 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 05 02:31:01.746525 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 05 02:31:01.746525 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application result = self._query(query) Aug 05 02:31:01.746525 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 05 02:31:01.746525 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application conn.query(q) Aug 05 02:31:01.746525 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 05 02:31:01.746525 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 05 02:31:01.746525 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 05 02:31:01.746525 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application result.read() Aug 05 02:31:01.746525 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 05 02:31:01.747480 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 05 02:31:01.747480 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 05 02:31:01.747480 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 05 02:31:01.747480 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 05 02:31:01.747480 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 05 02:31:01.747480 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 05 02:31:01.747480 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 05 02:31:01.747480 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 05 02:31:01.747480 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:31:01.747480 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 05 02:31:01.747480 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:31:01.747480 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:01.747480 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 05 02:31:01.747480 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 05 02:31:01.747480 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 05 02:31:01.747480 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 05 02:31:01.747480 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 05 02:31:01.747480 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application next(self.gen) Aug 05 02:31:01.753733 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 05 02:31:01.753733 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application yield resource Aug 05 02:31:01.753733 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 05 02:31:01.753733 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application next(self.gen) Aug 05 02:31:01.753733 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 05 02:31:01.753733 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self.session.rollback() Aug 05 02:31:01.753733 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 05 02:31:01.753733 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self.force_reraise() Aug 05 02:31:01.753733 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 05 02:31:01.753733 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise self.value Aug 05 02:31:01.753733 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 05 02:31:01.753733 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 05 02:31:01.753733 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 05 02:31:01.753733 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application session.commit() Aug 05 02:31:01.753733 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 05 02:31:01.753733 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 05 02:31:01.753733 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 05 02:31:01.754720 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self._prepare_impl() Aug 05 02:31:01.754720 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 05 02:31:01.754720 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self.session.flush() Aug 05 02:31:01.754720 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 05 02:31:01.754720 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self._flush(objects) Aug 05 02:31:01.754720 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 05 02:31:01.754720 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 05 02:31:01.754720 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 05 02:31:01.754720 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application compat.raise_( Aug 05 02:31:01.754720 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 05 02:31:01.754720 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception Aug 05 02:31:01.754720 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 05 02:31:01.754720 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application flush_context.execute() Aug 05 02:31:01.754720 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 05 02:31:01.754720 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rec.execute(self) Aug 05 02:31:01.754720 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 05 02:31:01.754720 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 05 02:31:01.755718 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 05 02:31:01.755718 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 05 02:31:01.755718 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 05 02:31:01.755718 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 05 02:31:01.755718 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 05 02:31:01.755718 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 05 02:31:01.755718 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 05 02:31:01.755718 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 05 02:31:01.755718 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 05 02:31:01.755718 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 05 02:31:01.755718 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 05 02:31:01.755718 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 05 02:31:01.755718 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 05 02:31:01.755718 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 05 02:31:01.755718 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 05 02:31:01.755718 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception Aug 05 02:31:01.757694 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 05 02:31:01.757694 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 05 02:31:01.757694 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 05 02:31:01.757694 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 05 02:31:01.757694 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 05 02:31:01.757694 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application result = self._query(query) Aug 05 02:31:01.757694 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 05 02:31:01.757694 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application conn.query(q) Aug 05 02:31:01.757694 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 05 02:31:01.757694 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 05 02:31:01.757694 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 05 02:31:01.757694 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application result.read() Aug 05 02:31:01.757694 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 05 02:31:01.757694 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 05 02:31:01.757694 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 05 02:31:01.757694 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 05 02:31:01.760385 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 05 02:31:01.760385 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 05 02:31:01.760385 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 05 02:31:01.760385 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 05 02:31:01.760385 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 05 02:31:01.760385 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 05 02:31:01.760385 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [parameters: {'user_id': 'c652034bd42547f48de3622eb8938636', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 05 02:31:01.760385 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 05 02:31:01.760385 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:31:01.760385 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:31:01.760385 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:31:01.760385 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:01.760385 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:31:01.760385 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:31:01.760385 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:31:01.764000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:31:01.764000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:31:01.764000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:31:01.764000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:31:01.764000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:31:01.764000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:31:01.764000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:31:01.764000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 05 02:31:01.764000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 05 02:31:01.764000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:31:01.764000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:31:01.764000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:31:01.764000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:31:01.764000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:31:01.764000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:31:01.764000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 05 02:31:01.764000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 05 02:31:01.766303 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 05 02:31:01.766303 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 05 02:31:01.766303 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 05 02:31:01.766303 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 05 02:31:01.766303 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 05 02:31:01.766303 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:31:01.766303 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 483/969] 10.222.0.42 () {60 vars in 1131 bytes} [Fri Aug 5 02:31:01 2022] POST /identity/v3/users => generated 160 bytes in 221 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:31:01.766303 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2d23e-cdbd-4d31-acb6-5e00938c49b7 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:01.792585 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:01.873741 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2d23e-cdbd-4d31-acb6-5e00938c49b7 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:01.887549 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f3a7e-33b9-4254-b110-3885217302bf None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:01.911152 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2aa3c7-c736-4bf3-b4d5-6f89fb9133c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:01.911803 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2aa3c7-c736-4bf3-b4d5-6f89fb9133c6 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:01.912082 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2aa3c7-c736-4bf3-b4d5-6f89fb9133c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:01.912354 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2aa3c7-c736-4bf3-b4d5-6f89fb9133c6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:01.920401 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2aa3c7-c736-4bf3-b4d5-6f89fb9133c6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:01.922030 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2aa3c7-c736-4bf3-b4d5-6f89fb9133c6 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:01.933384 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c90f052-bdd3-4e23-befe-b56f797d698e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:01.934327 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90f052-bdd3-4e23-befe-b56f797d698e None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:01.934819 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90f052-bdd3-4e23-befe-b56f797d698e None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:01.935334 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90f052-bdd3-4e23-befe-b56f797d698e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:01.935692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-6d2aa3c7-c736-4bf3-b4d5-6f89fb9133c6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 05 02:31:01.935692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:01.935692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:31:01.935692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:31:01.935692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:31:01.935692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:31:01.935692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:31:01.935692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:31:01.935692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:31:01.935692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:31:01.935692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:31:01.935692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:31:01.935692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:31:01.935692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:31:01.935692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:31:01.935692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:31:01.936626 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:31:01.936626 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:31:01.936626 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:31:01.936626 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:31:01.936626 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:31:01.936626 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:31:01.936626 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:31:01.936626 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:31:01.936626 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:31:01.936626 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:31:01.936626 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:31:01.936626 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:31:01.936626 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:31:01.936626 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:31:01.936626 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:31:01.936626 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:31:01.936626 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:31:01.936626 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:31:01.937580 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:31:01.937580 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:31:01.937580 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:31:01.937580 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:31:01.937580 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:31:01.937580 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:31:01.937580 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:31:01.937580 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:31:01.937580 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 05 02:31:01.937580 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:31:01.942161 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 484/970] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:31:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:31:01.943447 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2aa3c7-c736-4bf3-b4d5-6f89fb9133c6 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:01.949612 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c90f052-bdd3-4e23-befe-b56f797d698e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:01.951407 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c90f052-bdd3-4e23-befe-b56f797d698e None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:01.967718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-4c90f052-bdd3-4e23-befe-b56f797d698e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 02:31:01.967718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:01.967718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:31:01.967718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:31:01.967718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:31:01.967718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:31:01.967718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:31:01.967718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:31:01.967718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:31:01.967718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:31:01.967718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:31:01.967718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:31:01.967718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:31:01.967718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:31:01.967718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:31:01.967718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:31:01.968742 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:31:01.968742 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:31:01.968742 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:31:01.968742 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:31:01.968742 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:31:01.968742 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:31:01.968742 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:31:01.968742 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:31:01.968742 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:31:01.968742 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:31:01.968742 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:31:01.968742 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:31:01.968742 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:31:01.968742 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:31:01.968742 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:31:01.968742 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:31:01.968742 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:31:01.968742 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:31:01.969713 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:31:01.969713 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:31:01.969713 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:31:01.969713 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:31:01.969713 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:31:01.969713 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:31:01.969713 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:31:01.969713 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:31:01.969713 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 02:31:01.969713 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:31:01.972610 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 487/971] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Aug 5 02:31:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:31:01.980149 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c90f052-bdd3-4e23-befe-b56f797d698e None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:02.015416 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:02.039506 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:02.055711 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2aa3c7-c736-4bf3-b4d5-6f89fb9133c6 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:02.093578 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6fcbd5-5a16-4139-9069-cfed93a64905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:02.094213 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6fcbd5-5a16-4139-9069-cfed93a64905 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:02.094498 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6fcbd5-5a16-4139-9069-cfed93a64905 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:02.094779 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6fcbd5-5a16-4139-9069-cfed93a64905 None admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:02.095576 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6fcbd5-5a16-4139-9069-cfed93a64905 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:02.095921 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6fcbd5-5a16-4139-9069-cfed93a64905 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:02.097476 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6fcbd5-5a16-4139-9069-cfed93a64905 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:02.109741 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c90f052-bdd3-4e23-befe-b56f797d698e None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:02.142990 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 485/972] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 5 02:31:01 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:02.155378 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147ac54-b708-466f-b76c-c55a88160664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:02.156675 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147ac54-b708-466f-b76c-c55a88160664 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:02.157130 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147ac54-b708-466f-b76c-c55a88160664 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:02.157554 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147ac54-b708-466f-b76c-c55a88160664 None admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:02.158577 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c147ac54-b708-466f-b76c-c55a88160664 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:02.159091 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c147ac54-b708-466f-b76c-c55a88160664 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:02.160757 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c147ac54-b708-466f-b76c-c55a88160664 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:02.182940 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 488/973] 10.222.0.42 () {56 vars in 1149 bytes} [Fri Aug 5 02:31:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:02.188412 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6fcbd5-5a16-4139-9069-cfed93a64905 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:02.312896 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6fcbd5-5a16-4139-9069-cfed93a64905 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:02.352717 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855f201-9792-402c-9a72-3ab7b8cb0431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:02.353345 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855f201-9792-402c-9a72-3ab7b8cb0431 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:02.353630 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855f201-9792-402c-9a72-3ab7b8cb0431 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:02.353909 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855f201-9792-402c-9a72-3ab7b8cb0431 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:02.368948 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:02.425066 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6855f201-9792-402c-9a72-3ab7b8cb0431 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:02.426598 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6855f201-9792-402c-9a72-3ab7b8cb0431 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:02.531394 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 486/974] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:31:02 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 02:31:02.532856 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147ac54-b708-466f-b76c-c55a88160664 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:02.617864 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:02.636523 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147ac54-b708-466f-b76c-c55a88160664 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:02.671505 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f42e6c-c6e4-4c80-88f4-0d02bc726221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:02.672501 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f42e6c-c6e4-4c80-88f4-0d02bc726221 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:02.672988 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f42e6c-c6e4-4c80-88f4-0d02bc726221 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:02.673464 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f42e6c-c6e4-4c80-88f4-0d02bc726221 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:02.684996 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f42e6c-c6e4-4c80-88f4-0d02bc726221 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:02.686835 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f42e6c-c6e4-4c80-88f4-0d02bc726221 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:02.701973 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-e9f42e6c-c6e4-4c80-88f4-0d02bc726221 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:31:02.701973 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:02.701973 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:31:02.701973 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:31:02.701973 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:31:02.701973 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:31:02.701973 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:31:02.701973 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:31:02.701973 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:31:02.701973 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:31:02.701973 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:31:02.701973 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:31:02.701973 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:31:02.701973 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:31:02.701973 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:31:02.702879 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:31:02.702879 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:31:02.702879 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:31:02.702879 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:31:02.702879 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:31:02.702879 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:31:02.702879 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:31:02.702879 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:31:02.702879 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:31:02.702879 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:31:02.702879 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:31:02.702879 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:31:02.702879 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:31:02.702879 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:31:02.702879 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:31:02.702879 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:31:02.702879 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:31:02.703852 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:31:02.703852 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:31:02.703852 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:31:02.703852 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:31:02.709654 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 489/975] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:31:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:31:02.710800 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855f201-9792-402c-9a72-3ab7b8cb0431 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:02.758047 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:02.810364 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855f201-9792-402c-9a72-3ab7b8cb0431 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:02.843736 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45996dfc-9fe2-4300-9ffe-905e99044309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:02.844359 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45996dfc-9fe2-4300-9ffe-905e99044309 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:02.844644 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45996dfc-9fe2-4300-9ffe-905e99044309 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:02.844924 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45996dfc-9fe2-4300-9ffe-905e99044309 None admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:02.845646 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45996dfc-9fe2-4300-9ffe-905e99044309 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:02.845955 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45996dfc-9fe2-4300-9ffe-905e99044309 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:02.847350 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45996dfc-9fe2-4300-9ffe-905e99044309 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:02.858989 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 487/976] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:31:02.865305 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f42e6c-c6e4-4c80-88f4-0d02bc726221 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:02.916475 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed7721-b427-4a93-a06c-07a2e85d3ce5 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:02.916825 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed7721-b427-4a93-a06c-07a2e85d3ce5 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:02.917042 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed7721-b427-4a93-a06c-07a2e85d3ce5 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:02.918773 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 488/977] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:31:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:31:02.923433 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e78f9-8d32-49e9-8fdc-5e5c5edbb813 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:02.924221 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e78f9-8d32-49e9-8fdc-5e5c5edbb813 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:02.924508 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e78f9-8d32-49e9-8fdc-5e5c5edbb813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:02.944279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-be9e78f9-8d32-49e9-8fdc-5e5c5edbb813 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:02.945806 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-be9e78f9-8d32-49e9-8fdc-5e5c5edbb813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:02.970345 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f42e6c-c6e4-4c80-88f4-0d02bc726221 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:03.012177 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4aded-c621-4305-8676-d590ba8c840c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:03.012816 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4aded-c621-4305-8676-d590ba8c840c None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:03.013106 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4aded-c621-4305-8676-d590ba8c840c None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:03.013373 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4aded-c621-4305-8676-d590ba8c840c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:03.015595 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:03.016538 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 489/978] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:31:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 02:31:03.021772 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4aded-c621-4305-8676-d590ba8c840c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:03.023548 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4aded-c621-4305-8676-d590ba8c840c None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:03.035210 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-35b4aded-c621-4305-8676-d590ba8c840c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:31:03.035210 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:03.035210 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:31:03.035210 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:31:03.035210 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:31:03.035210 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:31:03.035210 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:31:03.035210 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:31:03.035210 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:31:03.035210 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:31:03.035210 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:31:03.035210 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:31:03.035210 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:31:03.035210 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:31:03.035210 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:31:03.036162 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:31:03.036162 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:31:03.036162 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:31:03.036162 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:31:03.036162 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:31:03.036162 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:31:03.036162 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:31:03.036162 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:31:03.036162 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:31:03.036162 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:31:03.036162 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:31:03.036162 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:31:03.036162 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:31:03.036162 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:31:03.036162 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:31:03.036162 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:31:03.036162 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:31:03.042234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:31:03.042234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:31:03.042234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:31:03.042234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:31:03.042234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:31:03.042234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:31:03.042234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:31:03.042234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:31:03.042234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 490/979] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:31:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:31:03.042765 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e78f9-8d32-49e9-8fdc-5e5c5edbb813 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:03.044106 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4aded-c621-4305-8676-d590ba8c840c None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:03.077775 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:03.146657 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e78f9-8d32-49e9-8fdc-5e5c5edbb813 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:03.158589 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4aded-c621-4305-8676-d590ba8c840c None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:03.184198 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce07fd-1e32-4506-a137-e90e265f774e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:03.184818 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce07fd-1e32-4506-a137-e90e265f774e None admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:03.185097 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce07fd-1e32-4506-a137-e90e265f774e None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:03.185396 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce07fd-1e32-4506-a137-e90e265f774e None admin] PATH_INFO: `/v3/services` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:03.186063 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce07fd-1e32-4506-a137-e90e265f774e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:03.187775 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce07fd-1e32-4506-a137-e90e265f774e None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:03.195495 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b730ef7-6bad-4ff5-ac43-b674a220da04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:03.196111 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b730ef7-6bad-4ff5-ac43-b674a220da04 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:03.196399 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b730ef7-6bad-4ff5-ac43-b674a220da04 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:03.196675 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b730ef7-6bad-4ff5-ac43-b674a220da04 None admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:03.197420 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b730ef7-6bad-4ff5-ac43-b674a220da04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:03.197725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b730ef7-6bad-4ff5-ac43-b674a220da04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:03.199246 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b730ef7-6bad-4ff5-ac43-b674a220da04 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:03.211194 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 491/980] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 5 02:31:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:03.217239 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b730ef7-6bad-4ff5-ac43-b674a220da04 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:03.272904 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:03.301980 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 490/981] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Aug 5 02:31:03 2022] POST /identity/v3/services => generated 242 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:31:03.323331 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b730ef7-6bad-4ff5-ac43-b674a220da04 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:03.369861 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b9116-d222-42a1-8488-c675f6bad048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:03.370414 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b9116-d222-42a1-8488-c675f6bad048 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:03.370694 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b9116-d222-42a1-8488-c675f6bad048 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:03.370991 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b9116-d222-42a1-8488-c675f6bad048 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:03.371796 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923b9116-d222-42a1-8488-c675f6bad048 None admin] RBAC: Adding query filter params (role.id=c14dbbd7897245a18070be9be19c278b, scope.project.id=63b323c02a614fc28aac6e7a060064ba, user.id=6bea520676244effbbe212aa62b1cc68) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:03.372157 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923b9116-d222-42a1-8488-c675f6bad048 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:03.373666 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923b9116-d222-42a1-8488-c675f6bad048 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:03.380576 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 492/982] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:31:03 2022] GET /identity/v3/role_assignments?user.id=6bea520676244effbbe212aa62b1cc68&scope.project.id=63b323c02a614fc28aac6e7a060064ba&role.id=c14dbbd7897245a18070be9be19c278b => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:31:03.476820 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b026c-d1a8-4cc6-a08c-ea2c5771d006 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:03.477108 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b026c-d1a8-4cc6-a08c-ea2c5771d006 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:03.477393 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b026c-d1a8-4cc6-a08c-ea2c5771d006 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:03.478940 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 491/983] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:31:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:31:03.484507 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c4a90-a642-4242-aaf4-eb7d7fd857db None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:03.484791 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c4a90-a642-4242-aaf4-eb7d7fd857db None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:03.485073 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c4a90-a642-4242-aaf4-eb7d7fd857db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:03.504797 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-d60c4a90-a642-4242-aaf4-eb7d7fd857db None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:03.506027 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-d60c4a90-a642-4242-aaf4-eb7d7fd857db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:03.577098 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 493/984] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:31:03 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:31:03.600273 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b026c-d1a8-4cc6-a08c-ea2c5771d006 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:03.700362 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:03.708227 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b026c-d1a8-4cc6-a08c-ea2c5771d006 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:03.742940 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6fab20-2c68-4ec7-bf23-7588fb37579e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:03.743616 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6fab20-2c68-4ec7-bf23-7588fb37579e None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:03.743901 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6fab20-2c68-4ec7-bf23-7588fb37579e None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:03.744228 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6fab20-2c68-4ec7-bf23-7588fb37579e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:03.744814 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6fab20-2c68-4ec7-bf23-7588fb37579e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:03.746194 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6fab20-2c68-4ec7-bf23-7588fb37579e None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:03.755093 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-dd6fab20-2c68-4ec7-bf23-7588fb37579e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 02:31:03.755093 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:03.755093 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:31:03.755093 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:31:03.755093 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:31:03.755093 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:31:03.755093 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:31:03.755093 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:31:03.755093 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 02:31:03.755093 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:31:03.755093 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:31:03.755093 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:31:03.755093 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:03.755093 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:31:03.755093 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:31:03.755093 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:31:03.755093 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:31:03.756093 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:31:03.756093 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:31:03.756093 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:31:03.756093 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:31:03.756093 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:31:03.756093 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:31:03.756093 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:31:03.756093 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:31:03.756093 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:31:03.756093 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:31:03.756093 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:31:03.756093 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:31:03.756093 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:31:03.756093 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:31:03.756093 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:31:03.756093 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:31:03.756944 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:31:03.756944 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:31:03.756944 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:31:03.756944 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:31:03.756944 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:31:03.756944 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:31:03.756944 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:31:03.756944 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:31:03.756944 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:31:03.756944 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:31:03.756944 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:31:03.756944 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:31:03.756944 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 02:31:03.756944 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:31:03.759021 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 492/985] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Aug 5 02:31:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:31:03.762468 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c4a90-a642-4242-aaf4-eb7d7fd857db None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:03.810098 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:03.864542 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c4a90-a642-4242-aaf4-eb7d7fd857db None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:03.899425 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac8c4ed-65ea-4306-93dd-4f726a5fc24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:03.900045 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8c4ed-65ea-4306-93dd-4f726a5fc24f None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:03.900323 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8c4ed-65ea-4306-93dd-4f726a5fc24f None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:03.900595 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8c4ed-65ea-4306-93dd-4f726a5fc24f None admin] PATH_INFO: `/v3/services` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:03.901267 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac8c4ed-65ea-4306-93dd-4f726a5fc24f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:03.901566 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac8c4ed-65ea-4306-93dd-4f726a5fc24f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:03.902930 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac8c4ed-65ea-4306-93dd-4f726a5fc24f None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:03.907615 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 494/986] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Aug 5 02:31:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:03.913621 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6fab20-2c68-4ec7-bf23-7588fb37579e None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:04.015058 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6fab20-2c68-4ec7-bf23-7588fb37579e None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:04.049660 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eedf17-b0e2-420b-b051-7eab028d84ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:04.050286 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eedf17-b0e2-420b-b051-7eab028d84ee None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:04.050568 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eedf17-b0e2-420b-b051-7eab028d84ee None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:04.050845 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eedf17-b0e2-420b-b051-7eab028d84ee None admin] PATH_INFO: `/v3/services` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:04.051559 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eedf17-b0e2-420b-b051-7eab028d84ee None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:04.051869 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eedf17-b0e2-420b-b051-7eab028d84ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:04.053242 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eedf17-b0e2-420b-b051-7eab028d84ee None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:04.063252 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 493/987] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Aug 5 02:31:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:31:04.064774 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac8c4ed-65ea-4306-93dd-4f726a5fc24f None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:04.166495 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac8c4ed-65ea-4306-93dd-4f726a5fc24f None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:04.176472 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:04.201051 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed4bfe-c920-4e85-bbb2-1bc2cebaf283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:04.201665 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed4bfe-c920-4e85-bbb2-1bc2cebaf283 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:04.201944 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed4bfe-c920-4e85-bbb2-1bc2cebaf283 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:04.202220 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed4bfe-c920-4e85-bbb2-1bc2cebaf283 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:04.202989 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aed4bfe-c920-4e85-bbb2-1bc2cebaf283 None admin] RBAC: Adding query filter params (interface=admin, service_id=e0281380c6dd474dbb00f5ed52997ba7, region_id=RegionOne) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:04.203306 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aed4bfe-c920-4e85-bbb2-1bc2cebaf283 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:04.204688 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aed4bfe-c920-4e85-bbb2-1bc2cebaf283 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:04.209718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 495/988] 10.222.0.42 () {56 vars in 1249 bytes} [Fri Aug 5 02:31:04 2022] GET /identity/v3/endpoints?service_id=e0281380c6dd474dbb00f5ed52997ba7&interface=admin®ion_id=RegionOne => generated 193 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:04.215417 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eedf17-b0e2-420b-b051-7eab028d84ee None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:04.241573 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:04.324950 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eedf17-b0e2-420b-b051-7eab028d84ee None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:04.363476 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03dfc5-5bc0-4111-bade-35a4474d259c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:04.364103 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03dfc5-5bc0-4111-bade-35a4474d259c None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:04.364382 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03dfc5-5bc0-4111-bade-35a4474d259c None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:04.364656 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03dfc5-5bc0-4111-bade-35a4474d259c None admin] PATH_INFO: `/v3/services` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:04.365306 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03dfc5-5bc0-4111-bade-35a4474d259c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:04.366673 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03dfc5-5bc0-4111-bade-35a4474d259c None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:04.375111 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 494/989] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Aug 5 02:31:04 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:31:05.354061 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1a9b0-91b0-4a5e-ba9e-7a5bc203ae05 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:05.354570 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1a9b0-91b0-4a5e-ba9e-7a5bc203ae05 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:05.354646 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1a9b0-91b0-4a5e-ba9e-7a5bc203ae05 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:05.356144 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 496/990] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:31:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:31:05.361055 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21375a40-89b9-449f-9d32-17553328911c None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:05.361462 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21375a40-89b9-449f-9d32-17553328911c None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:05.361625 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21375a40-89b9-449f-9d32-17553328911c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:05.380127 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-21375a40-89b9-449f-9d32-17553328911c None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:05.381304 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-21375a40-89b9-449f-9d32-17553328911c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:05.449270 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 495/991] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:31:05 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:31:05.456742 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb1b11-ae14-4fb9-a0a5-68554d03ec49 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:05.457031 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb1b11-ae14-4fb9-a0a5-68554d03ec49 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:05.457314 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb1b11-ae14-4fb9-a0a5-68554d03ec49 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:05.458654 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 497/992] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:31:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:31:05.463886 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c90c3b-d02c-49af-8627-14b4de85cb91 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:05.464180 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c90c3b-d02c-49af-8627-14b4de85cb91 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:05.464459 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c90c3b-d02c-49af-8627-14b4de85cb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:05.473635 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb1b11-ae14-4fb9-a0a5-68554d03ec49 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:05.483296 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-33c90c3b-d02c-49af-8627-14b4de85cb91 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:05.484535 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-33c90c3b-d02c-49af-8627-14b4de85cb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:05.496628 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:05.555707 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 496/993] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:31:05 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:31:05.577521 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c90c3b-d02c-49af-8627-14b4de85cb91 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:05.586571 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb1b11-ae14-4fb9-a0a5-68554d03ec49 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:05.623176 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89902a7a-7da7-4627-8670-f2511a068e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:05.623975 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89902a7a-7da7-4627-8670-f2511a068e2a None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:05.624261 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89902a7a-7da7-4627-8670-f2511a068e2a None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:05.624534 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89902a7a-7da7-4627-8670-f2511a068e2a None admin] PATH_INFO: `/v3/services/compute` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:05.625154 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89902a7a-7da7-4627-8670-f2511a068e2a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:05.626526 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89902a7a-7da7-4627-8670-f2511a068e2a None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:05.636792 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-89902a7a-7da7-4627-8670-f2511a068e2a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 02:31:05.636792 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:05.636792 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:31:05.636792 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:31:05.636792 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:31:05.636792 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:31:05.636792 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:31:05.636792 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:31:05.636792 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 02:31:05.636792 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:31:05.636792 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:31:05.636792 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:31:05.636792 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:05.636792 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:31:05.636792 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:31:05.636792 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:31:05.636792 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:31:05.637794 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:31:05.637794 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:31:05.637794 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:31:05.637794 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:31:05.637794 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:31:05.637794 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:31:05.637794 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:31:05.637794 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:31:05.637794 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:31:05.637794 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:31:05.637794 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:31:05.637794 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:31:05.637794 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:31:05.637794 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:31:05.637794 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:31:05.637794 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:31:05.638638 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:31:05.638638 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:31:05.638638 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:31:05.638638 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:31:05.638638 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:31:05.638638 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:31:05.638638 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:31:05.638638 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:31:05.638638 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:31:05.638638 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:31:05.638638 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:31:05.638638 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:31:05.638638 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 02:31:05.638638 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:31:05.638638 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 498/994] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:31:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:31:05.644603 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89902a7a-7da7-4627-8670-f2511a068e2a None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:05.681885 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:05.683428 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c90c3b-d02c-49af-8627-14b4de85cb91 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:05.718718 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc2de1-e458-403a-a513-b6eeafa31ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:05.719391 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc2de1-e458-403a-a513-b6eeafa31ceb None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:05.719676 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc2de1-e458-403a-a513-b6eeafa31ceb None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:05.719951 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc2de1-e458-403a-a513-b6eeafa31ceb None admin] PATH_INFO: `/v3/services/image` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:05.720608 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc2de1-e458-403a-a513-b6eeafa31ceb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:05.721975 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc2de1-e458-403a-a513-b6eeafa31ceb None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:05.731039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-02fc2de1-e458-403a-a513-b6eeafa31ceb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 02:31:05.731039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:05.731039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:31:05.731039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:31:05.731039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:31:05.731039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:31:05.731039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:31:05.731039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:31:05.731039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 02:31:05.731039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:31:05.731039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:31:05.731039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:31:05.731039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:05.731039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:31:05.731039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:31:05.731039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:31:05.731039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:31:05.732019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:31:05.732019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:31:05.732019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:31:05.732019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:31:05.732019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:31:05.732019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:31:05.732019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:31:05.732019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:31:05.732019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:31:05.732019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:31:05.732019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:31:05.732019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:31:05.732019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:31:05.732019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:31:05.732019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:31:05.732019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:31:05.732901 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:31:05.732901 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:31:05.732901 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:31:05.732901 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:31:05.732901 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:31:05.732901 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:31:05.732901 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:31:05.732901 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:31:05.732901 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:31:05.732901 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:31:05.732901 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:31:05.732901 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:31:05.732901 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 02:31:05.732901 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:31:05.732901 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 497/995] 10.222.0.42 () {56 vars in 1105 bytes} [Fri Aug 5 02:31:05 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:31:05.738473 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc2de1-e458-403a-a513-b6eeafa31ceb None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:05.750383 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:05.751283 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89902a7a-7da7-4627-8670-f2511a068e2a None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:05.787294 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a0c86-3c57-44f0-81aa-b8a351cf360b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:05.787906 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a0c86-3c57-44f0-81aa-b8a351cf360b None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:05.788191 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a0c86-3c57-44f0-81aa-b8a351cf360b None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:05.788468 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a0c86-3c57-44f0-81aa-b8a351cf360b None admin] PATH_INFO: `/v3/services` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:05.789139 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a0c86-3c57-44f0-81aa-b8a351cf360b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:05.789442 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a0c86-3c57-44f0-81aa-b8a351cf360b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:05.790823 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a0c86-3c57-44f0-81aa-b8a351cf360b None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:05.800641 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 499/996] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Aug 5 02:31:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:31:05.801655 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a0c86-3c57-44f0-81aa-b8a351cf360b None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:05.845818 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc2de1-e458-403a-a513-b6eeafa31ceb None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:05.881048 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5b086-2a22-467f-8baf-0b284023fcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:05.881678 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5b086-2a22-467f-8baf-0b284023fcc0 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:05.881970 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5b086-2a22-467f-8baf-0b284023fcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:05.882245 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5b086-2a22-467f-8baf-0b284023fcc0 None admin] PATH_INFO: `/v3/services` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:05.882924 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5b086-2a22-467f-8baf-0b284023fcc0 None admin] RBAC: Adding query filter params (name=image) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:05.883267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5b086-2a22-467f-8baf-0b284023fcc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:05.884670 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5b086-2a22-467f-8baf-0b284023fcc0 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:05.890981 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 498/997] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:31:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:31:05.895137 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5b086-2a22-467f-8baf-0b284023fcc0 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:05.910474 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:05.913493 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a0c86-3c57-44f0-81aa-b8a351cf360b None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:05.950237 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef15ac-ca2a-4892-bdd2-a8d2641e34ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:05.950990 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef15ac-ca2a-4892-bdd2-a8d2641e34ca None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:05.951270 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef15ac-ca2a-4892-bdd2-a8d2641e34ca None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:05.951569 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef15ac-ca2a-4892-bdd2-a8d2641e34ca None admin] PATH_INFO: `/v3/services` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:05.952312 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ef15ac-ca2a-4892-bdd2-a8d2641e34ca None admin] RBAC: Adding query filter params (type=compute) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:05.952678 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ef15ac-ca2a-4892-bdd2-a8d2641e34ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:05.954169 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ef15ac-ca2a-4892-bdd2-a8d2641e34ca None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:05.959673 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 500/998] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Aug 5 02:31:05 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:31:05.965044 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef15ac-ca2a-4892-bdd2-a8d2641e34ca None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:05.976070 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:06.002208 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5b086-2a22-467f-8baf-0b284023fcc0 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:06.038112 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c3d171-cdf5-4c7a-b83b-40f485b17fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:06.038739 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3d171-cdf5-4c7a-b83b-40f485b17fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:06.039055 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3d171-cdf5-4c7a-b83b-40f485b17fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:06.039334 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3d171-cdf5-4c7a-b83b-40f485b17fd8 None admin] PATH_INFO: `/v3/services` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:06.040018 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c3d171-cdf5-4c7a-b83b-40f485b17fd8 None admin] RBAC: Adding query filter params (type=image) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:06.040326 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c3d171-cdf5-4c7a-b83b-40f485b17fd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:06.041703 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c3d171-cdf5-4c7a-b83b-40f485b17fd8 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:06.046523 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 499/999] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:31:05 2022] GET /identity/v3/services?type=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:31:06.070742 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef15ac-ca2a-4892-bdd2-a8d2641e34ca None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:06.108768 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e13a1-bba5-4b7b-99a5-878d46d771bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:06.109322 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e13a1-bba5-4b7b-99a5-878d46d771bb None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:06.109606 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e13a1-bba5-4b7b-99a5-878d46d771bb None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:06.109886 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e13a1-bba5-4b7b-99a5-878d46d771bb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:06.110657 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e13a1-bba5-4b7b-99a5-878d46d771bb None admin] RBAC: Adding query filter params (interface=public, service_id=e9fe09adf58444b9b9440000ab8d6360, region_id=RegionOne) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:06.111592 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e13a1-bba5-4b7b-99a5-878d46d771bb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:06.112978 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e13a1-bba5-4b7b-99a5-878d46d771bb None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:06.123407 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 501/1000] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Aug 5 02:31:05 2022] GET /identity/v3/endpoints?service_id=e9fe09adf58444b9b9440000ab8d6360&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:31:06.124967 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c3d171-cdf5-4c7a-b83b-40f485b17fd8 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:06.233117 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c3d171-cdf5-4c7a-b83b-40f485b17fd8 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:06.266581 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44855c00-72c5-4edd-a7bd-f9463a18c872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:06.267260 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44855c00-72c5-4edd-a7bd-f9463a18c872 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:06.267545 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44855c00-72c5-4edd-a7bd-f9463a18c872 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:06.267824 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44855c00-72c5-4edd-a7bd-f9463a18c872 None admin] PATH_INFO: `/v3/services` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:06.268484 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44855c00-72c5-4edd-a7bd-f9463a18c872 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:06.269864 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44855c00-72c5-4edd-a7bd-f9463a18c872 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:06.282757 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 500/1001] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Aug 5 02:31:06 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:31:06.416355 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e918b-296c-4794-a80b-d54877602e86 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:06.416869 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e918b-296c-4794-a80b-d54877602e86 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:06.416869 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e918b-296c-4794-a80b-d54877602e86 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:06.418343 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 502/1002] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:31:06.424545 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3dbff-eb7a-4c7d-9906-0f69ef7a18a2 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:06.425065 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3dbff-eb7a-4c7d-9906-0f69ef7a18a2 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:06.425389 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3dbff-eb7a-4c7d-9906-0f69ef7a18a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:06.432184 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:06.444134 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-63a3dbff-eb7a-4c7d-9906-0f69ef7a18a2 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:06.455885 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-63a3dbff-eb7a-4c7d-9906-0f69ef7a18a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:06.515794 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 501/1003] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:31:06 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:31:06.539164 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e918b-296c-4794-a80b-d54877602e86 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:06.568001 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:06.667499 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e918b-296c-4794-a80b-d54877602e86 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:06.701190 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc1bc99-00cc-4c2a-a93f-a8b58555d870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:06.701901 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1bc99-00cc-4c2a-a93f-a8b58555d870 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:06.702180 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1bc99-00cc-4c2a-a93f-a8b58555d870 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:06.702452 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1bc99-00cc-4c2a-a93f-a8b58555d870 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:06.703108 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc1bc99-00cc-4c2a-a93f-a8b58555d870 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:06.704478 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc1bc99-00cc-4c2a-a93f-a8b58555d870 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:06.713951 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-2bc1bc99-00cc-4c2a-a93f-a8b58555d870 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 02:31:06.713951 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:06.713951 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:31:06.713951 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:31:06.713951 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:31:06.713951 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:31:06.713951 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:31:06.713951 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:31:06.713951 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 02:31:06.713951 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:31:06.713951 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:31:06.713951 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:31:06.713951 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:06.713951 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:31:06.713951 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:31:06.713951 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:31:06.713951 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:31:06.714997 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:31:06.714997 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:31:06.714997 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:31:06.714997 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:31:06.714997 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:31:06.714997 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:31:06.714997 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:31:06.714997 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:31:06.714997 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:31:06.714997 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:31:06.714997 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:31:06.714997 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:31:06.714997 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:31:06.714997 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:31:06.714997 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:31:06.714997 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:31:06.721524 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:31:06.721524 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:31:06.721524 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:31:06.721524 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:31:06.721524 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:31:06.721524 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:31:06.721524 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:31:06.721524 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:31:06.721524 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:31:06.721524 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:31:06.721524 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:31:06.721524 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:31:06.721524 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 02:31:06.721524 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:31:06.721524 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 503/1004] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Aug 5 02:31:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:31:06.724478 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a3dbff-eb7a-4c7d-9906-0f69ef7a18a2 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:06.825756 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a3dbff-eb7a-4c7d-9906-0f69ef7a18a2 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:06.856157 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:06.861630 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfee97a-6b54-4e0e-81dc-048889d39b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:06.862253 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfee97a-6b54-4e0e-81dc-048889d39b1d None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:06.862536 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfee97a-6b54-4e0e-81dc-048889d39b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:06.862813 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfee97a-6b54-4e0e-81dc-048889d39b1d None admin] PATH_INFO: `/v3/services` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:06.863522 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfee97a-6b54-4e0e-81dc-048889d39b1d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:06.863890 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfee97a-6b54-4e0e-81dc-048889d39b1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:06.865257 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfee97a-6b54-4e0e-81dc-048889d39b1d None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:06.874605 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 502/1005] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Aug 5 02:31:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:31:06.876084 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc1bc99-00cc-4c2a-a93f-a8b58555d870 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:06.970679 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:06.979960 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc1bc99-00cc-4c2a-a93f-a8b58555d870 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:07.023511 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6830b1-a1a6-4785-a747-778e5c8c3957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:07.024155 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6830b1-a1a6-4785-a747-778e5c8c3957 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:07.024439 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6830b1-a1a6-4785-a747-778e5c8c3957 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:07.024711 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6830b1-a1a6-4785-a747-778e5c8c3957 None admin] PATH_INFO: `/v3/services` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:07.025457 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6830b1-a1a6-4785-a747-778e5c8c3957 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:07.025766 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6830b1-a1a6-4785-a747-778e5c8c3957 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:07.027387 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6830b1-a1a6-4785-a747-778e5c8c3957 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:07.034162 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 504/1006] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Aug 5 02:31:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:07.041995 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfee97a-6b54-4e0e-81dc-048889d39b1d None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:07.143611 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfee97a-6b54-4e0e-81dc-048889d39b1d None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:07.178579 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611f70f-8593-4074-a8a2-8c49e051caa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:07.179239 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611f70f-8593-4074-a8a2-8c49e051caa4 None admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:07.179521 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611f70f-8593-4074-a8a2-8c49e051caa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:07.179791 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611f70f-8593-4074-a8a2-8c49e051caa4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:07.180516 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0611f70f-8593-4074-a8a2-8c49e051caa4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:07.181926 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0611f70f-8593-4074-a8a2-8c49e051caa4 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:07.252744 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 503/1007] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:31:07 2022] POST /identity/v3/endpoints => generated 325 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:31:08.081336 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a909c-2509-4998-b40d-025150b2fb5d None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:08.081885 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a909c-2509-4998-b40d-025150b2fb5d None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:08.081885 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a909c-2509-4998-b40d-025150b2fb5d None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:08.083434 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 505/1008] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:31:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:31:08.088364 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3efb2e6-d6d5-4aeb-9e76-427c7b55ffb3 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:08.088760 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3efb2e6-d6d5-4aeb-9e76-427c7b55ffb3 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:08.088920 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3efb2e6-d6d5-4aeb-9e76-427c7b55ffb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:08.107452 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-b3efb2e6-d6d5-4aeb-9e76-427c7b55ffb3 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:08.108648 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-b3efb2e6-d6d5-4aeb-9e76-427c7b55ffb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:08.156749 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:08.178721 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 504/1009] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:31:08 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:31:08.200928 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a909c-2509-4998-b40d-025150b2fb5d None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:08.312127 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a909c-2509-4998-b40d-025150b2fb5d None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:08.332339 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3152cf-0281-4b59-bc15-ae360ceec259 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:08.332904 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3152cf-0281-4b59-bc15-ae360ceec259 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:08.333183 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3152cf-0281-4b59-bc15-ae360ceec259 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:08.334542 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 505/1010] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:31:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:31:08.339587 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a3c39-e9ca-4113-b290-3c857bf3325a None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:08.339880 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a3c39-e9ca-4113-b290-3c857bf3325a None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:08.340166 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a3c39-e9ca-4113-b290-3c857bf3325a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:08.349771 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1678f843-0cb3-442b-9b7a-dd71dd73c3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:08.350393 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678f843-0cb3-442b-9b7a-dd71dd73c3bd None admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:08.350677 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678f843-0cb3-442b-9b7a-dd71dd73c3bd None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:08.350974 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678f843-0cb3-442b-9b7a-dd71dd73c3bd None admin] PATH_INFO: `/v3/services` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:08.351675 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1678f843-0cb3-442b-9b7a-dd71dd73c3bd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:08.353061 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1678f843-0cb3-442b-9b7a-dd71dd73c3bd None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:08.359306 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-8a2a3c39-e9ca-4113-b290-3c857bf3325a None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:08.360527 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-8a2a3c39-e9ca-4113-b290-3c857bf3325a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:08.419254 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 506/1011] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Aug 5 02:31:08 2022] POST /identity/v3/services => generated 242 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:31:08.443776 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 506/1012] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:31:08 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 02:31:08.466804 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1678f843-0cb3-442b-9b7a-dd71dd73c3bd None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:08.489111 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:08.580404 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1678f843-0cb3-442b-9b7a-dd71dd73c3bd None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:08.617803 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c443c68-19a4-42e7-937c-d0055fb8c770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:08.618381 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c443c68-19a4-42e7-937c-d0055fb8c770 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:08.618667 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c443c68-19a4-42e7-937c-d0055fb8c770 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:08.618945 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c443c68-19a4-42e7-937c-d0055fb8c770 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:08.619660 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c443c68-19a4-42e7-937c-d0055fb8c770 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:08.621045 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c443c68-19a4-42e7-937c-d0055fb8c770 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:08.630082 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-6c443c68-19a4-42e7-937c-d0055fb8c770 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 02:31:08.630082 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:08.630082 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:31:08.630082 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:31:08.630082 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:31:08.630082 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:31:08.630082 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:31:08.630082 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:31:08.630082 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 02:31:08.630082 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:31:08.630082 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:31:08.630082 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:31:08.630082 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:08.630082 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:31:08.630082 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:31:08.630082 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:31:08.630082 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:31:08.631141 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:31:08.631141 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:31:08.631141 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:31:08.631141 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:31:08.631141 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:31:08.631141 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:31:08.631141 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:31:08.631141 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:31:08.631141 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:31:08.631141 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:31:08.631141 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:31:08.631141 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:31:08.631141 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:31:08.631141 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:31:08.631141 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:31:08.631141 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:31:08.632024 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:31:08.632024 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:31:08.632024 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:31:08.632024 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:31:08.632024 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:31:08.632024 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:31:08.632024 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:31:08.632024 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:31:08.632024 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:31:08.632024 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:31:08.632024 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:31:08.632024 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:31:08.632024 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 02:31:08.632024 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:31:08.632024 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 507/1013] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:31:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:31:08.637574 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a3c39-e9ca-4113-b290-3c857bf3325a None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:08.739139 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a3c39-e9ca-4113-b290-3c857bf3325a None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:08.748526 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:08.773668 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ee596-52b5-468d-bb08-e61a73018cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:08.774303 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ee596-52b5-468d-bb08-e61a73018cde None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:08.774584 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ee596-52b5-468d-bb08-e61a73018cde None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:08.774857 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ee596-52b5-468d-bb08-e61a73018cde None admin] PATH_INFO: `/v3/services` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:08.775567 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ee596-52b5-468d-bb08-e61a73018cde None admin] RBAC: Adding query filter params (name=compute) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:08.775987 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ee596-52b5-468d-bb08-e61a73018cde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:08.777994 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ee596-52b5-468d-bb08-e61a73018cde None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:08.788512 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 507/1014] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Aug 5 02:31:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:31:08.789794 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c443c68-19a4-42e7-937c-d0055fb8c770 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:08.871368 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:08.890996 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c443c68-19a4-42e7-937c-d0055fb8c770 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:08.926735 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4e4e2-b80b-46be-9c1e-34789684bad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:08.927391 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4e4e2-b80b-46be-9c1e-34789684bad3 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:08.927673 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4e4e2-b80b-46be-9c1e-34789684bad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:08.927975 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4e4e2-b80b-46be-9c1e-34789684bad3 None admin] PATH_INFO: `/v3/services` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:08.928647 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d4e4e2-b80b-46be-9c1e-34789684bad3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:08.928951 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d4e4e2-b80b-46be-9c1e-34789684bad3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:08.930323 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d4e4e2-b80b-46be-9c1e-34789684bad3 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:08.940150 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 508/1015] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Aug 5 02:31:08 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:08.941069 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ee596-52b5-468d-bb08-e61a73018cde None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:09.040243 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ee596-52b5-468d-bb08-e61a73018cde None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:09.074595 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51401780-362f-47de-b112-a4be4428ac45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:09.075251 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51401780-362f-47de-b112-a4be4428ac45 None admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:09.075538 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51401780-362f-47de-b112-a4be4428ac45 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:09.075816 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51401780-362f-47de-b112-a4be4428ac45 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:09.076537 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51401780-362f-47de-b112-a4be4428ac45 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:09.077902 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51401780-362f-47de-b112-a4be4428ac45 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:09.195076 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 508/1016] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:31:08 2022] POST /identity/v3/endpoints => generated 334 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:31:09.276689 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0959e-4922-4739-be1e-ed009c380563 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:09.276689 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0959e-4922-4739-be1e-ed009c380563 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:09.276689 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0959e-4922-4739-be1e-ed009c380563 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:09.277265 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 509/1017] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:31:09.282648 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427f6d5-551f-40ef-9cb2-9dacc7ced8bd None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:09.282944 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427f6d5-551f-40ef-9cb2-9dacc7ced8bd None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:09.283255 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427f6d5-551f-40ef-9cb2-9dacc7ced8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:09.301858 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-2427f6d5-551f-40ef-9cb2-9dacc7ced8bd None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:09.303201 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-2427f6d5-551f-40ef-9cb2-9dacc7ced8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:09.327684 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:09.391036 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 509/1018] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:31:09 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:31:09.408767 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0959e-4922-4739-be1e-ed009c380563 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:09.515281 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0959e-4922-4739-be1e-ed009c380563 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:09.550200 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe215c7c-3760-4149-af95-37585938d2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:09.550872 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe215c7c-3760-4149-af95-37585938d2e3 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:09.551180 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe215c7c-3760-4149-af95-37585938d2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:09.551461 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe215c7c-3760-4149-af95-37585938d2e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:09.552740 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe215c7c-3760-4149-af95-37585938d2e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:09.554232 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe215c7c-3760-4149-af95-37585938d2e3 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:09.558997 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 510/1019] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:31:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:31:09.562270 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427f6d5-551f-40ef-9cb2-9dacc7ced8bd None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:09.665935 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427f6d5-551f-40ef-9cb2-9dacc7ced8bd None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:09.701572 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c72b0c7-9a85-497c-b9d3-fdd410372952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:09.702454 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72b0c7-9a85-497c-b9d3-fdd410372952 None admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:09.702936 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72b0c7-9a85-497c-b9d3-fdd410372952 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:09.703420 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72b0c7-9a85-497c-b9d3-fdd410372952 None admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:09.704271 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c72b0c7-9a85-497c-b9d3-fdd410372952 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:09.705957 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c72b0c7-9a85-497c-b9d3-fdd410372952 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:09.807976 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 510/1020] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Aug 5 02:31:09 2022] POST /identity/v3/projects => generated 311 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:31:10.471349 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ccef8-0671-485c-85b3-d6886e4f4441 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:10.471888 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ccef8-0671-485c-85b3-d6886e4f4441 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:10.471888 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ccef8-0671-485c-85b3-d6886e4f4441 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:10.473451 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 511/1021] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:31:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:31:10.478649 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92cf8c9-147e-4d9f-9dd0-74c62eb22b7f None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:10.479059 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92cf8c9-147e-4d9f-9dd0-74c62eb22b7f None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:10.479257 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92cf8c9-147e-4d9f-9dd0-74c62eb22b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:10.492266 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:10.497950 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-a92cf8c9-147e-4d9f-9dd0-74c62eb22b7f None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:10.499178 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-a92cf8c9-147e-4d9f-9dd0-74c62eb22b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:10.571069 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 511/1022] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:31:10 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:31:10.590449 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ccef8-0671-485c-85b3-d6886e4f4441 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:10.605845 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:10.692002 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ccef8-0671-485c-85b3-d6886e4f4441 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:10.725266 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576f769-50c2-450f-8f11-6f7c9e839acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:10.725899 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576f769-50c2-450f-8f11-6f7c9e839acc None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:10.726192 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576f769-50c2-450f-8f11-6f7c9e839acc None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:10.726457 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576f769-50c2-450f-8f11-6f7c9e839acc None admin] PATH_INFO: `/v3/services/image` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:10.727098 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6576f769-50c2-450f-8f11-6f7c9e839acc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:10.728467 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6576f769-50c2-450f-8f11-6f7c9e839acc None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:10.737226 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-6576f769-50c2-450f-8f11-6f7c9e839acc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 02:31:10.737226 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:10.737226 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:31:10.737226 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:31:10.737226 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:31:10.737226 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:31:10.737226 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:31:10.737226 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:31:10.737226 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 02:31:10.737226 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:31:10.737226 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:31:10.737226 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:31:10.737226 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:10.737226 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:31:10.737226 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:31:10.737226 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:31:10.737226 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:31:10.738241 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:31:10.738241 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:31:10.738241 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:31:10.738241 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:31:10.738241 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:31:10.738241 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:31:10.738241 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:31:10.738241 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:31:10.738241 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:31:10.738241 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:31:10.738241 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:31:10.738241 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:31:10.738241 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:31:10.738241 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:31:10.738241 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:31:10.738241 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:31:10.739122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:31:10.739122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:31:10.739122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:31:10.739122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:31:10.739122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:31:10.739122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:31:10.739122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:31:10.739122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:31:10.739122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:31:10.739122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:31:10.739122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:31:10.739122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:31:10.739122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 02:31:10.739122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:31:10.740544 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 512/1023] 10.222.0.42 () {56 vars in 1105 bytes} [Fri Aug 5 02:31:10 2022] GET /identity/v3/services/image => generated 86 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:31:10.744289 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92cf8c9-147e-4d9f-9dd0-74c62eb22b7f None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:10.845021 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92cf8c9-147e-4d9f-9dd0-74c62eb22b7f None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:10.878964 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56d93b-b2ba-4c70-acb4-1cfbbf4fdea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:10.879618 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56d93b-b2ba-4c70-acb4-1cfbbf4fdea8 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:10.879904 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56d93b-b2ba-4c70-acb4-1cfbbf4fdea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:10.880184 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56d93b-b2ba-4c70-acb4-1cfbbf4fdea8 None admin] PATH_INFO: `/v3/services` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:10.880869 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d56d93b-b2ba-4c70-acb4-1cfbbf4fdea8 None admin] RBAC: Adding query filter params (name=image) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:10.881178 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d56d93b-b2ba-4c70-acb4-1cfbbf4fdea8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:10.882557 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d56d93b-b2ba-4c70-acb4-1cfbbf4fdea8 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:10.884440 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:10.893821 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 512/1024] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:31:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:31:10.895011 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576f769-50c2-450f-8f11-6f7c9e839acc None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:10.978394 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:11.002219 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576f769-50c2-450f-8f11-6f7c9e839acc None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:11.039861 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434b396-54b4-45e4-9e22-bea2d079ff7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:11.040493 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434b396-54b4-45e4-9e22-bea2d079ff7a None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:11.040778 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434b396-54b4-45e4-9e22-bea2d079ff7a None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:11.041058 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434b396-54b4-45e4-9e22-bea2d079ff7a None admin] PATH_INFO: `/v3/services` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:11.041730 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2434b396-54b4-45e4-9e22-bea2d079ff7a None admin] RBAC: Adding query filter params (type=image) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:11.042039 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2434b396-54b4-45e4-9e22-bea2d079ff7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:11.043472 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2434b396-54b4-45e4-9e22-bea2d079ff7a None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:11.053499 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 513/1025] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:31:10 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:31:11.054696 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56d93b-b2ba-4c70-acb4-1cfbbf4fdea8 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:11.166678 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56d93b-b2ba-4c70-acb4-1cfbbf4fdea8 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:11.203805 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cadb66-31c5-4a40-8f90-9630e97891fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:11.205110 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cadb66-31c5-4a40-8f90-9630e97891fc None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:11.205405 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cadb66-31c5-4a40-8f90-9630e97891fc None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:11.205679 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cadb66-31c5-4a40-8f90-9630e97891fc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:11.206436 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cadb66-31c5-4a40-8f90-9630e97891fc None admin] RBAC: Adding query filter params (interface=public, service_id=74a75b210ee8446483db3d71f283a990, region_id=RegionOne) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:11.206747 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cadb66-31c5-4a40-8f90-9630e97891fc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:11.208158 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cadb66-31c5-4a40-8f90-9630e97891fc None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:11.217537 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 513/1026] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Aug 5 02:31:11 2022] GET /identity/v3/endpoints?service_id=74a75b210ee8446483db3d71f283a990&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:31:11.218880 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434b396-54b4-45e4-9e22-bea2d079ff7a None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:11.325564 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc1435-aa8c-4611-ac6c-09f291e8b3fd None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:11.325920 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc1435-aa8c-4611-ac6c-09f291e8b3fd None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:11.326396 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc1435-aa8c-4611-ac6c-09f291e8b3fd None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:11.327867 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 514/1027] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:31:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:31:11.331593 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434b396-54b4-45e4-9e22-bea2d079ff7a None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:11.335011 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f32d7-1092-4c0c-a2cc-48cec818fdef None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:11.335304 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f32d7-1092-4c0c-a2cc-48cec818fdef None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:11.335584 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f32d7-1092-4c0c-a2cc-48cec818fdef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:11.355326 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-570f32d7-1092-4c0c-a2cc-48cec818fdef None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:11.356504 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-570f32d7-1092-4c0c-a2cc-48cec818fdef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:11.366919 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8d838-0a00-480d-8f06-aa9285b69e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:11.367676 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8d838-0a00-480d-8f06-aa9285b69e38 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:11.367961 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8d838-0a00-480d-8f06-aa9285b69e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:11.368230 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8d838-0a00-480d-8f06-aa9285b69e38 None admin] PATH_INFO: `/v3/services` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:11.368879 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8d838-0a00-480d-8f06-aa9285b69e38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:11.370373 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8d838-0a00-480d-8f06-aa9285b69e38 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:11.378291 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 514/1028] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Aug 5 02:31:11 2022] GET /identity/v3/services => generated 1957 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:31:11.431317 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:11.441114 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 515/1029] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:31:11 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:31:11.465107 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8d838-0a00-480d-8f06-aa9285b69e38 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:11.469257 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:11.574044 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8d838-0a00-480d-8f06-aa9285b69e38 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:11.608714 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15c740-df18-4ebb-8458-aaa9b8b5f69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:11.609591 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15c740-df18-4ebb-8458-aaa9b8b5f69f None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:11.610024 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15c740-df18-4ebb-8458-aaa9b8b5f69f None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:11.610447 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15c740-df18-4ebb-8458-aaa9b8b5f69f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:11.620981 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd15c740-df18-4ebb-8458-aaa9b8b5f69f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:31:11.627083 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-dd15c740-df18-4ebb-8458-aaa9b8b5f69f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 02:31:11.627083 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:11.627083 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:31:11.627083 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:31:11.627083 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:31:11.627083 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:31:11.627083 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:31:11.627083 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:31:11.627083 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:31:11.627083 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:31:11.627083 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:31:11.627083 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:31:11.627083 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:31:11.627083 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:31:11.627083 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:31:11.627083 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:31:11.628227 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:31:11.628227 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:31:11.628227 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:31:11.628227 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:31:11.628227 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:31:11.628227 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:31:11.628227 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:31:11.628227 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:31:11.628227 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:31:11.628227 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:31:11.628227 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:31:11.628227 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:31:11.628227 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:31:11.628227 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:31:11.628227 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:31:11.628227 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:31:11.629289 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:31:11.629289 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:31:11.629289 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:31:11.629289 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:31:11.629289 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:31:11.629289 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:31:11.629289 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:31:11.629289 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:31:11.629289 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:31:11.629289 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:31:11.629289 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 02:31:11.629289 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:31:11.631627 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 515/1030] 10.222.0.42 () {56 vars in 1120 bytes} [Fri Aug 5 02:31:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:31:11.637764 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f32d7-1092-4c0c-a2cc-48cec818fdef None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:11.745470 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f32d7-1092-4c0c-a2cc-48cec818fdef None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:11.780344 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d6fa7-c1d8-43e7-8282-d39ea7992404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:11.780976 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d6fa7-c1d8-43e7-8282-d39ea7992404 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:11.781259 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d6fa7-c1d8-43e7-8282-d39ea7992404 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:11.781536 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d6fa7-c1d8-43e7-8282-d39ea7992404 None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:11.782255 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d6fa7-c1d8-43e7-8282-d39ea7992404 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:11.782591 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d6fa7-c1d8-43e7-8282-d39ea7992404 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:11.783994 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d6fa7-c1d8-43e7-8282-d39ea7992404 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:11.792528 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 516/1031] 10.222.0.42 () {56 vars in 1115 bytes} [Fri Aug 5 02:31:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:11.798011 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15c740-df18-4ebb-8458-aaa9b8b5f69f None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:11.861968 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462179c-e26c-4352-a1cf-9bab3767ad94 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:11.862268 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462179c-e26c-4352-a1cf-9bab3767ad94 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:11.862547 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462179c-e26c-4352-a1cf-9bab3767ad94 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:11.863515 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:11.863923 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 517/1032] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:31:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:31:11.868869 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c501c1-6b57-4365-8990-2faf16abac7c None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:11.869157 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c501c1-6b57-4365-8990-2faf16abac7c None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:11.869497 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c501c1-6b57-4365-8990-2faf16abac7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:11.889580 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-29c501c1-6b57-4365-8990-2faf16abac7c None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:11.890775 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-29c501c1-6b57-4365-8990-2faf16abac7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:11.904616 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15c740-df18-4ebb-8458-aaa9b8b5f69f None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:11.948562 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d06729-24e9-4a45-a6b6-ad7e2f4558f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:11.951314 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d06729-24e9-4a45-a6b6-ad7e2f4558f2 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:11.951314 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d06729-24e9-4a45-a6b6-ad7e2f4558f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:11.951314 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d06729-24e9-4a45-a6b6-ad7e2f4558f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:11.952978 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:11.961345 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d06729-24e9-4a45-a6b6-ad7e2f4558f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:11.965999 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d06729-24e9-4a45-a6b6-ad7e2f4558f2 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:11.971000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 518/1033] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:31:11 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 02:31:11.981713 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-55d06729-24e9-4a45-a6b6-ad7e2f4558f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:31:11.981713 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:11.981713 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:31:11.981713 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:31:11.981713 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:31:11.981713 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:31:11.981713 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:31:11.981713 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:31:11.981713 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:31:11.981713 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:31:11.981713 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:31:11.981713 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:31:11.981713 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:31:11.981713 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:31:11.981713 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:31:11.982622 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:31:11.982622 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:31:11.982622 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:31:11.982622 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:31:11.982622 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:31:11.982622 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:31:11.982622 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:31:11.982622 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:31:11.982622 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:31:11.982622 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:31:11.982622 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:31:11.982622 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:31:11.982622 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:31:11.982622 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:31:11.982622 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:31:11.982622 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:31:11.982622 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:31:11.983596 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:31:11.983596 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:31:11.983596 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:31:11.983596 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:31:11.983596 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 516/1034] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:31:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:31:11.990505 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c501c1-6b57-4365-8990-2faf16abac7c None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:11.998579 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d06729-24e9-4a45-a6b6-ad7e2f4558f2 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:12.100038 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c501c1-6b57-4365-8990-2faf16abac7c None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:12.113190 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d06729-24e9-4a45-a6b6-ad7e2f4558f2 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:12.129213 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:12.140807 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad19bd-5e33-42c3-8112-37cf3d046b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:12.141436 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad19bd-5e33-42c3-8112-37cf3d046b53 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:12.141719 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad19bd-5e33-42c3-8112-37cf3d046b53 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:12.142023 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad19bd-5e33-42c3-8112-37cf3d046b53 None admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:12.142720 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad19bd-5e33-42c3-8112-37cf3d046b53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:12.143058 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad19bd-5e33-42c3-8112-37cf3d046b53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:12.144439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad19bd-5e33-42c3-8112-37cf3d046b53 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:12.147634 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404e1f3-5b2e-4480-b89e-e115e8757426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:12.148667 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404e1f3-5b2e-4480-b89e-e115e8757426 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:12.149315 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404e1f3-5b2e-4480-b89e-e115e8757426 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:12.150040 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404e1f3-5b2e-4480-b89e-e115e8757426 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:12.151551 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6404e1f3-5b2e-4480-b89e-e115e8757426 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:12.152719 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6404e1f3-5b2e-4480-b89e-e115e8757426 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:12.154466 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 517/1035] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:31:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:31:12.161848 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 519/1036] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:31:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:12.162009 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404e1f3-5b2e-4480-b89e-e115e8757426 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:12.162862 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad19bd-5e33-42c3-8112-37cf3d046b53 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:12.210690 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:12.264366 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404e1f3-5b2e-4480-b89e-e115e8757426 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:12.266705 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad19bd-5e33-42c3-8112-37cf3d046b53 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:12.302883 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36962333-1532-433a-a08f-7b6e777bccc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:12.303825 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36962333-1532-433a-a08f-7b6e777bccc2 None admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:12.304125 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36962333-1532-433a-a08f-7b6e777bccc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:12.304400 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36962333-1532-433a-a08f-7b6e777bccc2 None admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:12.305372 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36962333-1532-433a-a08f-7b6e777bccc2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:12.306546 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36962333-1532-433a-a08f-7b6e777bccc2 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:12.317715 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ef19e-3ecc-41cb-bbd2-e01c84107bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:12.318570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ef19e-3ecc-41cb-bbd2-e01c84107bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:12.318769 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ef19e-3ecc-41cb-bbd2-e01c84107bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:12.319077 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ef19e-3ecc-41cb-bbd2-e01c84107bd4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:12.327395 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ef19e-3ecc-41cb-bbd2-e01c84107bd4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:12.328878 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ef19e-3ecc-41cb-bbd2-e01c84107bd4 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:12.340152 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-f81ef19e-3ecc-41cb-bbd2-e01c84107bd4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 02:31:12.340152 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:12.340152 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:31:12.340152 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:31:12.340152 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:31:12.340152 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:31:12.340152 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:31:12.340152 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:31:12.340152 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:31:12.340152 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:31:12.340152 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:31:12.340152 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:31:12.340152 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:31:12.340152 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:31:12.340152 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:31:12.340152 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:31:12.341214 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:31:12.341214 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:31:12.341214 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:31:12.341214 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:31:12.341214 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:31:12.341214 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:31:12.341214 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:31:12.341214 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:31:12.341214 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:31:12.341214 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:31:12.341214 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:31:12.341214 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:31:12.341214 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:31:12.341214 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:31:12.341214 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:31:12.341214 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:31:12.341214 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:31:12.341214 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:31:12.342177 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:31:12.342177 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:31:12.342177 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:31:12.342177 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:31:12.342177 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:31:12.342177 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:31:12.342177 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:31:12.342177 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:31:12.342177 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 02:31:12.342177 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:31:12.342177 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 520/1037] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Aug 5 02:31:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:31:12.347485 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ef19e-3ecc-41cb-bbd2-e01c84107bd4 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:12.387047 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 518/1038] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 5 02:31:12 2022] POST /identity/v3/users => generated 285 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:31:12.458315 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ef19e-3ecc-41cb-bbd2-e01c84107bd4 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:12.465869 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:12.495647 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc946c5-a1d5-431f-86e2-762519f9a430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:12.496292 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc946c5-a1d5-431f-86e2-762519f9a430 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:12.496578 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc946c5-a1d5-431f-86e2-762519f9a430 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:12.496856 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc946c5-a1d5-431f-86e2-762519f9a430 None admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:12.497673 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc946c5-a1d5-431f-86e2-762519f9a430 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:12.497983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc946c5-a1d5-431f-86e2-762519f9a430 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:12.499489 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc946c5-a1d5-431f-86e2-762519f9a430 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:12.521149 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 521/1039] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Aug 5 02:31:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:31:12.527233 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36962333-1532-433a-a08f-7b6e777bccc2 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:12.574546 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:12.647864 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36962333-1532-433a-a08f-7b6e777bccc2 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:12.683004 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac919201-cf71-4759-948d-926ad7f2bb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:12.683628 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac919201-cf71-4759-948d-926ad7f2bb29 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:12.683908 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac919201-cf71-4759-948d-926ad7f2bb29 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:12.684184 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac919201-cf71-4759-948d-926ad7f2bb29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:12.752725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac919201-cf71-4759-948d-926ad7f2bb29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:12.754190 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac919201-cf71-4759-948d-926ad7f2bb29 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:12.795754 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:12.854544 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 519/1040] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:31:12 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 02:31:12.860070 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc946c5-a1d5-431f-86e2-762519f9a430 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:12.959526 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc946c5-a1d5-431f-86e2-762519f9a430 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:12.994016 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d87efc-ae1f-472d-8d49-5751b1fe5b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:12.994664 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d87efc-ae1f-472d-8d49-5751b1fe5b5b None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:12.994944 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d87efc-ae1f-472d-8d49-5751b1fe5b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:12.995242 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d87efc-ae1f-472d-8d49-5751b1fe5b5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:13.005315 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d87efc-ae1f-472d-8d49-5751b1fe5b5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:13.006761 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d87efc-ae1f-472d-8d49-5751b1fe5b5b None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:13.021196 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-63d87efc-ae1f-472d-8d49-5751b1fe5b5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:31:13.021196 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:13.021196 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:31:13.021196 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:31:13.021196 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:31:13.021196 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:31:13.021196 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:31:13.021196 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:31:13.021196 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:31:13.021196 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:31:13.021196 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:31:13.021196 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:31:13.021196 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:31:13.021196 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:31:13.021196 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:31:13.022148 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:31:13.022148 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:31:13.022148 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:31:13.022148 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:31:13.022148 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:31:13.022148 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:31:13.022148 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:31:13.022148 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:31:13.022148 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:31:13.022148 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:31:13.022148 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:31:13.022148 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:31:13.022148 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:31:13.022148 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:31:13.022148 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:31:13.022148 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:31:13.022148 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:31:13.023120 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:31:13.023120 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:31:13.023120 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:31:13.023120 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:31:13.023944 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 522/1041] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:31:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:31:13.028033 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac919201-cf71-4759-948d-926ad7f2bb29 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:13.128067 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac919201-cf71-4759-948d-926ad7f2bb29 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:13.161797 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635fde24-d57f-47a6-beaf-cf12e2656ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:13.162417 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635fde24-d57f-47a6-beaf-cf12e2656ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:13.162701 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635fde24-d57f-47a6-beaf-cf12e2656ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:13.162999 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635fde24-d57f-47a6-beaf-cf12e2656ba5 None admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:13.163749 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635fde24-d57f-47a6-beaf-cf12e2656ba5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:13.164005 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635fde24-d57f-47a6-beaf-cf12e2656ba5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:13.165383 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635fde24-d57f-47a6-beaf-cf12e2656ba5 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:13.176282 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:13.182982 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 520/1042] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:31:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:31:13.197521 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d87efc-ae1f-472d-8d49-5751b1fe5b5b None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:13.211194 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:13.298332 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d87efc-ae1f-472d-8d49-5751b1fe5b5b None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:13.331455 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb0b3c-0e5f-4e13-8146-a4d0a0986e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:13.332096 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb0b3c-0e5f-4e13-8146-a4d0a0986e74 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:13.332380 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb0b3c-0e5f-4e13-8146-a4d0a0986e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:13.332656 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb0b3c-0e5f-4e13-8146-a4d0a0986e74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:13.339206 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb0b3c-0e5f-4e13-8146-a4d0a0986e74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:13.340657 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb0b3c-0e5f-4e13-8146-a4d0a0986e74 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:13.352583 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-04cb0b3c-0e5f-4e13-8146-a4d0a0986e74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:31:13.352583 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:13.352583 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:31:13.352583 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:31:13.352583 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:31:13.352583 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:31:13.352583 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:31:13.352583 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:31:13.352583 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:31:13.352583 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:31:13.352583 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:31:13.352583 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:31:13.352583 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:31:13.352583 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:31:13.352583 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:31:13.353474 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:31:13.353474 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:31:13.353474 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:31:13.353474 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:31:13.353474 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:31:13.353474 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:31:13.353474 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:31:13.353474 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:31:13.353474 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:31:13.353474 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:31:13.353474 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:31:13.353474 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:31:13.353474 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:31:13.353474 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:31:13.353474 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:31:13.353474 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:31:13.353474 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:31:13.354452 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:31:13.354452 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:31:13.354452 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:31:13.354452 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:31:13.354452 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:31:13.354452 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:31:13.354452 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:31:13.354452 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:31:13.355490 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 523/1043] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:31:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:31:13.359566 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635fde24-d57f-47a6-beaf-cf12e2656ba5 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:13.442434 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e480d-a3a5-4553-a9ad-0b24370bdb22 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:13.443146 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e480d-a3a5-4553-a9ad-0b24370bdb22 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:13.443448 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e480d-a3a5-4553-a9ad-0b24370bdb22 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:13.445243 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 524/1044] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:31:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:31:13.450201 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b8d86-1d13-4afe-aef8-bce0e498ce65 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:13.450493 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b8d86-1d13-4afe-aef8-bce0e498ce65 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:13.450775 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b8d86-1d13-4afe-aef8-bce0e498ce65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:13.462889 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635fde24-d57f-47a6-beaf-cf12e2656ba5 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:13.471491 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-f23b8d86-1d13-4afe-aef8-bce0e498ce65 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:13.473079 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-f23b8d86-1d13-4afe-aef8-bce0e498ce65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:13.498455 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c51779-2acf-42a2-ae16-dcf43c0716a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:13.499106 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c51779-2acf-42a2-ae16-dcf43c0716a2 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:13.499389 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c51779-2acf-42a2-ae16-dcf43c0716a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:13.499661 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c51779-2acf-42a2-ae16-dcf43c0716a2 None admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:13.500523 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c51779-2acf-42a2-ae16-dcf43c0716a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:13.500945 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c51779-2acf-42a2-ae16-dcf43c0716a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:13.502389 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c51779-2acf-42a2-ae16-dcf43c0716a2 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:13.519302 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 521/1045] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 5 02:31:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:13.522112 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c51779-2acf-42a2-ae16-dcf43c0716a2 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:13.542106 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 525/1046] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:31:13 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 02:31:13.564601 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b8d86-1d13-4afe-aef8-bce0e498ce65 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:13.574510 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:13.588250 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:13.630166 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c51779-2acf-42a2-ae16-dcf43c0716a2 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:13.665611 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b999e46-c072-4602-a6df-1ae7022894ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:13.666229 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b999e46-c072-4602-a6df-1ae7022894ee None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:13.666582 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b999e46-c072-4602-a6df-1ae7022894ee None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:13.666783 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b999e46-c072-4602-a6df-1ae7022894ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:13.667597 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b999e46-c072-4602-a6df-1ae7022894ee None admin] RBAC: Adding query filter params (role.id=c14dbbd7897245a18070be9be19c278b, scope.project.id=63b323c02a614fc28aac6e7a060064ba, user.id=55374d3bccd541c9a8f82da9b21c2fb8) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:13.667905 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b999e46-c072-4602-a6df-1ae7022894ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:13.669356 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b999e46-c072-4602-a6df-1ae7022894ee None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:13.675013 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 522/1047] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:31:13 2022] GET /identity/v3/role_assignments?user.id=55374d3bccd541c9a8f82da9b21c2fb8&scope.project.id=63b323c02a614fc28aac6e7a060064ba&role.id=c14dbbd7897245a18070be9be19c278b => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:13.686446 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b8d86-1d13-4afe-aef8-bce0e498ce65 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:13.725563 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abcedae-e543-4414-8a16-ee51618a4ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:13.726148 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcedae-e543-4414-8a16-ee51618a4ebd None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:13.726432 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcedae-e543-4414-8a16-ee51618a4ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:13.726709 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcedae-e543-4414-8a16-ee51618a4ebd None admin] PATH_INFO: `/v3/services/image` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:13.727394 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abcedae-e543-4414-8a16-ee51618a4ebd None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:13.728825 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abcedae-e543-4414-8a16-ee51618a4ebd None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:13.738793 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-0abcedae-e543-4414-8a16-ee51618a4ebd None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 02:31:13.738793 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:13.738793 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:31:13.738793 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:31:13.738793 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:31:13.738793 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:31:13.738793 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:31:13.738793 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:31:13.738793 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 02:31:13.738793 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:31:13.738793 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:31:13.738793 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:31:13.738793 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:13.738793 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:31:13.738793 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:31:13.738793 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:31:13.738793 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:31:13.739894 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:31:13.739894 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:31:13.739894 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:31:13.739894 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:31:13.739894 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:31:13.739894 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:31:13.739894 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:31:13.739894 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:31:13.739894 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:31:13.739894 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:31:13.739894 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:31:13.739894 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:31:13.739894 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:31:13.739894 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:31:13.739894 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:31:13.739894 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:31:13.746286 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:31:13.746286 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:31:13.746286 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:31:13.746286 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:31:13.746286 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:31:13.746286 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:31:13.746286 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:31:13.746286 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:31:13.746286 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:31:13.746286 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:31:13.746286 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:31:13.746286 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:31:13.746286 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 02:31:13.746286 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:31:13.746286 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 526/1048] 10.222.0.42 () {56 vars in 1105 bytes} [Fri Aug 5 02:31:13 2022] GET /identity/v3/services/image => generated 86 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:31:13.748866 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b999e46-c072-4602-a6df-1ae7022894ee None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:13.856108 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b999e46-c072-4602-a6df-1ae7022894ee None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:13.878943 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:13.889834 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42767bd-4d71-4561-b17f-489040282c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:13.890452 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42767bd-4d71-4561-b17f-489040282c7e None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:13.890727 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42767bd-4d71-4561-b17f-489040282c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:13.899693 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42767bd-4d71-4561-b17f-489040282c7e None admin] PATH_INFO: `/v3/services` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:13.899693 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42767bd-4d71-4561-b17f-489040282c7e None admin] RBAC: Adding query filter params (name=image) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:13.899693 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42767bd-4d71-4561-b17f-489040282c7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:13.899693 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42767bd-4d71-4561-b17f-489040282c7e None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:13.899693 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 523/1049] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:31:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:31:13.903727 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abcedae-e543-4414-8a16-ee51618a4ebd None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:13.983251 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:14.014873 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abcedae-e543-4414-8a16-ee51618a4ebd None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:14.048765 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a08b0-0aef-47c0-87fa-e6f4cbbc2e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:14.049392 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a08b0-0aef-47c0-87fa-e6f4cbbc2e11 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:14.049674 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a08b0-0aef-47c0-87fa-e6f4cbbc2e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:14.049951 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a08b0-0aef-47c0-87fa-e6f4cbbc2e11 None admin] PATH_INFO: `/v3/services` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:14.050627 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a08b0-0aef-47c0-87fa-e6f4cbbc2e11 None admin] RBAC: Adding query filter params (type=image) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:14.050930 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a08b0-0aef-47c0-87fa-e6f4cbbc2e11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:14.052330 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a08b0-0aef-47c0-87fa-e6f4cbbc2e11 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:14.062201 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 527/1050] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:31:13 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:14.063501 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42767bd-4d71-4561-b17f-489040282c7e None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:14.167546 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42767bd-4d71-4561-b17f-489040282c7e None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:14.201265 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf346f-4841-4e11-9111-eaeb5b1fa436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:14.201890 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf346f-4841-4e11-9111-eaeb5b1fa436 None admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:14.202175 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf346f-4841-4e11-9111-eaeb5b1fa436 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:14.202461 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf346f-4841-4e11-9111-eaeb5b1fa436 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:14.203192 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf346f-4841-4e11-9111-eaeb5b1fa436 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:14.205110 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf346f-4841-4e11-9111-eaeb5b1fa436 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:14.321130 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 524/1051] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:31:14 2022] POST /identity/v3/endpoints => generated 327 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:31:14.514103 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059bc13-b246-425a-88a4-8d3a90634ef7 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:14.514466 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059bc13-b246-425a-88a4-8d3a90634ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:14.514669 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059bc13-b246-425a-88a4-8d3a90634ef7 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:14.516075 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 528/1052] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:31:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:31:14.522139 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447200d-52e6-45ff-b1c3-cb2aa801a907 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:14.522449 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447200d-52e6-45ff-b1c3-cb2aa801a907 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:14.522777 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447200d-52e6-45ff-b1c3-cb2aa801a907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:14.540808 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-3447200d-52e6-45ff-b1c3-cb2aa801a907 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:14.541976 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-3447200d-52e6-45ff-b1c3-cb2aa801a907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:14.596703 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:14.629984 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 525/1053] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:31:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:31:14.653322 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e059bc13-b246-425a-88a4-8d3a90634ef7 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:14.758904 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e059bc13-b246-425a-88a4-8d3a90634ef7 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:14.793710 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03022bd-4fa4-4733-bac0-1da2eda422b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:14.794285 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03022bd-4fa4-4733-bac0-1da2eda422b4 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:14.794568 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03022bd-4fa4-4733-bac0-1da2eda422b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:14.794901 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03022bd-4fa4-4733-bac0-1da2eda422b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:14.796831 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:14.808806 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03022bd-4fa4-4733-bac0-1da2eda422b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:31:14.814445 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-c03022bd-4fa4-4733-bac0-1da2eda422b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:31:14.814445 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:14.814445 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:31:14.814445 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:31:14.814445 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:31:14.814445 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:31:14.814445 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:31:14.814445 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:31:14.814445 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:31:14.814445 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:31:14.814445 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:31:14.814445 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:31:14.814445 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:31:14.814445 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:31:14.814445 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:31:14.814445 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:31:14.815741 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:31:14.815741 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:31:14.815741 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:31:14.815741 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:31:14.815741 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:31:14.815741 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:31:14.815741 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:31:14.815741 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:31:14.815741 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:31:14.815741 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:31:14.815741 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:31:14.815741 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:31:14.815741 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:31:14.815741 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:31:14.815741 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:31:14.815741 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:31:14.821662 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:31:14.821662 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:31:14.821662 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:31:14.821662 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:31:14.821662 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:31:14.821662 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:31:14.821662 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:31:14.821662 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:31:14.821662 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:31:14.821662 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:31:14.821662 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:31:14.821662 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:31:14.821662 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 529/1054] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 5 02:31:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:31:14.824082 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447200d-52e6-45ff-b1c3-cb2aa801a907 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:14.922869 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447200d-52e6-45ff-b1c3-cb2aa801a907 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:14.956710 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e20c20-690b-4285-84d9-68417bf33858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:14.957319 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e20c20-690b-4285-84d9-68417bf33858 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:14.957596 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e20c20-690b-4285-84d9-68417bf33858 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:14.957863 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e20c20-690b-4285-84d9-68417bf33858 None admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:14.958560 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e20c20-690b-4285-84d9-68417bf33858 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:14.958858 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e20c20-690b-4285-84d9-68417bf33858 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:14.960247 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e20c20-690b-4285-84d9-68417bf33858 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:14.968368 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 526/1055] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:31:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:14.974448 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03022bd-4fa4-4733-bac0-1da2eda422b4 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:15.076145 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03022bd-4fa4-4733-bac0-1da2eda422b4 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:15.110311 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f34fd-e324-4c56-b0b7-eb5429ba2fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:15.111501 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f34fd-e324-4c56-b0b7-eb5429ba2fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:15.111786 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f34fd-e324-4c56-b0b7-eb5429ba2fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:15.112064 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f34fd-e324-4c56-b0b7-eb5429ba2fe1 None admin] PATH_INFO: `/v3/users/8015abdd4acf45f1beb2dfeb69a552a0` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:15.125242 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f34fd-e324-4c56-b0b7-eb5429ba2fe1 None admin] RBAC: Authorizing `identity:get_user(user_id=8015abdd4acf45f1beb2dfeb69a552a0)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:15.126717 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f34fd-e324-4c56-b0b7-eb5429ba2fe1 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:15.133025 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 530/1056] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:31:14 2022] GET /identity/v3/users/8015abdd4acf45f1beb2dfeb69a552a0 => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:15.134551 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e20c20-690b-4285-84d9-68417bf33858 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:15.167242 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:15.239119 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e20c20-690b-4285-84d9-68417bf33858 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:15.281658 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae8c9d-e69c-431d-9163-913251087016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:15.282816 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae8c9d-e69c-431d-9163-913251087016 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:15.283128 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae8c9d-e69c-431d-9163-913251087016 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:15.283401 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae8c9d-e69c-431d-9163-913251087016 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:15.350638 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ae8c9d-e69c-431d-9163-913251087016 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:15.352039 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ae8c9d-e69c-431d-9163-913251087016 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:15.381746 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:15.451340 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 527/1057] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:31:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 02:31:15.458036 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f34fd-e324-4c56-b0b7-eb5429ba2fe1 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:15.510082 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:15.557331 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f34fd-e324-4c56-b0b7-eb5429ba2fe1 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:15.590321 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65758fa-322b-4d6e-b9c0-35add24c14ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:15.590976 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65758fa-322b-4d6e-b9c0-35add24c14ed None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:15.591278 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65758fa-322b-4d6e-b9c0-35add24c14ed None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:15.591539 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65758fa-322b-4d6e-b9c0-35add24c14ed None admin] PATH_INFO: `/v3/projects/8bdee413c80b4a90b6f9461fabcf1614` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:15.592675 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65758fa-322b-4d6e-b9c0-35add24c14ed None admin] RBAC: Authorizing `identity:get_project(project_id=8bdee413c80b4a90b6f9461fabcf1614)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:15.594096 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65758fa-322b-4d6e-b9c0-35add24c14ed None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:15.596504 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 531/1058] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:31:15 2022] GET /identity/v3/projects/8bdee413c80b4a90b6f9461fabcf1614 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:15.602845 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae8c9d-e69c-431d-9163-913251087016 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:15.659155 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1332e-ceeb-4593-9549-8d4fa590b4f2 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:15.659494 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1332e-ceeb-4593-9549-8d4fa590b4f2 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:15.659702 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1332e-ceeb-4593-9549-8d4fa590b4f2 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:15.661170 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 532/1059] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:31:15.665776 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e76cf-9c87-4f91-a0df-bb35b19673fb None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:15.666078 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e76cf-9c87-4f91-a0df-bb35b19673fb None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:15.666348 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e76cf-9c87-4f91-a0df-bb35b19673fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:15.684313 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-909e76cf-9c87-4f91-a0df-bb35b19673fb None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:15.685511 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-909e76cf-9c87-4f91-a0df-bb35b19673fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:15.704895 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae8c9d-e69c-431d-9163-913251087016 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:15.735741 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:15.743351 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d4329-8ba3-4eba-ac05-b4e7add74570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:15.744138 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d4329-8ba3-4eba-ac05-b4e7add74570 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:15.744425 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d4329-8ba3-4eba-ac05-b4e7add74570 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:15.748927 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d4329-8ba3-4eba-ac05-b4e7add74570 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:15.748927 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d4329-8ba3-4eba-ac05-b4e7add74570 None admin] RBAC: Adding query filter params (role.id=83afe883a303495b966480fb9b5bb7dd, scope.project.id=8bdee413c80b4a90b6f9461fabcf1614, user.id=8015abdd4acf45f1beb2dfeb69a552a0) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:15.748927 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d4329-8ba3-4eba-ac05-b4e7add74570 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:15.748927 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d4329-8ba3-4eba-ac05-b4e7add74570 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:15.752652 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 528/1060] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:31:15 2022] GET /identity/v3/role_assignments?user.id=8015abdd4acf45f1beb2dfeb69a552a0&scope.project.id=8bdee413c80b4a90b6f9461fabcf1614&role.id=83afe883a303495b966480fb9b5bb7dd => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:15.754372 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 533/1061] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:31:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 02:31:15.778001 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d4329-8ba3-4eba-ac05-b4e7add74570 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:15.886341 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d4329-8ba3-4eba-ac05-b4e7add74570 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:15.922756 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c13da-6398-4787-8021-e0c0137c23bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:15.923464 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c13da-6398-4787-8021-e0c0137c23bd None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:15.923746 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c13da-6398-4787-8021-e0c0137c23bd None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:15.924016 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c13da-6398-4787-8021-e0c0137c23bd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:15.934214 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c13da-6398-4787-8021-e0c0137c23bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:31:15.940098 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-e68c13da-6398-4787-8021-e0c0137c23bd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 02:31:15.940098 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:15.940098 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:31:15.940098 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:31:15.940098 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:31:15.940098 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:31:15.940098 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:31:15.940098 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:31:15.940098 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:31:15.940098 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:31:15.940098 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:31:15.940098 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:31:15.940098 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:31:15.940098 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:31:15.940098 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:31:15.940098 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:31:15.941062 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:31:15.941062 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:31:15.941062 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:31:15.941062 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:31:15.941062 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:31:15.941062 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:31:15.941062 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:31:15.941062 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:31:15.941062 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:31:15.941062 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:31:15.941062 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:31:15.941062 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:31:15.941062 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:31:15.941062 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:31:15.941062 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:31:15.941062 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:31:15.941920 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:31:15.941920 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:31:15.941920 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:31:15.941920 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:31:15.941920 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:31:15.941920 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:31:15.941920 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:31:15.941920 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:31:15.941920 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:31:15.941920 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:31:15.941920 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 02:31:15.941920 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:31:15.941920 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 529/1062] 10.222.0.42 () {56 vars in 1120 bytes} [Fri Aug 5 02:31:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:31:15.949114 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e76cf-9c87-4f91-a0df-bb35b19673fb None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:15.999242 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:16.049163 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e76cf-9c87-4f91-a0df-bb35b19673fb None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:16.085042 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356787ca-8937-45da-920a-ae62d942bdf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:16.085664 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356787ca-8937-45da-920a-ae62d942bdf0 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:16.085946 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356787ca-8937-45da-920a-ae62d942bdf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:16.086217 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356787ca-8937-45da-920a-ae62d942bdf0 None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:16.086928 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356787ca-8937-45da-920a-ae62d942bdf0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:16.087257 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356787ca-8937-45da-920a-ae62d942bdf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:16.088619 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356787ca-8937-45da-920a-ae62d942bdf0 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:16.101406 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 534/1063] 10.222.0.42 () {56 vars in 1115 bytes} [Fri Aug 5 02:31:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:16.102631 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c13da-6398-4787-8021-e0c0137c23bd None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:16.159664 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:16.207329 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c13da-6398-4787-8021-e0c0137c23bd None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:16.243112 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767e999c-5779-47d8-b4ce-2c960d31204e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:16.244029 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e999c-5779-47d8-b4ce-2c960d31204e None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:16.244462 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e999c-5779-47d8-b4ce-2c960d31204e None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:16.244887 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e999c-5779-47d8-b4ce-2c960d31204e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:16.256512 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767e999c-5779-47d8-b4ce-2c960d31204e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:16.258250 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767e999c-5779-47d8-b4ce-2c960d31204e None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:16.273119 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-767e999c-5779-47d8-b4ce-2c960d31204e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:31:16.273119 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:16.273119 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:31:16.273119 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:31:16.273119 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:31:16.273119 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:31:16.273119 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:31:16.273119 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:31:16.273119 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:31:16.273119 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:31:16.273119 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:31:16.273119 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:31:16.273119 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:31:16.273119 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:31:16.273119 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:31:16.273962 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:31:16.273962 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:31:16.273962 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:31:16.273962 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:31:16.273962 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:31:16.273962 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:31:16.273962 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:31:16.273962 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:31:16.273962 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:31:16.273962 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:31:16.273962 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:31:16.273962 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:31:16.273962 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:31:16.273962 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:31:16.273962 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:31:16.273962 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:31:16.273962 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:31:16.274901 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:31:16.274901 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:31:16.274901 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:31:16.274901 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:31:16.280262 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356787ca-8937-45da-920a-ae62d942bdf0 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:16.283922 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 530/1064] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:31:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:31:16.365953 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1d536-6339-4af1-83bf-d2472dc973ea None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:16.366246 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1d536-6339-4af1-83bf-d2472dc973ea None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:16.366525 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1d536-6339-4af1-83bf-d2472dc973ea None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:16.367912 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 531/1065] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:31:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:31:16.373286 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a952d35-151c-45d9-9582-f07c8de49f85 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:16.373728 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a952d35-151c-45d9-9582-f07c8de49f85 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:16.374151 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a952d35-151c-45d9-9582-f07c8de49f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:16.386896 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356787ca-8937-45da-920a-ae62d942bdf0 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:16.398074 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-6a952d35-151c-45d9-9582-f07c8de49f85 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:16.399760 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-6a952d35-151c-45d9-9582-f07c8de49f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:16.400151 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:16.424116 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e105aeb-3fe1-478f-a14b-06df2d04c0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:16.424670 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e105aeb-3fe1-478f-a14b-06df2d04c0c9 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:16.424998 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e105aeb-3fe1-478f-a14b-06df2d04c0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:16.425280 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e105aeb-3fe1-478f-a14b-06df2d04c0c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:16.425988 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e105aeb-3fe1-478f-a14b-06df2d04c0c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:16.426297 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e105aeb-3fe1-478f-a14b-06df2d04c0c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:16.427700 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e105aeb-3fe1-478f-a14b-06df2d04c0c9 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:16.441534 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 535/1066] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:31:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:16.447243 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e105aeb-3fe1-478f-a14b-06df2d04c0c9 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:16.489267 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 532/1067] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:31:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 02:31:16.527404 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a952d35-151c-45d9-9582-f07c8de49f85 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:16.588537 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:16.592431 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e105aeb-3fe1-478f-a14b-06df2d04c0c9 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:16.644709 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214db1c6-76c7-4016-afa7-05589b5df661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:16.645715 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214db1c6-76c7-4016-afa7-05589b5df661 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:16.646176 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214db1c6-76c7-4016-afa7-05589b5df661 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:16.646636 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214db1c6-76c7-4016-afa7-05589b5df661 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:16.657985 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214db1c6-76c7-4016-afa7-05589b5df661 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:16.660329 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214db1c6-76c7-4016-afa7-05589b5df661 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:16.680239 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-214db1c6-76c7-4016-afa7-05589b5df661 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 02:31:16.680239 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:16.680239 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:31:16.680239 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:31:16.680239 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:31:16.680239 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:31:16.680239 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:31:16.680239 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:31:16.680239 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:31:16.680239 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:31:16.680239 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:31:16.680239 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:31:16.680239 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:31:16.680239 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:31:16.680239 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:31:16.680239 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:31:16.682238 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:31:16.682238 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:31:16.682238 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:31:16.682238 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:31:16.682238 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:31:16.682238 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:31:16.682238 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:31:16.682238 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:31:16.682238 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:31:16.682238 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:31:16.682238 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:31:16.682238 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:31:16.682238 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:31:16.682238 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:31:16.682238 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:31:16.682238 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:31:16.682238 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:31:16.682238 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:31:16.683534 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:31:16.683534 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:31:16.683534 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:31:16.683534 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:31:16.683534 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:31:16.683534 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:31:16.683534 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:31:16.683534 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:31:16.683534 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 02:31:16.683534 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:31:16.683534 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 536/1068] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Aug 5 02:31:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:31:16.685111 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a952d35-151c-45d9-9582-f07c8de49f85 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:16.688055 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214db1c6-76c7-4016-afa7-05589b5df661 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:16.736376 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:16.741734 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8da284-d244-4ef2-80c1-019b63679b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:16.742509 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8da284-d244-4ef2-80c1-019b63679b53 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:16.742994 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8da284-d244-4ef2-80c1-019b63679b53 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:16.743470 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8da284-d244-4ef2-80c1-019b63679b53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:16.844309 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214db1c6-76c7-4016-afa7-05589b5df661 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:16.851782 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8da284-d244-4ef2-80c1-019b63679b53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:16.853278 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8da284-d244-4ef2-80c1-019b63679b53 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:16.881760 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ea747-527b-438f-8a3b-03fb834dc7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:16.882573 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ea747-527b-438f-8a3b-03fb834dc7d2 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:16.882696 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ea747-527b-438f-8a3b-03fb834dc7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:16.882929 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ea747-527b-438f-8a3b-03fb834dc7d2 None admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:16.883822 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ea747-527b-438f-8a3b-03fb834dc7d2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:16.884084 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ea747-527b-438f-8a3b-03fb834dc7d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:16.885463 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ea747-527b-438f-8a3b-03fb834dc7d2 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:16.898489 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:16.904714 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 537/1069] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Aug 5 02:31:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:16.915684 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ea747-527b-438f-8a3b-03fb834dc7d2 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:16.961019 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 533/1070] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:31:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 05 02:31:16.966826 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8da284-d244-4ef2-80c1-019b63679b53 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:17.012726 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:17.023692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ea747-527b-438f-8a3b-03fb834dc7d2 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:17.060953 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e4048-6e49-4740-bd11-510b6fcd7960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:17.061593 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e4048-6e49-4740-bd11-510b6fcd7960 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:17.061877 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e4048-6e49-4740-bd11-510b6fcd7960 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:17.062155 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e4048-6e49-4740-bd11-510b6fcd7960 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:17.066675 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8da284-d244-4ef2-80c1-019b63679b53 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:17.073113 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e4048-6e49-4740-bd11-510b6fcd7960 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:17.074562 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e4048-6e49-4740-bd11-510b6fcd7960 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:17.089880 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-517e4048-6e49-4740-bd11-510b6fcd7960 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:31:17.089880 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:17.089880 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:31:17.089880 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:31:17.089880 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:31:17.089880 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:31:17.089880 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:31:17.089880 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:31:17.089880 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:31:17.089880 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:31:17.089880 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:31:17.089880 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:31:17.089880 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:31:17.089880 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:31:17.089880 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:31:17.090843 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:31:17.090843 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:31:17.090843 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:31:17.090843 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:31:17.090843 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:31:17.090843 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:31:17.090843 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:31:17.090843 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:31:17.090843 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:31:17.090843 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:31:17.090843 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:31:17.090843 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:31:17.090843 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:31:17.090843 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:31:17.090843 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:31:17.090843 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:31:17.090843 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:31:17.091983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:31:17.091983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:31:17.091983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:31:17.091983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:31:17.091983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 538/1071] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:31:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:31:17.096747 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e4048-6e49-4740-bd11-510b6fcd7960 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:17.104414 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12887b33-b35e-4fa4-8e38-59b309c0f89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:17.105055 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12887b33-b35e-4fa4-8e38-59b309c0f89f None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:17.105330 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12887b33-b35e-4fa4-8e38-59b309c0f89f None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:17.105605 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12887b33-b35e-4fa4-8e38-59b309c0f89f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:17.112889 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:17.116274 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12887b33-b35e-4fa4-8e38-59b309c0f89f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:17.118268 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12887b33-b35e-4fa4-8e38-59b309c0f89f None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:17.134337 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-12887b33-b35e-4fa4-8e38-59b309c0f89f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:31:17.134337 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:17.134337 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:31:17.134337 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:31:17.134337 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:31:17.134337 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:31:17.134337 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:31:17.134337 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:31:17.134337 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:31:17.134337 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:31:17.134337 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:31:17.134337 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:31:17.134337 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:31:17.134337 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:31:17.134337 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:31:17.135302 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:31:17.135302 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:31:17.135302 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:31:17.135302 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:31:17.135302 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:31:17.135302 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:31:17.135302 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:31:17.135302 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:31:17.135302 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:31:17.135302 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:31:17.135302 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:31:17.135302 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:31:17.135302 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:31:17.135302 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:31:17.135302 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:31:17.135302 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:31:17.135302 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:31:17.136239 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:31:17.136239 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:31:17.136239 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:31:17.136239 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:31:17.136239 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 534/1072] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:31:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:31:17.141261 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12887b33-b35e-4fa4-8e38-59b309c0f89f None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:17.205615 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e4048-6e49-4740-bd11-510b6fcd7960 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:17.241135 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f888d0a-2529-4fc3-8fde-092870678949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:17.241750 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f888d0a-2529-4fc3-8fde-092870678949 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:17.242030 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f888d0a-2529-4fc3-8fde-092870678949 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:17.242309 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f888d0a-2529-4fc3-8fde-092870678949 None admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:17.243256 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f888d0a-2529-4fc3-8fde-092870678949 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:17.243402 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f888d0a-2529-4fc3-8fde-092870678949 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:17.244668 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f888d0a-2529-4fc3-8fde-092870678949 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:17.249248 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12887b33-b35e-4fa4-8e38-59b309c0f89f None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:17.257153 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 539/1073] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:31:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:17.262447 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f888d0a-2529-4fc3-8fde-092870678949 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:17.265049 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:17.290396 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea9c17-9872-402c-a36b-f04ee2d1e79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:17.291089 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea9c17-9872-402c-a36b-f04ee2d1e79f None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:17.291371 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea9c17-9872-402c-a36b-f04ee2d1e79f None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:17.291645 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea9c17-9872-402c-a36b-f04ee2d1e79f None admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:17.292343 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea9c17-9872-402c-a36b-f04ee2d1e79f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:17.292926 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea9c17-9872-402c-a36b-f04ee2d1e79f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:17.294011 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea9c17-9872-402c-a36b-f04ee2d1e79f None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:17.307203 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 535/1074] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:31:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:31:17.373643 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f888d0a-2529-4fc3-8fde-092870678949 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:17.410776 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a0653-9cc2-48c6-9764-499eea4fe152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:17.411467 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a0653-9cc2-48c6-9764-499eea4fe152 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:17.411747 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a0653-9cc2-48c6-9764-499eea4fe152 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:17.412021 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a0653-9cc2-48c6-9764-499eea4fe152 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:17.419643 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a0653-9cc2-48c6-9764-499eea4fe152 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:17.421117 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a0653-9cc2-48c6-9764-499eea4fe152 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:17.434007 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-2c3a0653-9cc2-48c6-9764-499eea4fe152 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:31:17.434007 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:17.434007 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:31:17.434007 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:31:17.434007 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:31:17.434007 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:31:17.434007 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:31:17.434007 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:31:17.434007 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:31:17.434007 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:31:17.434007 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:31:17.434007 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:31:17.434007 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:31:17.434007 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:31:17.434007 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:31:17.435647 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:31:17.435647 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:31:17.435647 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:31:17.435647 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:31:17.435647 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:31:17.435647 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:31:17.435647 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:31:17.435647 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:31:17.435647 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:31:17.435647 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:31:17.435647 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:31:17.435647 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:31:17.435647 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:31:17.435647 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:31:17.435647 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:31:17.435647 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:31:17.435647 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:31:17.436535 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:31:17.436535 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:31:17.436535 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:31:17.436535 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:31:17.436535 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:31:17.436535 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:31:17.436535 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:31:17.436535 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:31:17.436535 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 540/1075] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:31:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:31:17.441538 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea9c17-9872-402c-a36b-f04ee2d1e79f None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:17.495765 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:17.547540 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea9c17-9872-402c-a36b-f04ee2d1e79f None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:17.581239 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd35a2-96a1-4418-bd52-7332a1d82f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:17.581872 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd35a2-96a1-4418-bd52-7332a1d82f06 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:17.582156 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd35a2-96a1-4418-bd52-7332a1d82f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:17.582432 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd35a2-96a1-4418-bd52-7332a1d82f06 None admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:17.583315 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cd35a2-96a1-4418-bd52-7332a1d82f06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:17.583625 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cd35a2-96a1-4418-bd52-7332a1d82f06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:17.585102 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cd35a2-96a1-4418-bd52-7332a1d82f06 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:17.599915 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 536/1076] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 5 02:31:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:17.606054 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a0653-9cc2-48c6-9764-499eea4fe152 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:17.666128 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:17.703755 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a0653-9cc2-48c6-9764-499eea4fe152 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:17.736804 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5cb10-9b71-44e5-8446-6898f6b245f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:17.737467 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5cb10-9b71-44e5-8446-6898f6b245f4 None admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:17.737772 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5cb10-9b71-44e5-8446-6898f6b245f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:17.738044 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5cb10-9b71-44e5-8446-6898f6b245f4 None admin] PATH_INFO: `/v3/projects/63b323c02a614fc28aac6e7a060064ba/users/55374d3bccd541c9a8f82da9b21c2fb8/roles/c14dbbd7897245a18070be9be19c278b` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:17.740209 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d5cb10-9b71-44e5-8446-6898f6b245f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=63b323c02a614fc28aac6e7a060064ba, user_id=55374d3bccd541c9a8f82da9b21c2fb8, role_id=c14dbbd7897245a18070be9be19c278b)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:17.741695 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d5cb10-9b71-44e5-8446-6898f6b245f4 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:17.756633 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a539616-e62d-4a76-b242-4902d4c0ae8c None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:17.756633 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a539616-e62d-4a76-b242-4902d4c0ae8c None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:17.756633 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a539616-e62d-4a76-b242-4902d4c0ae8c None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:17.757304 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 537/1077] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:31:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:31:17.761713 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c6d81-d650-4cea-8c28-3eccf3280eab None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:17.761989 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c6d81-d650-4cea-8c28-3eccf3280eab None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:17.762256 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c6d81-d650-4cea-8c28-3eccf3280eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:17.780037 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-954c6d81-d650-4cea-8c28-3eccf3280eab None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:17.781198 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-954c6d81-d650-4cea-8c28-3eccf3280eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:17.833978 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 541/1078] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 5 02:31:17 2022] PUT /identity/v3/projects/63b323c02a614fc28aac6e7a060064ba/users/55374d3bccd541c9a8f82da9b21c2fb8/roles/c14dbbd7897245a18070be9be19c278b => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:31:17.852985 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 538/1079] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:31:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 02:31:17.875580 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5cb10-9b71-44e5-8446-6898f6b245f4 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:17.980730 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5cb10-9b71-44e5-8446-6898f6b245f4 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:18.002686 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:18.013965 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3caef-4586-4e8d-9203-58ba9ef9f0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:18.014583 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3caef-4586-4e8d-9203-58ba9ef9f0e5 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:18.014871 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3caef-4586-4e8d-9203-58ba9ef9f0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:18.015170 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3caef-4586-4e8d-9203-58ba9ef9f0e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:18.025808 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3caef-4586-4e8d-9203-58ba9ef9f0e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:31:18.031107 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-68d3caef-4586-4e8d-9203-58ba9ef9f0e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:31:18.031107 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:18.031107 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:31:18.031107 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:31:18.031107 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:31:18.031107 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:31:18.031107 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:31:18.031107 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:31:18.031107 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:31:18.031107 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:31:18.031107 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:31:18.031107 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:31:18.031107 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:31:18.031107 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:31:18.031107 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:31:18.031107 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:31:18.032752 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:31:18.032752 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:31:18.032752 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:31:18.032752 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:31:18.032752 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:31:18.032752 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:31:18.032752 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:31:18.032752 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:31:18.032752 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:31:18.032752 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:31:18.032752 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:31:18.032752 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:31:18.032752 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:31:18.032752 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:31:18.032752 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:31:18.032752 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:31:18.033609 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:31:18.033609 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:31:18.033609 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:31:18.033609 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:31:18.033609 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:31:18.033609 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:31:18.033609 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:31:18.033609 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:31:18.033609 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:31:18.033609 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:31:18.033609 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:31:18.033609 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:31:18.034262 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 542/1080] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 5 02:31:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:31:18.039523 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c6d81-d650-4cea-8c28-3eccf3280eab None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:18.080529 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:18.136277 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c6d81-d650-4cea-8c28-3eccf3280eab None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:18.168884 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f9c3dd-ec2c-455a-850b-82471608d734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:18.169493 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9c3dd-ec2c-455a-850b-82471608d734 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:18.169771 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9c3dd-ec2c-455a-850b-82471608d734 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:18.170102 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9c3dd-ec2c-455a-850b-82471608d734 None admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:18.170800 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f9c3dd-ec2c-455a-850b-82471608d734 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:18.171130 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f9c3dd-ec2c-455a-850b-82471608d734 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:18.172492 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f9c3dd-ec2c-455a-850b-82471608d734 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:18.180700 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 539/1081] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:31:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:18.186275 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3caef-4586-4e8d-9203-58ba9ef9f0e5 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:18.303625 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3caef-4586-4e8d-9203-58ba9ef9f0e5 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:18.337698 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b980e4-d24c-4e66-88fb-20efb1d16b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:18.338348 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b980e4-d24c-4e66-88fb-20efb1d16b3a None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:18.338629 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b980e4-d24c-4e66-88fb-20efb1d16b3a None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:18.338907 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b980e4-d24c-4e66-88fb-20efb1d16b3a None admin] PATH_INFO: `/v3/users/8015abdd4acf45f1beb2dfeb69a552a0` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:18.340093 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b980e4-d24c-4e66-88fb-20efb1d16b3a None admin] RBAC: Authorizing `identity:get_user(user_id=8015abdd4acf45f1beb2dfeb69a552a0)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:18.341517 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b980e4-d24c-4e66-88fb-20efb1d16b3a None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:18.343194 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 543/1082] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:31:18 2022] GET /identity/v3/users/8015abdd4acf45f1beb2dfeb69a552a0 => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:18.349166 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f9c3dd-ec2c-455a-850b-82471608d734 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:18.445652 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f9c3dd-ec2c-455a-850b-82471608d734 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:18.447165 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:18.478419 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebc63e-4782-41b2-a0f5-57ebb118035e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:18.479309 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebc63e-4782-41b2-a0f5-57ebb118035e None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:18.479755 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebc63e-4782-41b2-a0f5-57ebb118035e None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:18.480302 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebc63e-4782-41b2-a0f5-57ebb118035e None admin] PATH_INFO: `/v3/projects/8bdee413c80b4a90b6f9461fabcf1614` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:18.481446 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ebc63e-4782-41b2-a0f5-57ebb118035e None admin] RBAC: Authorizing `identity:get_project(project_id=8bdee413c80b4a90b6f9461fabcf1614)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:18.482878 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ebc63e-4782-41b2-a0f5-57ebb118035e None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:18.484544 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 540/1083] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:31:18 2022] GET /identity/v3/projects/8bdee413c80b4a90b6f9461fabcf1614 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:18.490931 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b980e4-d24c-4e66-88fb-20efb1d16b3a None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:18.538841 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:18.586743 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b980e4-d24c-4e66-88fb-20efb1d16b3a None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:18.618724 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd9e76-5fee-402f-884e-7a7d8b74fdc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:18.619400 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd9e76-5fee-402f-884e-7a7d8b74fdc0 None admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:18.619681 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd9e76-5fee-402f-884e-7a7d8b74fdc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:18.619952 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd9e76-5fee-402f-884e-7a7d8b74fdc0 None admin] PATH_INFO: `/v3/projects/8bdee413c80b4a90b6f9461fabcf1614/users/8015abdd4acf45f1beb2dfeb69a552a0/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:18.621839 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cd9e76-5fee-402f-884e-7a7d8b74fdc0 None admin] RBAC: Authorizing `identity:create_grant(project_id=8bdee413c80b4a90b6f9461fabcf1614, user_id=8015abdd4acf45f1beb2dfeb69a552a0, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:18.623287 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cd9e76-5fee-402f-884e-7a7d8b74fdc0 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:18.684787 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 544/1084] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 5 02:31:18 2022] PUT /identity/v3/projects/8bdee413c80b4a90b6f9461fabcf1614/users/8015abdd4acf45f1beb2dfeb69a552a0/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:31:19.848336 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f1e27-6c16-49fc-9ad3-62aa2568a567 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:19.849154 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f1e27-6c16-49fc-9ad3-62aa2568a567 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:19.849154 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f1e27-6c16-49fc-9ad3-62aa2568a567 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:19.850472 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 541/1085] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:31:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:31:19.855639 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8f7e9-89ca-491a-bdb0-58213e3028f7 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:19.856042 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8f7e9-89ca-491a-bdb0-58213e3028f7 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:19.856192 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8f7e9-89ca-491a-bdb0-58213e3028f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:19.873794 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-aed8f7e9-89ca-491a-bdb0-58213e3028f7 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:19.874991 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-aed8f7e9-89ca-491a-bdb0-58213e3028f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:19.939850 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 545/1086] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:31:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:31:19.962289 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f1e27-6c16-49fc-9ad3-62aa2568a567 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:20.067189 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f1e27-6c16-49fc-9ad3-62aa2568a567 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:20.100306 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94100b1f-4b5e-4857-9577-eaf48069b38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:20.100872 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94100b1f-4b5e-4857-9577-eaf48069b38d None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:20.101152 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94100b1f-4b5e-4857-9577-eaf48069b38d None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:20.101425 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94100b1f-4b5e-4857-9577-eaf48069b38d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:20.111832 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94100b1f-4b5e-4857-9577-eaf48069b38d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:31:20.116657 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-94100b1f-4b5e-4857-9577-eaf48069b38d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 02:31:20.116657 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:20.116657 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:31:20.116657 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:31:20.116657 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:31:20.116657 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:31:20.116657 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:31:20.116657 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:31:20.116657 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:31:20.116657 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:31:20.116657 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:31:20.116657 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:31:20.116657 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:31:20.116657 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:31:20.116657 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:31:20.116657 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:31:20.117779 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:31:20.117779 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:31:20.117779 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:31:20.117779 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:31:20.117779 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:31:20.117779 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:31:20.117779 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:31:20.117779 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:31:20.117779 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:31:20.117779 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:31:20.117779 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:31:20.117779 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:31:20.117779 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:31:20.117779 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:31:20.117779 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:31:20.117779 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:31:20.118650 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:31:20.118650 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:31:20.118650 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:31:20.118650 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:31:20.118650 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:31:20.118650 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:31:20.118650 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:31:20.118650 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:31:20.118650 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:31:20.118650 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:31:20.118650 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 02:31:20.118650 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:31:20.118650 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 542/1087] 10.222.0.42 () {56 vars in 1120 bytes} [Fri Aug 5 02:31:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:31:20.124509 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8f7e9-89ca-491a-bdb0-58213e3028f7 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:20.164576 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:20.219672 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8f7e9-89ca-491a-bdb0-58213e3028f7 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:20.255102 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8475a2-5601-451b-b522-aa088e4de9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:20.255720 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8475a2-5601-451b-b522-aa088e4de9df None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:20.255998 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8475a2-5601-451b-b522-aa088e4de9df None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:20.256276 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8475a2-5601-451b-b522-aa088e4de9df None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:20.256980 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8475a2-5601-451b-b522-aa088e4de9df None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:20.257279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8475a2-5601-451b-b522-aa088e4de9df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:20.258644 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8475a2-5601-451b-b522-aa088e4de9df None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:20.266624 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 546/1088] 10.222.0.42 () {56 vars in 1115 bytes} [Fri Aug 5 02:31:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:20.273375 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94100b1f-4b5e-4857-9577-eaf48069b38d None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:20.303348 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:20.375182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94100b1f-4b5e-4857-9577-eaf48069b38d None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:20.408428 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec6e510-3718-4451-b7bd-b691a9d365d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:20.409061 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6e510-3718-4451-b7bd-b691a9d365d2 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:20.409338 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6e510-3718-4451-b7bd-b691a9d365d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:20.409606 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6e510-3718-4451-b7bd-b691a9d365d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:20.419931 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec6e510-3718-4451-b7bd-b691a9d365d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:20.421401 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec6e510-3718-4451-b7bd-b691a9d365d2 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:20.436475 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-6ec6e510-3718-4451-b7bd-b691a9d365d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:31:20.436475 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:20.436475 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:31:20.436475 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:31:20.436475 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:31:20.436475 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:31:20.436475 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:31:20.436475 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:31:20.436475 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:31:20.436475 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:31:20.436475 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:31:20.436475 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:31:20.436475 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:31:20.436475 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:31:20.436475 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:31:20.437412 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:31:20.437412 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:31:20.437412 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:31:20.437412 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:31:20.437412 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:31:20.437412 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:31:20.437412 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:31:20.437412 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:31:20.437412 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:31:20.437412 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:31:20.437412 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:31:20.437412 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:31:20.437412 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:31:20.437412 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:31:20.437412 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:31:20.437412 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:31:20.437412 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:31:20.438322 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:31:20.438322 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:31:20.438322 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:31:20.438322 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:31:20.438322 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 543/1089] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:31:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:31:20.443419 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8475a2-5601-451b-b522-aa088e4de9df None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:20.540784 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8475a2-5601-451b-b522-aa088e4de9df None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:20.542281 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:20.573591 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40183d-75da-4a4c-8a73-730ab83c636e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:20.574211 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40183d-75da-4a4c-8a73-730ab83c636e None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:20.574495 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40183d-75da-4a4c-8a73-730ab83c636e None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:20.574907 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40183d-75da-4a4c-8a73-730ab83c636e None admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:20.575542 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d40183d-75da-4a4c-8a73-730ab83c636e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:20.576089 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d40183d-75da-4a4c-8a73-730ab83c636e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:20.577968 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d40183d-75da-4a4c-8a73-730ab83c636e None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:20.590541 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 547/1090] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:31:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:20.596946 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec6e510-3718-4451-b7bd-b691a9d365d2 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:20.658985 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ebbbe-961c-43fc-94f0-934ac38b602e None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:20.659194 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ebbbe-961c-43fc-94f0-934ac38b602e None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:20.659475 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ebbbe-961c-43fc-94f0-934ac38b602e None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:20.660834 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 548/1091] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:31:20.665743 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf66c0-ed24-4177-a58a-c217194239de None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:20.666027 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf66c0-ed24-4177-a58a-c217194239de None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:20.666304 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf66c0-ed24-4177-a58a-c217194239de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:20.677968 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:20.684167 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-59cf66c0-ed24-4177-a58a-c217194239de None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:20.685587 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-59cf66c0-ed24-4177-a58a-c217194239de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:20.695143 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec6e510-3718-4451-b7bd-b691a9d365d2 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:20.729661 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07042ab8-5ab0-4758-84ba-a4e9c0e1e3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:20.730327 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07042ab8-5ab0-4758-84ba-a4e9c0e1e3b8 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:20.730617 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07042ab8-5ab0-4758-84ba-a4e9c0e1e3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:20.730890 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07042ab8-5ab0-4758-84ba-a4e9c0e1e3b8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:20.738227 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07042ab8-5ab0-4758-84ba-a4e9c0e1e3b8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:20.739701 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07042ab8-5ab0-4758-84ba-a4e9c0e1e3b8 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:20.750636 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-07042ab8-5ab0-4758-84ba-a4e9c0e1e3b8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 02:31:20.750636 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:20.750636 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:31:20.750636 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:31:20.750636 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:31:20.750636 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:31:20.750636 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:31:20.750636 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:31:20.750636 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:31:20.750636 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:31:20.750636 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:31:20.750636 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:31:20.750636 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:31:20.750636 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:31:20.750636 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:31:20.750636 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:31:20.751834 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:31:20.751834 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:31:20.751834 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:31:20.751834 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:31:20.751834 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:31:20.751834 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:31:20.751834 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:31:20.751834 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:31:20.751834 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:31:20.751834 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:31:20.751834 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:31:20.751834 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:31:20.751834 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:31:20.751834 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:31:20.751834 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:31:20.751834 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:31:20.751834 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:31:20.751834 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:31:20.752829 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:31:20.752829 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:31:20.752829 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:31:20.752829 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:31:20.752829 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:31:20.752829 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:31:20.752829 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:31:20.752829 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:31:20.752829 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 02:31:20.752829 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:31:20.752829 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 544/1092] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Aug 5 02:31:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:31:20.753455 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 549/1093] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:31:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 02:31:20.757667 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07042ab8-5ab0-4758-84ba-a4e9c0e1e3b8 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:20.776060 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf66c0-ed24-4177-a58a-c217194239de None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:20.855455 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07042ab8-5ab0-4758-84ba-a4e9c0e1e3b8 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:20.863059 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:20.871235 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf66c0-ed24-4177-a58a-c217194239de None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:20.888632 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc9a4d-05d9-453e-a124-a465b4f45b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:20.889246 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc9a4d-05d9-453e-a124-a465b4f45b82 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:20.889527 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc9a4d-05d9-453e-a124-a465b4f45b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:20.889799 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc9a4d-05d9-453e-a124-a465b4f45b82 None admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:20.890584 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc9a4d-05d9-453e-a124-a465b4f45b82 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:20.890889 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc9a4d-05d9-453e-a124-a465b4f45b82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:20.892896 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc9a4d-05d9-453e-a124-a465b4f45b82 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:20.905068 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5907252-8d46-4ed7-b871-c51b91cc2ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:20.905713 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5907252-8d46-4ed7-b871-c51b91cc2ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:20.905996 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5907252-8d46-4ed7-b871-c51b91cc2ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:20.906274 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5907252-8d46-4ed7-b871-c51b91cc2ba5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:20.907738 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:20.911051 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 545/1094] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Aug 5 02:31:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:20.916560 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc9a4d-05d9-453e-a124-a465b4f45b82 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:20.917473 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5907252-8d46-4ed7-b871-c51b91cc2ba5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:31:20.922649 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-c5907252-8d46-4ed7-b871-c51b91cc2ba5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:31:20.922649 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:20.922649 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:31:20.922649 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:31:20.922649 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:31:20.922649 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:31:20.922649 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:31:20.922649 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:31:20.922649 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:31:20.922649 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:31:20.922649 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:31:20.922649 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:31:20.922649 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:31:20.922649 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:31:20.922649 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:31:20.922649 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:31:20.923807 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:31:20.923807 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:31:20.923807 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:31:20.923807 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:31:20.923807 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:31:20.923807 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:31:20.923807 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:31:20.923807 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:31:20.923807 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:31:20.923807 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:31:20.923807 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:31:20.923807 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:31:20.923807 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:31:20.923807 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:31:20.923807 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:31:20.923807 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:31:20.924717 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:31:20.924717 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:31:20.924717 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:31:20.924717 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:31:20.924717 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:31:20.924717 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:31:20.924717 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:31:20.924717 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:31:20.924717 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:31:20.924717 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:31:20.924717 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:31:20.924717 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:31:20.924717 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 550/1095] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 5 02:31:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:31:20.929908 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5907252-8d46-4ed7-b871-c51b91cc2ba5 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:21.013998 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc9a4d-05d9-453e-a124-a465b4f45b82 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:21.026722 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5907252-8d46-4ed7-b871-c51b91cc2ba5 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:21.048504 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511d4eb-ce37-4b16-911d-44ea06f6c6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:21.049123 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511d4eb-ce37-4b16-911d-44ea06f6c6b6 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:21.049407 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511d4eb-ce37-4b16-911d-44ea06f6c6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:21.049696 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511d4eb-ce37-4b16-911d-44ea06f6c6b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:21.059545 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4cf5c4-fdfa-4385-8800-346bab9905ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:21.060156 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4cf5c4-fdfa-4385-8800-346bab9905ce None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:21.060432 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4cf5c4-fdfa-4385-8800-346bab9905ce None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:21.060703 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4cf5c4-fdfa-4385-8800-346bab9905ce None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:21.061428 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4cf5c4-fdfa-4385-8800-346bab9905ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:21.061707 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4cf5c4-fdfa-4385-8800-346bab9905ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:21.063602 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4cf5c4-fdfa-4385-8800-346bab9905ce None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:21.071355 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 551/1096] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:31:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:21.076971 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4cf5c4-fdfa-4385-8800-346bab9905ce None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:21.092368 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:21.114536 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:21.116858 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511d4eb-ce37-4b16-911d-44ea06f6c6b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:21.118422 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511d4eb-ce37-4b16-911d-44ea06f6c6b6 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:21.176190 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4cf5c4-fdfa-4385-8800-346bab9905ce None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:21.211294 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec3e096-0226-4e65-8d75-023677cb423d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:21.211931 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3e096-0226-4e65-8d75-023677cb423d None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:21.212209 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3e096-0226-4e65-8d75-023677cb423d None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:21.212481 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3e096-0226-4e65-8d75-023677cb423d None admin] PATH_INFO: `/v3/users/8015abdd4acf45f1beb2dfeb69a552a0` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:21.213651 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec3e096-0226-4e65-8d75-023677cb423d None admin] RBAC: Authorizing `identity:get_user(user_id=8015abdd4acf45f1beb2dfeb69a552a0)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:21.215325 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec3e096-0226-4e65-8d75-023677cb423d None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:21.216932 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 552/1097] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:31:21 2022] GET /identity/v3/users/8015abdd4acf45f1beb2dfeb69a552a0 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:31:21.222853 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec3e096-0226-4e65-8d75-023677cb423d None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:21.225117 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 546/1098] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:31:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 05 02:31:21.230557 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511d4eb-ce37-4b16-911d-44ea06f6c6b6 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:21.303993 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:21.321512 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec3e096-0226-4e65-8d75-023677cb423d None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:21.330173 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:21.332924 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511d4eb-ce37-4b16-911d-44ea06f6c6b6 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:21.355251 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52fef1c-b9c1-44d1-a596-8f144d87b07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:21.355866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fef1c-b9c1-44d1-a596-8f144d87b07b None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:21.356151 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fef1c-b9c1-44d1-a596-8f144d87b07b None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:21.356425 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fef1c-b9c1-44d1-a596-8f144d87b07b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:21.365789 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0246dc3-8e43-4c8c-9235-0440002eeae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:21.366420 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0246dc3-8e43-4c8c-9235-0440002eeae6 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:21.366702 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0246dc3-8e43-4c8c-9235-0440002eeae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:21.366997 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0246dc3-8e43-4c8c-9235-0440002eeae6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:21.377094 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0246dc3-8e43-4c8c-9235-0440002eeae6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:21.378552 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0246dc3-8e43-4c8c-9235-0440002eeae6 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:21.393274 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-a0246dc3-8e43-4c8c-9235-0440002eeae6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:31:21.393274 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:21.393274 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:31:21.393274 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:31:21.393274 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:31:21.393274 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:31:21.393274 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:31:21.393274 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:31:21.393274 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:31:21.393274 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:31:21.393274 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:31:21.393274 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:31:21.393274 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:31:21.393274 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:31:21.393274 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:31:21.394333 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:31:21.394333 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:31:21.394333 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:31:21.394333 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:31:21.394333 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:31:21.394333 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:31:21.394333 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:31:21.394333 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:31:21.394333 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:31:21.394333 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:31:21.394333 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:31:21.394333 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:31:21.394333 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:31:21.394333 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:31:21.394333 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:31:21.394333 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:31:21.394333 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:31:21.395570 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:31:21.395570 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:31:21.395570 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:31:21.395570 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:31:21.395570 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 547/1099] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:31:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:31:21.400097 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0246dc3-8e43-4c8c-9235-0440002eeae6 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:21.422257 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52fef1c-b9c1-44d1-a596-8f144d87b07b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:21.424283 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52fef1c-b9c1-44d1-a596-8f144d87b07b None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:21.500177 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0246dc3-8e43-4c8c-9235-0440002eeae6 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:21.511938 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:21.529853 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 553/1100] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:31:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 02:31:21.533181 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e0e64-585e-4590-8f11-386b19dcbfdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:21.533815 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e0e64-585e-4590-8f11-386b19dcbfdf None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:21.534073 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e0e64-585e-4590-8f11-386b19dcbfdf None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:21.534361 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e0e64-585e-4590-8f11-386b19dcbfdf None admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:21.535057 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e0e64-585e-4590-8f11-386b19dcbfdf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:21.535359 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e0e64-585e-4590-8f11-386b19dcbfdf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:21.535610 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52fef1c-b9c1-44d1-a596-8f144d87b07b None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:21.536731 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e0e64-585e-4590-8f11-386b19dcbfdf None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:21.550987 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 548/1101] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:31:21.556107 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e0e64-585e-4590-8f11-386b19dcbfdf None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:21.570410 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:21.637318 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52fef1c-b9c1-44d1-a596-8f144d87b07b None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:21.655477 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e0e64-585e-4590-8f11-386b19dcbfdf None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:21.670258 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156e4b9-3a63-4dab-bacd-5627ef91a04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:21.670904 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156e4b9-3a63-4dab-bacd-5627ef91a04b None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:21.671211 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156e4b9-3a63-4dab-bacd-5627ef91a04b None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:21.671486 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156e4b9-3a63-4dab-bacd-5627ef91a04b None admin] PATH_INFO: `/v3/projects/8bdee413c80b4a90b6f9461fabcf1614` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:21.673142 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6156e4b9-3a63-4dab-bacd-5627ef91a04b None admin] RBAC: Authorizing `identity:get_project(project_id=8bdee413c80b4a90b6f9461fabcf1614)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:21.674579 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6156e4b9-3a63-4dab-bacd-5627ef91a04b None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:21.676277 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 554/1102] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:31:21 2022] GET /identity/v3/projects/8bdee413c80b4a90b6f9461fabcf1614 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:31:21.682244 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156e4b9-3a63-4dab-bacd-5627ef91a04b None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:21.692413 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118c477-3071-41c0-8ca0-e26cc76439ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:21.693055 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118c477-3071-41c0-8ca0-e26cc76439ae None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:21.693334 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118c477-3071-41c0-8ca0-e26cc76439ae None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:21.693607 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118c477-3071-41c0-8ca0-e26cc76439ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:21.700443 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b118c477-3071-41c0-8ca0-e26cc76439ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:21.701883 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b118c477-3071-41c0-8ca0-e26cc76439ae None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:21.714081 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-b118c477-3071-41c0-8ca0-e26cc76439ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:31:21.714081 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:21.714081 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:31:21.714081 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:31:21.714081 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:31:21.714081 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:31:21.714081 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:31:21.714081 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:31:21.714081 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:31:21.714081 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:31:21.714081 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:31:21.714081 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:31:21.714081 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:31:21.714081 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:31:21.714081 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:31:21.715048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:31:21.715048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:31:21.715048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:31:21.715048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:31:21.715048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:31:21.715048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:31:21.715048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:31:21.715048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:31:21.715048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:31:21.715048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:31:21.715048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:31:21.715048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:31:21.715048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:31:21.715048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:31:21.715048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:31:21.715048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:31:21.715048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:31:21.715981 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:31:21.715981 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:31:21.715981 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:31:21.715981 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:31:21.715981 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:31:21.715981 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:31:21.715981 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:31:21.715981 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:31:21.715981 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 549/1103] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:31:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:31:21.721226 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118c477-3071-41c0-8ca0-e26cc76439ae None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:21.730797 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:21.778731 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156e4b9-3a63-4dab-bacd-5627ef91a04b None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:21.790882 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:21.812573 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92acf0ce-e3f9-4fb0-86c9-36d85ab03442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:21.813192 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acf0ce-e3f9-4fb0-86c9-36d85ab03442 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:21.813475 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acf0ce-e3f9-4fb0-86c9-36d85ab03442 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:21.813751 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acf0ce-e3f9-4fb0-86c9-36d85ab03442 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:21.814579 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92acf0ce-e3f9-4fb0-86c9-36d85ab03442 None admin] RBAC: Adding query filter params (role.id=83afe883a303495b966480fb9b5bb7dd, scope.project.id=8bdee413c80b4a90b6f9461fabcf1614, user.id=8015abdd4acf45f1beb2dfeb69a552a0) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:21.814937 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92acf0ce-e3f9-4fb0-86c9-36d85ab03442 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:21.816467 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92acf0ce-e3f9-4fb0-86c9-36d85ab03442 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:21.821152 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118c477-3071-41c0-8ca0-e26cc76439ae None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:21.822158 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 555/1104] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:31:21 2022] GET /identity/v3/role_assignments?user.id=8015abdd4acf45f1beb2dfeb69a552a0&scope.project.id=8bdee413c80b4a90b6f9461fabcf1614&role.id=83afe883a303495b966480fb9b5bb7dd => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:31:21.858573 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d36a6da-c1c7-4cd3-b0e9-47a655191a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:21.859247 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36a6da-c1c7-4cd3-b0e9-47a655191a4b None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:21.859528 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36a6da-c1c7-4cd3-b0e9-47a655191a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:21.859805 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36a6da-c1c7-4cd3-b0e9-47a655191a4b None admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:21.861148 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d36a6da-c1c7-4cd3-b0e9-47a655191a4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:21.861456 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d36a6da-c1c7-4cd3-b0e9-47a655191a4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:21.862959 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d36a6da-c1c7-4cd3-b0e9-47a655191a4b None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:21.877786 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 550/1105] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 5 02:31:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:31:21.884151 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92acf0ce-e3f9-4fb0-86c9-36d85ab03442 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:22.004365 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92acf0ce-e3f9-4fb0-86c9-36d85ab03442 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:22.018151 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:22.037697 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47bf711-0a5e-4e1a-9f09-8fd6d856e349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:22.038245 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47bf711-0a5e-4e1a-9f09-8fd6d856e349 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:22.038522 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47bf711-0a5e-4e1a-9f09-8fd6d856e349 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:22.038793 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47bf711-0a5e-4e1a-9f09-8fd6d856e349 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:22.039605 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47bf711-0a5e-4e1a-9f09-8fd6d856e349 None admin] RBAC: Adding query filter params (role.id=c14dbbd7897245a18070be9be19c278b, scope.project.id=63b323c02a614fc28aac6e7a060064ba, user.id=55374d3bccd541c9a8f82da9b21c2fb8) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:22.039910 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47bf711-0a5e-4e1a-9f09-8fd6d856e349 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:22.041335 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47bf711-0a5e-4e1a-9f09-8fd6d856e349 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:22.047020 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 556/1106] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:31:21 2022] GET /identity/v3/role_assignments?user.id=55374d3bccd541c9a8f82da9b21c2fb8&scope.project.id=63b323c02a614fc28aac6e7a060064ba&role.id=c14dbbd7897245a18070be9be19c278b => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:23.865767 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44aded6-0aff-4051-9917-b8e457672073 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:23.866296 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44aded6-0aff-4051-9917-b8e457672073 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:23.866296 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44aded6-0aff-4051-9917-b8e457672073 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:23.867665 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 551/1107] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:31:23.872852 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c669f57-79d8-4bac-8d0b-f0ac71e9fc64 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:23.873292 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c669f57-79d8-4bac-8d0b-f0ac71e9fc64 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:23.873395 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c669f57-79d8-4bac-8d0b-f0ac71e9fc64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:23.891643 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-2c669f57-79d8-4bac-8d0b-f0ac71e9fc64 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:23.892825 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-2c669f57-79d8-4bac-8d0b-f0ac71e9fc64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:23.956360 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 557/1108] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:31:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:31:23.980469 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44aded6-0aff-4051-9917-b8e457672073 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:24.077617 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44aded6-0aff-4051-9917-b8e457672073 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:24.105840 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:24.110436 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856eb7a-9a9c-4ce7-9485-046d076aec1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:24.111090 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856eb7a-9a9c-4ce7-9485-046d076aec1e None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:24.111373 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856eb7a-9a9c-4ce7-9485-046d076aec1e None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:24.111645 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856eb7a-9a9c-4ce7-9485-046d076aec1e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:24.112775 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5856eb7a-9a9c-4ce7-9485-046d076aec1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:24.114223 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5856eb7a-9a9c-4ce7-9485-046d076aec1e None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:24.123127 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 552/1109] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:31:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:24.123278 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c669f57-79d8-4bac-8d0b-f0ac71e9fc64 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:24.216503 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c669f57-79d8-4bac-8d0b-f0ac71e9fc64 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:24.226102 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:24.250606 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb89c9-b0da-4633-800c-d787970465a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:24.251262 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb89c9-b0da-4633-800c-d787970465a5 None admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:24.251546 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb89c9-b0da-4633-800c-d787970465a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:24.251820 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb89c9-b0da-4633-800c-d787970465a5 None admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:24.252499 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb89c9-b0da-4633-800c-d787970465a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:24.253926 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb89c9-b0da-4633-800c-d787970465a5 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:24.336052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 558/1110] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 5 02:31:24 2022] POST /identity/v3/users => generated 286 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:31:26.352039 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89015c7-438a-45c9-b3aa-a97aa7967063 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:26.352556 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89015c7-438a-45c9-b3aa-a97aa7967063 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:26.352556 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89015c7-438a-45c9-b3aa-a97aa7967063 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:26.353914 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 553/1111] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:31:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:31:26.359151 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13c670-e1e7-4714-98b0-79dcd0344425 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:26.359558 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13c670-e1e7-4714-98b0-79dcd0344425 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:26.360338 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13c670-e1e7-4714-98b0-79dcd0344425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:26.377990 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-7c13c670-e1e7-4714-98b0-79dcd0344425 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:26.379189 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-7c13c670-e1e7-4714-98b0-79dcd0344425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:26.443549 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 559/1112] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:31:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:31:26.466368 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89015c7-438a-45c9-b3aa-a97aa7967063 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:26.563479 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89015c7-438a-45c9-b3aa-a97aa7967063 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:26.595677 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62811372-bea0-47d1-8cf7-e16f937c3162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:26.596305 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62811372-bea0-47d1-8cf7-e16f937c3162 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:26.596587 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62811372-bea0-47d1-8cf7-e16f937c3162 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:26.596863 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62811372-bea0-47d1-8cf7-e16f937c3162 None admin] PATH_INFO: `/v3/roles/428314713da6487e8047a1f333265cda` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:26.598579 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62811372-bea0-47d1-8cf7-e16f937c3162 None admin] RBAC: Authorizing `identity:get_role(role_id=428314713da6487e8047a1f333265cda)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:26.599978 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62811372-bea0-47d1-8cf7-e16f937c3162 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:26.601285 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 554/1113] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:31:26 2022] GET /identity/v3/roles/428314713da6487e8047a1f333265cda => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:26.607012 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13c670-e1e7-4714-98b0-79dcd0344425 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:26.695761 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:26.702076 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13c670-e1e7-4714-98b0-79dcd0344425 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:26.735265 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c1929-c4ca-41c4-8823-46f70a78aa89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:26.735903 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c1929-c4ca-41c4-8823-46f70a78aa89 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:26.736186 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c1929-c4ca-41c4-8823-46f70a78aa89 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:26.736464 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c1929-c4ca-41c4-8823-46f70a78aa89 None admin] PATH_INFO: `/v3/users/38e750e9a2484491a2b24494f9bdf156` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:26.748932 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c1929-c4ca-41c4-8823-46f70a78aa89 None admin] RBAC: Authorizing `identity:get_user(user_id=38e750e9a2484491a2b24494f9bdf156)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:26.750404 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c1929-c4ca-41c4-8823-46f70a78aa89 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:26.752052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 560/1114] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:31:26 2022] GET /identity/v3/users/38e750e9a2484491a2b24494f9bdf156 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:26.757855 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62811372-bea0-47d1-8cf7-e16f937c3162 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:26.822461 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:26.854490 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62811372-bea0-47d1-8cf7-e16f937c3162 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:26.886398 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac146b-a530-4540-bd64-90fb204c4614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:26.887024 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac146b-a530-4540-bd64-90fb204c4614 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:26.887304 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac146b-a530-4540-bd64-90fb204c4614 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:26.887575 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac146b-a530-4540-bd64-90fb204c4614 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:26.950684 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac146b-a530-4540-bd64-90fb204c4614 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:26.952140 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac146b-a530-4540-bd64-90fb204c4614 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:27.013514 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:27.047336 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 555/1115] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:31:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 02:31:27.053188 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c1929-c4ca-41c4-8823-46f70a78aa89 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:27.148412 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c1929-c4ca-41c4-8823-46f70a78aa89 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:27.179576 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f50fa9-a70a-4293-afec-0d5fca0e93e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:27.181211 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f50fa9-a70a-4293-afec-0d5fca0e93e2 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:27.181211 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f50fa9-a70a-4293-afec-0d5fca0e93e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:27.181211 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f50fa9-a70a-4293-afec-0d5fca0e93e2 None admin] PATH_INFO: `/v3/projects/8bdee413c80b4a90b6f9461fabcf1614` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:27.182035 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f50fa9-a70a-4293-afec-0d5fca0e93e2 None admin] RBAC: Authorizing `identity:get_project(project_id=8bdee413c80b4a90b6f9461fabcf1614)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:27.183513 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f50fa9-a70a-4293-afec-0d5fca0e93e2 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:27.185167 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 561/1116] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:31:27 2022] GET /identity/v3/projects/8bdee413c80b4a90b6f9461fabcf1614 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:27.191824 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac146b-a530-4540-bd64-90fb204c4614 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:27.304878 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac146b-a530-4540-bd64-90fb204c4614 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:27.340263 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df281e7c-a656-46cd-94a8-0f292c5efbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:27.340877 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df281e7c-a656-46cd-94a8-0f292c5efbc2 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:27.341160 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df281e7c-a656-46cd-94a8-0f292c5efbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:27.341436 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df281e7c-a656-46cd-94a8-0f292c5efbc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:27.342216 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df281e7c-a656-46cd-94a8-0f292c5efbc2 None admin] RBAC: Adding query filter params (role.id=428314713da6487e8047a1f333265cda, scope.project.id=8bdee413c80b4a90b6f9461fabcf1614, user.id=38e750e9a2484491a2b24494f9bdf156) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:27.342523 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df281e7c-a656-46cd-94a8-0f292c5efbc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:27.344545 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df281e7c-a656-46cd-94a8-0f292c5efbc2 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:27.350072 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 556/1117] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:31:27 2022] GET /identity/v3/role_assignments?user.id=38e750e9a2484491a2b24494f9bdf156&scope.project.id=8bdee413c80b4a90b6f9461fabcf1614&role.id=428314713da6487e8047a1f333265cda => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:29.319481 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169aef24-3f8a-4608-a5bd-902916393da9 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:29.320026 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169aef24-3f8a-4608-a5bd-902916393da9 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:29.320026 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169aef24-3f8a-4608-a5bd-902916393da9 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:29.321383 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 562/1118] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:31:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:31:29.326564 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba300c-6ab1-4f7d-be8e-53e97b3569d7 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:29.326999 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba300c-6ab1-4f7d-be8e-53e97b3569d7 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:29.327160 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba300c-6ab1-4f7d-be8e-53e97b3569d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:29.346139 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-88ba300c-6ab1-4f7d-be8e-53e97b3569d7 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:29.347355 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-88ba300c-6ab1-4f7d-be8e-53e97b3569d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:29.372051 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:29.411818 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 557/1119] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:31:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:31:29.433621 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169aef24-3f8a-4608-a5bd-902916393da9 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:29.455560 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:29.530663 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169aef24-3f8a-4608-a5bd-902916393da9 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:29.562008 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b091741-bb49-475c-a5ea-7e2986117fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:29.563159 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b091741-bb49-475c-a5ea-7e2986117fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:29.563434 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b091741-bb49-475c-a5ea-7e2986117fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:29.563697 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b091741-bb49-475c-a5ea-7e2986117fb9 None admin] PATH_INFO: `/v3/roles/428314713da6487e8047a1f333265cda` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:29.565111 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b091741-bb49-475c-a5ea-7e2986117fb9 None admin] RBAC: Authorizing `identity:get_role(role_id=428314713da6487e8047a1f333265cda)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:29.566467 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b091741-bb49-475c-a5ea-7e2986117fb9 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:29.567808 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 563/1120] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:31:29 2022] GET /identity/v3/roles/428314713da6487e8047a1f333265cda => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:29.573531 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba300c-6ab1-4f7d-be8e-53e97b3569d7 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:29.681694 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba300c-6ab1-4f7d-be8e-53e97b3569d7 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:29.714219 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a142c1-f0d8-45ae-b7a8-0444ac7174bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:29.714849 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a142c1-f0d8-45ae-b7a8-0444ac7174bb None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:29.715154 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a142c1-f0d8-45ae-b7a8-0444ac7174bb None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:29.715430 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a142c1-f0d8-45ae-b7a8-0444ac7174bb None admin] PATH_INFO: `/v3/users/38e750e9a2484491a2b24494f9bdf156` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:29.716580 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a142c1-f0d8-45ae-b7a8-0444ac7174bb None admin] RBAC: Authorizing `identity:get_user(user_id=38e750e9a2484491a2b24494f9bdf156)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:29.718025 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a142c1-f0d8-45ae-b7a8-0444ac7174bb None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:29.719664 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 558/1121] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:31:29 2022] GET /identity/v3/users/38e750e9a2484491a2b24494f9bdf156 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:29.725745 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b091741-bb49-475c-a5ea-7e2986117fb9 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:29.808789 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:29.820418 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b091741-bb49-475c-a5ea-7e2986117fb9 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:29.853186 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40260029-12ae-48dc-8e5c-e8890ded9ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:29.853820 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40260029-12ae-48dc-8e5c-e8890ded9ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:29.854100 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40260029-12ae-48dc-8e5c-e8890ded9ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:29.854373 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40260029-12ae-48dc-8e5c-e8890ded9ac5 None admin] PATH_INFO: `/v3/projects/8bdee413c80b4a90b6f9461fabcf1614` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:29.855547 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40260029-12ae-48dc-8e5c-e8890ded9ac5 None admin] RBAC: Authorizing `identity:get_project(project_id=8bdee413c80b4a90b6f9461fabcf1614)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:29.856969 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40260029-12ae-48dc-8e5c-e8890ded9ac5 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:29.858622 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 564/1122] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:31:29 2022] GET /identity/v3/projects/8bdee413c80b4a90b6f9461fabcf1614 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:29.865296 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a142c1-f0d8-45ae-b7a8-0444ac7174bb None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:29.894857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:29.965636 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a142c1-f0d8-45ae-b7a8-0444ac7174bb None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:29.998641 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a1e7f-0491-4db4-83a5-f7adb3019bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:29.999318 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a1e7f-0491-4db4-83a5-f7adb3019bb6 None admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:29.999601 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a1e7f-0491-4db4-83a5-f7adb3019bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:29.999873 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a1e7f-0491-4db4-83a5-f7adb3019bb6 None admin] PATH_INFO: `/v3/projects/8bdee413c80b4a90b6f9461fabcf1614/users/38e750e9a2484491a2b24494f9bdf156/roles/428314713da6487e8047a1f333265cda` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:30.002571 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a1e7f-0491-4db4-83a5-f7adb3019bb6 None admin] RBAC: Authorizing `identity:create_grant(project_id=8bdee413c80b4a90b6f9461fabcf1614, user_id=38e750e9a2484491a2b24494f9bdf156, role_id=428314713da6487e8047a1f333265cda)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:30.004031 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a1e7f-0491-4db4-83a5-f7adb3019bb6 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:30.060703 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 559/1123] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 5 02:31:29 2022] PUT /identity/v3/projects/8bdee413c80b4a90b6f9461fabcf1614/users/38e750e9a2484491a2b24494f9bdf156/roles/428314713da6487e8047a1f333265cda => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:31:32.013968 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e04b7-3ea9-492e-acf5-de62d3f72c55 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:32.014533 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e04b7-3ea9-492e-acf5-de62d3f72c55 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:32.014533 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e04b7-3ea9-492e-acf5-de62d3f72c55 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:32.015917 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 565/1124] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:31:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:31:32.020941 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b5eda-d3af-4b41-a8e1-abf880f3e222 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:32.021316 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b5eda-d3af-4b41-a8e1-abf880f3e222 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:32.021499 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b5eda-d3af-4b41-a8e1-abf880f3e222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:32.039404 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-da3b5eda-d3af-4b41-a8e1-abf880f3e222 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:32.040586 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-da3b5eda-d3af-4b41-a8e1-abf880f3e222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:32.105564 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 560/1125] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:31:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:31:32.129455 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e04b7-3ea9-492e-acf5-de62d3f72c55 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:32.224985 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e04b7-3ea9-492e-acf5-de62d3f72c55 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:32.258024 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8018e81b-fff1-4299-a9e0-fdb3977abf0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:32.258648 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018e81b-fff1-4299-a9e0-fdb3977abf0c None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:32.258930 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018e81b-fff1-4299-a9e0-fdb3977abf0c None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:32.259236 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018e81b-fff1-4299-a9e0-fdb3977abf0c None admin] PATH_INFO: `/v3/roles/428314713da6487e8047a1f333265cda` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:32.260657 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8018e81b-fff1-4299-a9e0-fdb3977abf0c None admin] RBAC: Authorizing `identity:get_role(role_id=428314713da6487e8047a1f333265cda)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:32.262021 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8018e81b-fff1-4299-a9e0-fdb3977abf0c None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:32.263374 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 566/1126] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:31:32 2022] GET /identity/v3/roles/428314713da6487e8047a1f333265cda => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:32.269088 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b5eda-d3af-4b41-a8e1-abf880f3e222 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:32.290042 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:32.365169 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b5eda-d3af-4b41-a8e1-abf880f3e222 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:32.397099 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289650d-3a63-4da4-a278-8d80d9ddcb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:32.397725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289650d-3a63-4da4-a278-8d80d9ddcb9d None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:32.398009 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289650d-3a63-4da4-a278-8d80d9ddcb9d None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:32.398285 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289650d-3a63-4da4-a278-8d80d9ddcb9d None admin] PATH_INFO: `/v3/users/38e750e9a2484491a2b24494f9bdf156` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:32.399465 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8289650d-3a63-4da4-a278-8d80d9ddcb9d None admin] RBAC: Authorizing `identity:get_user(user_id=38e750e9a2484491a2b24494f9bdf156)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:32.400905 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8289650d-3a63-4da4-a278-8d80d9ddcb9d None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:32.402490 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 561/1127] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:31:32 2022] GET /identity/v3/users/38e750e9a2484491a2b24494f9bdf156 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:32.409003 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8018e81b-fff1-4299-a9e0-fdb3977abf0c None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:32.433690 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:32.505787 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8018e81b-fff1-4299-a9e0-fdb3977abf0c None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:32.537998 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb6bac-4224-4b83-b52b-46da74512db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:32.538547 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb6bac-4224-4b83-b52b-46da74512db0 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:32.538826 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb6bac-4224-4b83-b52b-46da74512db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:32.539125 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb6bac-4224-4b83-b52b-46da74512db0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:32.604213 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb6bac-4224-4b83-b52b-46da74512db0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:32.605657 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb6bac-4224-4b83-b52b-46da74512db0 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:32.628318 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:32.698768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 567/1128] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:31:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 02:31:32.705053 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289650d-3a63-4da4-a278-8d80d9ddcb9d None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:32.790809 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:32.802364 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289650d-3a63-4da4-a278-8d80d9ddcb9d None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:32.835527 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2c47e-51dc-4923-af22-86f5d52c4852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:32.836153 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2c47e-51dc-4923-af22-86f5d52c4852 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:32.836433 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2c47e-51dc-4923-af22-86f5d52c4852 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:32.836708 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2c47e-51dc-4923-af22-86f5d52c4852 None admin] PATH_INFO: `/v3/projects/8bdee413c80b4a90b6f9461fabcf1614` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:32.837838 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f2c47e-51dc-4923-af22-86f5d52c4852 None admin] RBAC: Authorizing `identity:get_project(project_id=8bdee413c80b4a90b6f9461fabcf1614)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:32.839311 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f2c47e-51dc-4923-af22-86f5d52c4852 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:32.840928 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 562/1129] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:31:32 2022] GET /identity/v3/projects/8bdee413c80b4a90b6f9461fabcf1614 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:32.847520 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb6bac-4224-4b83-b52b-46da74512db0 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:32.941613 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb6bac-4224-4b83-b52b-46da74512db0 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:32.964018 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:32.975094 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3c339-16cc-415d-8201-55f59352e358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:32.975707 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3c339-16cc-415d-8201-55f59352e358 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:32.975985 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3c339-16cc-415d-8201-55f59352e358 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:32.976258 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3c339-16cc-415d-8201-55f59352e358 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:32.977038 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3c339-16cc-415d-8201-55f59352e358 None admin] RBAC: Adding query filter params (role.id=428314713da6487e8047a1f333265cda, scope.project.id=8bdee413c80b4a90b6f9461fabcf1614, user.id=38e750e9a2484491a2b24494f9bdf156) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:32.977352 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3c339-16cc-415d-8201-55f59352e358 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:32.978774 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3c339-16cc-415d-8201-55f59352e358 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:32.985951 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 568/1130] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:31:32 2022] GET /identity/v3/role_assignments?user.id=38e750e9a2484491a2b24494f9bdf156&scope.project.id=8bdee413c80b4a90b6f9461fabcf1614&role.id=428314713da6487e8047a1f333265cda => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:34.977267 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c5630-97c2-4cf2-beff-1ce0489eb645 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:34.977797 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c5630-97c2-4cf2-beff-1ce0489eb645 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:34.977797 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c5630-97c2-4cf2-beff-1ce0489eb645 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:34.979192 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 563/1131] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:31:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:31:34.984691 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8fd85-609f-4dc8-9e3f-18fc44b4a992 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:34.985133 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8fd85-609f-4dc8-9e3f-18fc44b4a992 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:34.985236 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8fd85-609f-4dc8-9e3f-18fc44b4a992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:35.003342 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-76d8fd85-609f-4dc8-9e3f-18fc44b4a992 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:35.004498 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-76d8fd85-609f-4dc8-9e3f-18fc44b4a992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:35.070008 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 569/1132] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:31:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:31:35.092408 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c5630-97c2-4cf2-beff-1ce0489eb645 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:35.190209 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c5630-97c2-4cf2-beff-1ce0489eb645 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:35.222064 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246244d-44d0-49a9-a919-a7f2d3e01cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:35.222679 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246244d-44d0-49a9-a919-a7f2d3e01cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:35.223220 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246244d-44d0-49a9-a919-a7f2d3e01cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:35.223496 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246244d-44d0-49a9-a919-a7f2d3e01cc6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:35.224624 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246244d-44d0-49a9-a919-a7f2d3e01cc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:35.226087 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246244d-44d0-49a9-a919-a7f2d3e01cc6 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:35.229896 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 564/1133] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:31:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:35.233438 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8fd85-609f-4dc8-9e3f-18fc44b4a992 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:35.330270 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8fd85-609f-4dc8-9e3f-18fc44b4a992 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:35.347679 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:35.364092 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086f808-eabd-44d9-a112-67cd336eb546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:35.364720 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086f808-eabd-44d9-a112-67cd336eb546 None admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:35.365004 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086f808-eabd-44d9-a112-67cd336eb546 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:35.365282 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086f808-eabd-44d9-a112-67cd336eb546 None admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:35.365977 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6086f808-eabd-44d9-a112-67cd336eb546 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:35.367460 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6086f808-eabd-44d9-a112-67cd336eb546 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:35.467375 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 570/1134] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Aug 5 02:31:35 2022] POST /identity/v3/projects => generated 311 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:31:37.500883 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33445c5c-2e37-4b36-b7ec-a6c02031aa91 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:37.501445 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33445c5c-2e37-4b36-b7ec-a6c02031aa91 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:37.501445 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33445c5c-2e37-4b36-b7ec-a6c02031aa91 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:37.502751 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 565/1135] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:31:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:31:37.508167 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54cacb-b522-4f30-a968-0bcec104ffbd None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:37.508582 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54cacb-b522-4f30-a968-0bcec104ffbd None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:37.508729 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54cacb-b522-4f30-a968-0bcec104ffbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:37.527706 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-2a54cacb-b522-4f30-a968-0bcec104ffbd None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:37.528827 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-2a54cacb-b522-4f30-a968-0bcec104ffbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:37.593957 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 571/1136] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:31:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:31:37.618066 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33445c5c-2e37-4b36-b7ec-a6c02031aa91 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:37.643460 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:37.716477 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33445c5c-2e37-4b36-b7ec-a6c02031aa91 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:37.753051 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937ba92-ae82-49dd-a6be-4b7996db16e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:37.753681 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937ba92-ae82-49dd-a6be-4b7996db16e3 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:37.753956 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937ba92-ae82-49dd-a6be-4b7996db16e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:37.754231 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937ba92-ae82-49dd-a6be-4b7996db16e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:37.755384 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8937ba92-ae82-49dd-a6be-4b7996db16e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:37.756817 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8937ba92-ae82-49dd-a6be-4b7996db16e3 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:37.758378 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 566/1137] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:31:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:37.764174 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a54cacb-b522-4f30-a968-0bcec104ffbd None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:37.855719 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:37.858446 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a54cacb-b522-4f30-a968-0bcec104ffbd None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:37.890937 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f5388-ae0c-44f2-94b4-a3cc5afcf31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:37.891569 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f5388-ae0c-44f2-94b4-a3cc5afcf31f None admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:37.891842 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f5388-ae0c-44f2-94b4-a3cc5afcf31f None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:37.892113 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f5388-ae0c-44f2-94b4-a3cc5afcf31f None admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:37.892790 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f5388-ae0c-44f2-94b4-a3cc5afcf31f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:37.894200 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f5388-ae0c-44f2-94b4-a3cc5afcf31f None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:37.986632 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 572/1138] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 5 02:31:37 2022] POST /identity/v3/users => generated 286 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:31:40.027713 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2e592-0468-45eb-af76-c900be8aa330 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:40.028270 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2e592-0468-45eb-af76-c900be8aa330 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:40.028270 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2e592-0468-45eb-af76-c900be8aa330 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:40.029580 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 567/1139] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:31:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:31:40.035432 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14733231-5cbb-473c-a16f-c9a399f9cb50 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:40.035864 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14733231-5cbb-473c-a16f-c9a399f9cb50 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:40.035964 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14733231-5cbb-473c-a16f-c9a399f9cb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:40.054297 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-14733231-5cbb-473c-a16f-c9a399f9cb50 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:40.055506 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-14733231-5cbb-473c-a16f-c9a399f9cb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:40.121658 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 573/1140] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:31:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 02:31:40.144294 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2e592-0468-45eb-af76-c900be8aa330 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:40.237320 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:40.246470 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2e592-0468-45eb-af76-c900be8aa330 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:40.279430 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7788cb-0e82-446a-978c-325fccb3e9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:40.280012 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7788cb-0e82-446a-978c-325fccb3e9f3 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:40.280292 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7788cb-0e82-446a-978c-325fccb3e9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:40.281199 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7788cb-0e82-446a-978c-325fccb3e9f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:40.291123 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7788cb-0e82-446a-978c-325fccb3e9f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:31:40.295940 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-ef7788cb-0e82-446a-978c-325fccb3e9f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:31:40.295940 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:40.295940 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:31:40.295940 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:31:40.295940 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:31:40.295940 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:31:40.295940 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:31:40.295940 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:31:40.295940 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:31:40.295940 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:31:40.295940 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:31:40.295940 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:31:40.295940 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:31:40.295940 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:31:40.295940 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:31:40.295940 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:31:40.297138 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:31:40.297138 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:31:40.297138 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:31:40.297138 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:31:40.297138 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:31:40.297138 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:31:40.297138 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:31:40.297138 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:31:40.297138 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:31:40.297138 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:31:40.297138 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:31:40.297138 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:31:40.297138 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:31:40.297138 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:31:40.297138 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:31:40.297138 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:31:40.303030 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:31:40.303030 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:31:40.303030 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:31:40.303030 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:31:40.303030 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:31:40.303030 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:31:40.303030 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:31:40.303030 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:31:40.303030 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:31:40.303030 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:31:40.303030 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:31:40.303030 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:31:40.303030 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 568/1141] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 5 02:31:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:31:40.303978 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14733231-5cbb-473c-a16f-c9a399f9cb50 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:40.384842 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:40.399372 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14733231-5cbb-473c-a16f-c9a399f9cb50 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:40.432462 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a290a8-cd67-4866-bb8d-f8849c37a115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:40.433076 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a290a8-cd67-4866-bb8d-f8849c37a115 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:40.433355 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a290a8-cd67-4866-bb8d-f8849c37a115 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:40.433628 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a290a8-cd67-4866-bb8d-f8849c37a115 None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:40.434337 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a290a8-cd67-4866-bb8d-f8849c37a115 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:40.434643 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a290a8-cd67-4866-bb8d-f8849c37a115 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:40.436093 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a290a8-cd67-4866-bb8d-f8849c37a115 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:40.444182 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 574/1142] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:31:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:40.449919 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7788cb-0e82-446a-978c-325fccb3e9f3 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:40.546677 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7788cb-0e82-446a-978c-325fccb3e9f3 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:40.579250 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54baaa-a86e-48f0-9439-edfda6c73ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:40.579879 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54baaa-a86e-48f0-9439-edfda6c73ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:40.580165 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54baaa-a86e-48f0-9439-edfda6c73ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:40.580444 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54baaa-a86e-48f0-9439-edfda6c73ae8 None admin] PATH_INFO: `/v3/users/47c303714b9e46ff942710816878eedf` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:40.593093 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f54baaa-a86e-48f0-9439-edfda6c73ae8 None admin] RBAC: Authorizing `identity:get_user(user_id=47c303714b9e46ff942710816878eedf)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:40.594547 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f54baaa-a86e-48f0-9439-edfda6c73ae8 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:40.596166 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 569/1143] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:31:40 2022] GET /identity/v3/users/47c303714b9e46ff942710816878eedf => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:40.601944 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a290a8-cd67-4866-bb8d-f8849c37a115 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:40.698056 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a290a8-cd67-4866-bb8d-f8849c37a115 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:40.730531 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f6299-3ae1-43d4-98d4-1597d57ad3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:40.731160 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f6299-3ae1-43d4-98d4-1597d57ad3cf None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:40.731453 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f6299-3ae1-43d4-98d4-1597d57ad3cf None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:40.731811 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f6299-3ae1-43d4-98d4-1597d57ad3cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:40.748275 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:40.796148 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978f6299-3ae1-43d4-98d4-1597d57ad3cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:40.797633 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978f6299-3ae1-43d4-98d4-1597d57ad3cf None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:40.892670 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 575/1144] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:31:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 02:31:40.898791 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54baaa-a86e-48f0-9439-edfda6c73ae8 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:40.910625 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:40.994157 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54baaa-a86e-48f0-9439-edfda6c73ae8 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:41.026854 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966079f-2985-4179-97bf-8b1fba8c8d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:41.027504 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966079f-2985-4179-97bf-8b1fba8c8d64 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:41.027782 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966079f-2985-4179-97bf-8b1fba8c8d64 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:41.028315 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966079f-2985-4179-97bf-8b1fba8c8d64 None admin] PATH_INFO: `/v3/projects/57622970301c4ef0aa5f690a5ac6ec4e` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:41.029174 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9966079f-2985-4179-97bf-8b1fba8c8d64 None admin] RBAC: Authorizing `identity:get_project(project_id=57622970301c4ef0aa5f690a5ac6ec4e)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:41.030648 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9966079f-2985-4179-97bf-8b1fba8c8d64 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:41.032309 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 570/1145] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:31:40 2022] GET /identity/v3/projects/57622970301c4ef0aa5f690a5ac6ec4e => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:41.038291 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f6299-3ae1-43d4-98d4-1597d57ad3cf None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:41.085199 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:41.133942 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f6299-3ae1-43d4-98d4-1597d57ad3cf None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:41.165713 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dcf0ae-411e-426c-a37a-affd0014547e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:41.166319 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcf0ae-411e-426c-a37a-affd0014547e None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:41.166600 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcf0ae-411e-426c-a37a-affd0014547e None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:41.166875 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcf0ae-411e-426c-a37a-affd0014547e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:41.167804 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dcf0ae-411e-426c-a37a-affd0014547e None admin] RBAC: Adding query filter params (role.id=83afe883a303495b966480fb9b5bb7dd, scope.project.id=57622970301c4ef0aa5f690a5ac6ec4e, user.id=47c303714b9e46ff942710816878eedf) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:41.168115 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dcf0ae-411e-426c-a37a-affd0014547e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:41.169539 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dcf0ae-411e-426c-a37a-affd0014547e None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:41.175270 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 576/1146] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:31:41 2022] GET /identity/v3/role_assignments?user.id=47c303714b9e46ff942710816878eedf&scope.project.id=57622970301c4ef0aa5f690a5ac6ec4e&role.id=83afe883a303495b966480fb9b5bb7dd => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:43.132414 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d8688-e4ed-4dbf-83a2-db616b0142c2 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:43.133047 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d8688-e4ed-4dbf-83a2-db616b0142c2 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:43.133047 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d8688-e4ed-4dbf-83a2-db616b0142c2 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:43.134270 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 571/1147] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:31:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:31:43.139302 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621b7cd-a63b-434b-bd1e-e7ce72cb20bd None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:43.139795 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621b7cd-a63b-434b-bd1e-e7ce72cb20bd None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:43.140534 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621b7cd-a63b-434b-bd1e-e7ce72cb20bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:43.158034 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-8621b7cd-a63b-434b-bd1e-e7ce72cb20bd None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:43.159238 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-8621b7cd-a63b-434b-bd1e-e7ce72cb20bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:43.222296 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 577/1148] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:31:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:31:43.244250 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d8688-e4ed-4dbf-83a2-db616b0142c2 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:43.321456 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:43.346051 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d8688-e4ed-4dbf-83a2-db616b0142c2 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:43.383271 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece14443-b609-4b5b-b0ea-b583a43978a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:43.383805 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece14443-b609-4b5b-b0ea-b583a43978a7 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:43.384078 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece14443-b609-4b5b-b0ea-b583a43978a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:43.384343 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece14443-b609-4b5b-b0ea-b583a43978a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:43.394499 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece14443-b609-4b5b-b0ea-b583a43978a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:31:43.399340 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-ece14443-b609-4b5b-b0ea-b583a43978a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:31:43.399340 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:43.399340 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:31:43.399340 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:31:43.399340 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:31:43.399340 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:31:43.399340 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:31:43.399340 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:31:43.399340 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:31:43.399340 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:31:43.399340 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:31:43.399340 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:31:43.399340 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:31:43.399340 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:31:43.399340 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:31:43.399340 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:31:43.400450 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:31:43.400450 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:31:43.400450 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:31:43.400450 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:31:43.400450 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:31:43.400450 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:31:43.400450 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:31:43.400450 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:31:43.400450 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:31:43.400450 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:31:43.400450 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:31:43.400450 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:31:43.400450 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:31:43.400450 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:31:43.400450 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:31:43.400450 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:31:43.401503 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:31:43.401503 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:31:43.401503 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:31:43.401503 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:31:43.401503 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:31:43.401503 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:31:43.401503 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:31:43.401503 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:31:43.401503 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:31:43.401503 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:31:43.401503 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:31:43.401503 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:31:43.401503 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 572/1149] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 5 02:31:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:31:43.406468 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621b7cd-a63b-434b-bd1e-e7ce72cb20bd None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:43.447933 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:43.501789 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621b7cd-a63b-434b-bd1e-e7ce72cb20bd None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:43.533866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6995d85-0653-460e-82b5-ec0ae8857385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:43.534476 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6995d85-0653-460e-82b5-ec0ae8857385 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:43.534759 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6995d85-0653-460e-82b5-ec0ae8857385 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:43.535060 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6995d85-0653-460e-82b5-ec0ae8857385 None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:43.535765 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6995d85-0653-460e-82b5-ec0ae8857385 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:43.536067 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6995d85-0653-460e-82b5-ec0ae8857385 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:43.537427 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6995d85-0653-460e-82b5-ec0ae8857385 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:43.545081 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 578/1150] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:31:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:43.551369 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece14443-b609-4b5b-b0ea-b583a43978a7 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:43.646911 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece14443-b609-4b5b-b0ea-b583a43978a7 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:43.679317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48606320-6bc3-413c-8b53-d2691ca91259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:43.679939 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48606320-6bc3-413c-8b53-d2691ca91259 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:43.680217 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48606320-6bc3-413c-8b53-d2691ca91259 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:43.680485 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48606320-6bc3-413c-8b53-d2691ca91259 None admin] PATH_INFO: `/v3/users/47c303714b9e46ff942710816878eedf` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:43.681613 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48606320-6bc3-413c-8b53-d2691ca91259 None admin] RBAC: Authorizing `identity:get_user(user_id=47c303714b9e46ff942710816878eedf)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:43.683068 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48606320-6bc3-413c-8b53-d2691ca91259 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:43.684630 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 573/1151] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:31:43 2022] GET /identity/v3/users/47c303714b9e46ff942710816878eedf => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:43.690325 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6995d85-0653-460e-82b5-ec0ae8857385 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:43.784556 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6995d85-0653-460e-82b5-ec0ae8857385 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:43.786777 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:43.816319 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c6f5f-650f-488a-864b-8fada779959b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:43.816956 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c6f5f-650f-488a-864b-8fada779959b None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:43.817241 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c6f5f-650f-488a-864b-8fada779959b None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:43.817521 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c6f5f-650f-488a-864b-8fada779959b None admin] PATH_INFO: `/v3/projects/57622970301c4ef0aa5f690a5ac6ec4e` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:43.818671 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c6f5f-650f-488a-864b-8fada779959b None admin] RBAC: Authorizing `identity:get_project(project_id=57622970301c4ef0aa5f690a5ac6ec4e)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:43.820292 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c6f5f-650f-488a-864b-8fada779959b None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:43.823088 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 579/1152] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:31:43 2022] GET /identity/v3/projects/57622970301c4ef0aa5f690a5ac6ec4e => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:31:43.827871 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48606320-6bc3-413c-8b53-d2691ca91259 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:43.836816 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:43.925229 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48606320-6bc3-413c-8b53-d2691ca91259 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:43.957259 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39cceec-f260-42e8-9bd0-97e5d40801c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:43.957910 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cceec-f260-42e8-9bd0-97e5d40801c7 None admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:43.958195 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cceec-f260-42e8-9bd0-97e5d40801c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:43.958473 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cceec-f260-42e8-9bd0-97e5d40801c7 None admin] PATH_INFO: `/v3/projects/57622970301c4ef0aa5f690a5ac6ec4e/users/47c303714b9e46ff942710816878eedf/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:43.960451 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39cceec-f260-42e8-9bd0-97e5d40801c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=57622970301c4ef0aa5f690a5ac6ec4e, user_id=47c303714b9e46ff942710816878eedf, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:43.961885 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39cceec-f260-42e8-9bd0-97e5d40801c7 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:44.013890 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 574/1153] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 5 02:31:43 2022] PUT /identity/v3/projects/57622970301c4ef0aa5f690a5ac6ec4e/users/47c303714b9e46ff942710816878eedf/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:31:45.995186 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf61686-43f4-41e8-81fd-582a6962bf6b None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:45.995757 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf61686-43f4-41e8-81fd-582a6962bf6b None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:45.995757 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf61686-43f4-41e8-81fd-582a6962bf6b None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:45.997103 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 580/1154] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:31:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:31:46.002785 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e1bf9-74ea-416f-aff8-43aab469e8d4 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:46.003232 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e1bf9-74ea-416f-aff8-43aab469e8d4 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:46.003405 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e1bf9-74ea-416f-aff8-43aab469e8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:46.021617 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-164e1bf9-74ea-416f-aff8-43aab469e8d4 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:46.022798 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-164e1bf9-74ea-416f-aff8-43aab469e8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:46.080201 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:46.087404 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 575/1155] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:31:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:31:46.110714 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf61686-43f4-41e8-81fd-582a6962bf6b None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:46.208724 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf61686-43f4-41e8-81fd-582a6962bf6b None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:46.240806 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d9fab-b599-4fa2-851f-0788a388c8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:46.241434 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d9fab-b599-4fa2-851f-0788a388c8fe None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:46.241717 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d9fab-b599-4fa2-851f-0788a388c8fe None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:46.241992 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d9fab-b599-4fa2-851f-0788a388c8fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:46.252289 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d9fab-b599-4fa2-851f-0788a388c8fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:31:46.257043 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-776d9fab-b599-4fa2-851f-0788a388c8fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:31:46.257043 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:46.257043 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:31:46.257043 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:31:46.257043 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:31:46.257043 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:31:46.257043 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:31:46.257043 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:31:46.257043 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:31:46.257043 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:31:46.257043 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:31:46.257043 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:31:46.257043 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:31:46.257043 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:31:46.257043 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:31:46.257043 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:31:46.258126 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:31:46.258126 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:31:46.258126 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:31:46.258126 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:31:46.258126 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:31:46.258126 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:31:46.258126 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:31:46.258126 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:31:46.258126 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:31:46.258126 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:31:46.258126 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:31:46.258126 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:31:46.258126 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:31:46.258126 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:31:46.258126 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:31:46.258126 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:31:46.259352 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:31:46.259352 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:31:46.259352 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:31:46.259352 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:31:46.259352 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:31:46.259352 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:31:46.259352 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:31:46.259352 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:31:46.259352 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:31:46.259352 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:31:46.259352 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:31:46.259352 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:31:46.259352 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 581/1156] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 5 02:31:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:31:46.264008 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e1bf9-74ea-416f-aff8-43aab469e8d4 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:46.358577 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e1bf9-74ea-416f-aff8-43aab469e8d4 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:46.390628 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d27981-ebbb-4ada-87b5-d07d5d05ddbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:46.391319 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d27981-ebbb-4ada-87b5-d07d5d05ddbf None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:46.391599 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d27981-ebbb-4ada-87b5-d07d5d05ddbf None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:46.391871 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d27981-ebbb-4ada-87b5-d07d5d05ddbf None admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:46.392572 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d27981-ebbb-4ada-87b5-d07d5d05ddbf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:46.392872 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d27981-ebbb-4ada-87b5-d07d5d05ddbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:46.394233 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d27981-ebbb-4ada-87b5-d07d5d05ddbf None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:46.402039 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 576/1157] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:31:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:46.408330 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d9fab-b599-4fa2-851f-0788a388c8fe None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:46.439581 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:46.505707 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d9fab-b599-4fa2-851f-0788a388c8fe None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:46.537907 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c99412-f8db-404a-89b2-0ffaa3de78b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:46.538538 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c99412-f8db-404a-89b2-0ffaa3de78b8 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:46.538820 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c99412-f8db-404a-89b2-0ffaa3de78b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:46.539126 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c99412-f8db-404a-89b2-0ffaa3de78b8 None admin] PATH_INFO: `/v3/users/47c303714b9e46ff942710816878eedf` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:46.540273 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c99412-f8db-404a-89b2-0ffaa3de78b8 None admin] RBAC: Authorizing `identity:get_user(user_id=47c303714b9e46ff942710816878eedf)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:46.541695 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c99412-f8db-404a-89b2-0ffaa3de78b8 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:46.543309 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 582/1158] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:31:46 2022] GET /identity/v3/users/47c303714b9e46ff942710816878eedf => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:46.549025 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d27981-ebbb-4ada-87b5-d07d5d05ddbf None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:46.605101 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:46.646244 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d27981-ebbb-4ada-87b5-d07d5d05ddbf None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:46.678206 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f129b1-db20-4327-81e9-768255d463c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:46.678812 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f129b1-db20-4327-81e9-768255d463c2 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:46.679140 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f129b1-db20-4327-81e9-768255d463c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:46.679420 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f129b1-db20-4327-81e9-768255d463c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:46.744957 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f129b1-db20-4327-81e9-768255d463c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:46.746404 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f129b1-db20-4327-81e9-768255d463c2 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:46.800885 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:46.842774 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 577/1159] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:31:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 05 02:31:46.848675 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c99412-f8db-404a-89b2-0ffaa3de78b8 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:46.941624 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:46.944456 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c99412-f8db-404a-89b2-0ffaa3de78b8 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:46.976061 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd8cca-568a-4d63-846c-07979147a5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:46.976692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd8cca-568a-4d63-846c-07979147a5b6 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:46.976975 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd8cca-568a-4d63-846c-07979147a5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:46.977253 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd8cca-568a-4d63-846c-07979147a5b6 None admin] PATH_INFO: `/v3/projects/57622970301c4ef0aa5f690a5ac6ec4e` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:46.978391 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd8cca-568a-4d63-846c-07979147a5b6 None admin] RBAC: Authorizing `identity:get_project(project_id=57622970301c4ef0aa5f690a5ac6ec4e)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:46.979864 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd8cca-568a-4d63-846c-07979147a5b6 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:46.981490 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 583/1160] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:31:46 2022] GET /identity/v3/projects/57622970301c4ef0aa5f690a5ac6ec4e => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:46.987894 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f129b1-db20-4327-81e9-768255d463c2 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:47.081087 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f129b1-db20-4327-81e9-768255d463c2 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:47.113634 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78627607-ee02-44ec-a55f-a49f25db9005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:47.114234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78627607-ee02-44ec-a55f-a49f25db9005 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:47.114511 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78627607-ee02-44ec-a55f-a49f25db9005 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:47.114780 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78627607-ee02-44ec-a55f-a49f25db9005 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:47.115586 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78627607-ee02-44ec-a55f-a49f25db9005 None admin] RBAC: Adding query filter params (role.id=83afe883a303495b966480fb9b5bb7dd, scope.project.id=57622970301c4ef0aa5f690a5ac6ec4e, user.id=47c303714b9e46ff942710816878eedf) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:47.115888 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78627607-ee02-44ec-a55f-a49f25db9005 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:47.117297 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78627607-ee02-44ec-a55f-a49f25db9005 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:47.122813 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 578/1161] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:31:46 2022] GET /identity/v3/role_assignments?user.id=47c303714b9e46ff942710816878eedf&scope.project.id=57622970301c4ef0aa5f690a5ac6ec4e&role.id=83afe883a303495b966480fb9b5bb7dd => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:49.124407 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fe333-1558-4475-9874-f3223ef598f6 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:49.125134 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fe333-1558-4475-9874-f3223ef598f6 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:49.125134 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fe333-1558-4475-9874-f3223ef598f6 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:49.126325 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 584/1162] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:31:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:31:49.131689 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d5731-c980-4e37-b412-56e7696f83eb None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:49.132082 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d5731-c980-4e37-b412-56e7696f83eb None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:49.132235 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d5731-c980-4e37-b412-56e7696f83eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:49.149797 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-087d5731-c980-4e37-b412-56e7696f83eb None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:49.150987 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-087d5731-c980-4e37-b412-56e7696f83eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:49.167211 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:49.215805 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 579/1163] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:31:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:31:49.237810 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6fe333-1558-4475-9874-f3223ef598f6 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:49.335471 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6fe333-1558-4475-9874-f3223ef598f6 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:49.367835 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615af3c-a744-421f-b7ca-776fd7651073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:49.368451 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615af3c-a744-421f-b7ca-776fd7651073 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:49.368735 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615af3c-a744-421f-b7ca-776fd7651073 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:49.369012 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615af3c-a744-421f-b7ca-776fd7651073 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:49.401564 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:49.436388 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615af3c-a744-421f-b7ca-776fd7651073 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:49.437846 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615af3c-a744-421f-b7ca-776fd7651073 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:49.532725 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 585/1164] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:31:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 02:31:49.538709 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d5731-c980-4e37-b412-56e7696f83eb None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:49.633494 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d5731-c980-4e37-b412-56e7696f83eb None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:49.666415 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3495df-0bd2-4305-a4cb-0f76c0cc1abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:49.667020 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3495df-0bd2-4305-a4cb-0f76c0cc1abf None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:49.667308 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3495df-0bd2-4305-a4cb-0f76c0cc1abf None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:49.667582 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3495df-0bd2-4305-a4cb-0f76c0cc1abf None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:49.674057 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3495df-0bd2-4305-a4cb-0f76c0cc1abf None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:49.675540 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3495df-0bd2-4305-a4cb-0f76c0cc1abf None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:49.687233 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-df3495df-0bd2-4305-a4cb-0f76c0cc1abf None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 05 02:31:49.687233 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:49.687233 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 05 02:31:49.687233 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 05 02:31:49.687233 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:31:49.687233 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:31:49.687233 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:31:49.687233 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:31:49.687233 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 05 02:31:49.687233 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:31:49.687233 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:31:49.687233 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:31:49.687233 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:49.687233 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:31:49.687233 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:31:49.687233 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:31:49.687233 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:31:49.688267 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:31:49.688267 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:31:49.688267 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:31:49.688267 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:31:49.688267 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:31:49.688267 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:31:49.688267 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:31:49.688267 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:31:49.688267 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:31:49.688267 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:31:49.688267 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:31:49.688267 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:31:49.688267 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:31:49.688267 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:31:49.688267 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:31:49.688267 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:31:49.689383 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:31:49.689383 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:31:49.689383 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:31:49.689383 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:31:49.689383 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:31:49.689383 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:31:49.689383 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:31:49.689383 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:31:49.689383 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:31:49.689383 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:31:49.689383 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 05 02:31:49.689383 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:31:49.689383 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 05 02:31:49.689383 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:31:49.689383 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 580/1165] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Aug 5 02:31:49 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:31:49.694246 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615af3c-a744-421f-b7ca-776fd7651073 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:49.757710 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:49.789179 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615af3c-a744-421f-b7ca-776fd7651073 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:49.821566 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4175a-93e8-4242-9bac-e5614e64f9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:49.822178 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4175a-93e8-4242-9bac-e5614e64f9e2 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:49.822460 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4175a-93e8-4242-9bac-e5614e64f9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:49.822737 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4175a-93e8-4242-9bac-e5614e64f9e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:49.823454 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c4175a-93e8-4242-9bac-e5614e64f9e2 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:49.823764 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c4175a-93e8-4242-9bac-e5614e64f9e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:49.825130 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c4175a-93e8-4242-9bac-e5614e64f9e2 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:49.832585 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 586/1166] 10.222.0.42 () {56 vars in 1115 bytes} [Fri Aug 5 02:31:49 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:51.792330 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf99b05-e4cf-4555-abec-8e99e12351c9 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:51.792849 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf99b05-e4cf-4555-abec-8e99e12351c9 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:51.792958 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf99b05-e4cf-4555-abec-8e99e12351c9 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:51.794254 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 581/1167] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:31:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:31:51.799881 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96255ef-7e69-4765-87d0-e1141af31d54 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:51.800293 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96255ef-7e69-4765-87d0-e1141af31d54 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:51.800434 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96255ef-7e69-4765-87d0-e1141af31d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:51.818015 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-f96255ef-7e69-4765-87d0-e1141af31d54 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:51.819216 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-f96255ef-7e69-4765-87d0-e1141af31d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:51.883397 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 587/1168] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:31:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:31:51.906170 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf99b05-e4cf-4555-abec-8e99e12351c9 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:51.921201 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:52.005312 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf99b05-e4cf-4555-abec-8e99e12351c9 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:52.037643 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5611a77f-9e75-4047-84f0-ee15b5315b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:52.038246 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5611a77f-9e75-4047-84f0-ee15b5315b3f None admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:52.038531 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5611a77f-9e75-4047-84f0-ee15b5315b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:52.038811 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5611a77f-9e75-4047-84f0-ee15b5315b3f None admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:52.039536 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5611a77f-9e75-4047-84f0-ee15b5315b3f None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:52.040917 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5611a77f-9e75-4047-84f0-ee15b5315b3f None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:52.140345 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 582/1169] 10.222.0.42 () {60 vars in 1138 bytes} [Fri Aug 5 02:31:51 2022] POST /identity/v3/domains => generated 267 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:31:54.178545 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732914f6-a3cc-4f0e-bde4-4f7b41aa8455 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:54.200950 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732914f6-a3cc-4f0e-bde4-4f7b41aa8455 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:54.200950 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732914f6-a3cc-4f0e-bde4-4f7b41aa8455 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:54.200950 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 588/1170] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:31:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:31:54.201232 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da291945-5cc1-4b26-bf02-2e79d3af25f9 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:54.201232 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da291945-5cc1-4b26-bf02-2e79d3af25f9 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:54.201232 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da291945-5cc1-4b26-bf02-2e79d3af25f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:54.205105 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-da291945-5cc1-4b26-bf02-2e79d3af25f9 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:54.206282 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-da291945-5cc1-4b26-bf02-2e79d3af25f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:54.271122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 583/1171] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:31:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:31:54.293960 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732914f6-a3cc-4f0e-bde4-4f7b41aa8455 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:54.353594 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:54.391883 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732914f6-a3cc-4f0e-bde4-4f7b41aa8455 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:54.423892 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a31de51-4d3a-4a33-9088-339737f9a47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:54.424528 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31de51-4d3a-4a33-9088-339737f9a47d None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:54.424812 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31de51-4d3a-4a33-9088-339737f9a47d None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:54.425087 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31de51-4d3a-4a33-9088-339737f9a47d None admin] PATH_INFO: `/v3/domains/8d03cacfd198410f8089c05facd2c587` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:54.435199 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a31de51-4d3a-4a33-9088-339737f9a47d None admin] RBAC: Authorizing `identity:get_domain(domain_id=8d03cacfd198410f8089c05facd2c587)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:54.437198 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a31de51-4d3a-4a33-9088-339737f9a47d None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:54.438794 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 589/1172] 10.222.0.42 () {56 vars in 1183 bytes} [Fri Aug 5 02:31:54 2022] GET /identity/v3/domains/8d03cacfd198410f8089c05facd2c587 => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:54.444539 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da291945-5cc1-4b26-bf02-2e79d3af25f9 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:54.446675 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:54.540042 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da291945-5cc1-4b26-bf02-2e79d3af25f9 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:54.572873 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5025cc-ed06-404b-bf53-b6e78531424d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:54.573483 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5025cc-ed06-404b-bf53-b6e78531424d None admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:54.573765 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5025cc-ed06-404b-bf53-b6e78531424d None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:54.574039 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5025cc-ed06-404b-bf53-b6e78531424d None admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:54.574727 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5025cc-ed06-404b-bf53-b6e78531424d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:54.576200 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5025cc-ed06-404b-bf53-b6e78531424d None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:54.642673 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 584/1173] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Aug 5 02:31:54 2022] POST /identity/v3/projects => generated 361 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:31:56.640691 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa1989-5385-490b-a304-fd50a037caec None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:56.641204 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa1989-5385-490b-a304-fd50a037caec None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:56.641204 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa1989-5385-490b-a304-fd50a037caec None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:56.642510 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 590/1174] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:31:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:31:56.647527 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd546cc-a0aa-47b1-935f-aa732c637915 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:56.647959 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd546cc-a0aa-47b1-935f-aa732c637915 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:56.648085 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd546cc-a0aa-47b1-935f-aa732c637915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:56.665726 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-4fd546cc-a0aa-47b1-935f-aa732c637915 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:56.666899 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-4fd546cc-a0aa-47b1-935f-aa732c637915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:56.716847 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:56.733913 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 585/1175] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:31:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:31:56.758651 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa1989-5385-490b-a304-fd50a037caec None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:56.857375 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa1989-5385-490b-a304-fd50a037caec None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:56.879555 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:56.890528 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b3b65-41d2-459a-8273-f64b4c1612b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:56.891243 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b3b65-41d2-459a-8273-f64b4c1612b5 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:56.891480 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b3b65-41d2-459a-8273-f64b4c1612b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:56.891759 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b3b65-41d2-459a-8273-f64b4c1612b5 None admin] PATH_INFO: `/v3/domains/8d03cacfd198410f8089c05facd2c587` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:56.892925 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b3b65-41d2-459a-8273-f64b4c1612b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=8d03cacfd198410f8089c05facd2c587)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:56.894349 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b3b65-41d2-459a-8273-f64b4c1612b5 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:56.896038 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 591/1176] 10.222.0.42 () {56 vars in 1183 bytes} [Fri Aug 5 02:31:56 2022] GET /identity/v3/domains/8d03cacfd198410f8089c05facd2c587 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:56.902000 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd546cc-a0aa-47b1-935f-aa732c637915 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:56.999263 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd546cc-a0aa-47b1-935f-aa732c637915 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:57.031826 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956db88d-c9b8-4f07-b3a2-54d515b0a8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:57.032442 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956db88d-c9b8-4f07-b3a2-54d515b0a8ba None admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:57.032724 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956db88d-c9b8-4f07-b3a2-54d515b0a8ba None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:57.033000 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956db88d-c9b8-4f07-b3a2-54d515b0a8ba None admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:57.033685 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956db88d-c9b8-4f07-b3a2-54d515b0a8ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:57.035155 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956db88d-c9b8-4f07-b3a2-54d515b0a8ba None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:57.115889 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 586/1177] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 5 02:31:56 2022] POST /identity/v3/users => generated 311 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:31:59.151033 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a23d8a-151e-4554-acc0-5ee279ae9f2c None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:59.151587 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a23d8a-151e-4554-acc0-5ee279ae9f2c None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:59.151587 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a23d8a-151e-4554-acc0-5ee279ae9f2c None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:59.152930 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 592/1178] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:31:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:31:59.158598 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5badb584-b2f4-46d8-b4e0-88d00394e620 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:59.159050 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5badb584-b2f4-46d8-b4e0-88d00394e620 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:59.159189 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5badb584-b2f4-46d8-b4e0-88d00394e620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:59.176647 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-5badb584-b2f4-46d8-b4e0-88d00394e620 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:59.177806 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-5badb584-b2f4-46d8-b4e0-88d00394e620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:59.210486 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:59.242078 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 587/1179] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:31:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:31:59.265522 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a23d8a-151e-4554-acc0-5ee279ae9f2c None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:59.362615 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a23d8a-151e-4554-acc0-5ee279ae9f2c None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:59.394453 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fdfa4b-3cab-46d0-adbd-4ed5320ad8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:59.395106 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fdfa4b-3cab-46d0-adbd-4ed5320ad8e7 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:59.395389 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fdfa4b-3cab-46d0-adbd-4ed5320ad8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:59.395661 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fdfa4b-3cab-46d0-adbd-4ed5320ad8e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:59.405740 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fdfa4b-3cab-46d0-adbd-4ed5320ad8e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:31:59.410451 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-a7fdfa4b-3cab-46d0-adbd-4ed5320ad8e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:31:59.410451 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:31:59.410451 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:31:59.410451 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:31:59.410451 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:31:59.410451 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:31:59.410451 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:31:59.410451 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:31:59.410451 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:31:59.410451 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:31:59.410451 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:31:59.410451 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:31:59.410451 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:31:59.410451 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:31:59.410451 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:31:59.410451 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:31:59.411675 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:31:59.411675 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:31:59.411675 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:31:59.411675 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:31:59.411675 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:31:59.411675 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:31:59.411675 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:31:59.411675 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:31:59.411675 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:31:59.411675 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:31:59.411675 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:31:59.411675 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:31:59.411675 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:31:59.411675 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:31:59.411675 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:31:59.411675 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:31:59.412639 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:31:59.412639 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:31:59.412639 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:31:59.412639 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:31:59.412639 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:31:59.412639 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:31:59.412639 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:31:59.412639 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:31:59.412639 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:31:59.412639 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:31:59.412639 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:31:59.412639 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:31:59.412639 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 593/1180] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 5 02:31:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:31:59.417651 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5badb584-b2f4-46d8-b4e0-88d00394e620 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:59.517842 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5badb584-b2f4-46d8-b4e0-88d00394e620 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:59.549942 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625cffe-1a78-42a8-82d8-c8582de2fadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:59.550555 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625cffe-1a78-42a8-82d8-c8582de2fadc None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:59.550837 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625cffe-1a78-42a8-82d8-c8582de2fadc None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:59.551142 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625cffe-1a78-42a8-82d8-c8582de2fadc None admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:59.551850 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b625cffe-1a78-42a8-82d8-c8582de2fadc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:59.552152 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b625cffe-1a78-42a8-82d8-c8582de2fadc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:59.553531 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b625cffe-1a78-42a8-82d8-c8582de2fadc None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:59.561787 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 588/1181] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:31:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:59.567590 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fdfa4b-3cab-46d0-adbd-4ed5320ad8e7 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:59.615539 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:59.664511 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fdfa4b-3cab-46d0-adbd-4ed5320ad8e7 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:59.697076 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f4822-a98e-4564-96b9-dc7e731b9bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:59.697714 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f4822-a98e-4564-96b9-dc7e731b9bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:59.697999 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f4822-a98e-4564-96b9-dc7e731b9bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:59.698283 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f4822-a98e-4564-96b9-dc7e731b9bf7 None admin] PATH_INFO: `/v3/users/3f1e67cb877f41039f30a93bf5a791b6` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:59.710921 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f4822-a98e-4564-96b9-dc7e731b9bf7 None admin] RBAC: Authorizing `identity:get_user(user_id=3f1e67cb877f41039f30a93bf5a791b6)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:59.712395 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f4822-a98e-4564-96b9-dc7e731b9bf7 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:59.714013 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 594/1182] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:31:59 2022] GET /identity/v3/users/3f1e67cb877f41039f30a93bf5a791b6 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:59.719791 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625cffe-1a78-42a8-82d8-c8582de2fadc None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:59.751470 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:59.817338 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625cffe-1a78-42a8-82d8-c8582de2fadc None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:59.849444 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b743e8b-d9e9-4298-9316-c2341a4bd728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:59.850046 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b743e8b-d9e9-4298-9316-c2341a4bd728 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:59.850326 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b743e8b-d9e9-4298-9316-c2341a4bd728 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:59.850599 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b743e8b-d9e9-4298-9316-c2341a4bd728 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:59.915379 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b743e8b-d9e9-4298-9316-c2341a4bd728 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:59.916849 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b743e8b-d9e9-4298-9316-c2341a4bd728 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:59.944850 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:00.012322 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 589/1183] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:31:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 02:32:00.018795 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f4822-a98e-4564-96b9-dc7e731b9bf7 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:00.113180 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f4822-a98e-4564-96b9-dc7e731b9bf7 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:00.123335 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:00.146697 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa0e8d-2880-44c7-a292-fb8bd0157f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:00.147340 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa0e8d-2880-44c7-a292-fb8bd0157f23 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:00.147621 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa0e8d-2880-44c7-a292-fb8bd0157f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:00.147895 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa0e8d-2880-44c7-a292-fb8bd0157f23 None admin] PATH_INFO: `/v3/projects/c795bdfb3c39441c8fc7cf028b135d39` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:00.149024 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fa0e8d-2880-44c7-a292-fb8bd0157f23 None admin] RBAC: Authorizing `identity:get_project(project_id=c795bdfb3c39441c8fc7cf028b135d39)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:00.150437 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fa0e8d-2880-44c7-a292-fb8bd0157f23 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:00.152103 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 595/1184] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:32:00 2022] GET /identity/v3/projects/c795bdfb3c39441c8fc7cf028b135d39 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:32:00.158110 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b743e8b-d9e9-4298-9316-c2341a4bd728 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:00.258371 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b743e8b-d9e9-4298-9316-c2341a4bd728 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:00.293138 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:00.298600 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68b512-d402-4955-bcb2-2e6553db6300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:00.299246 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68b512-d402-4955-bcb2-2e6553db6300 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:00.299528 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68b512-d402-4955-bcb2-2e6553db6300 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:00.299804 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68b512-d402-4955-bcb2-2e6553db6300 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:00.300587 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de68b512-d402-4955-bcb2-2e6553db6300 None admin] RBAC: Adding query filter params (role.id=83afe883a303495b966480fb9b5bb7dd, scope.project.id=c795bdfb3c39441c8fc7cf028b135d39, user.id=3f1e67cb877f41039f30a93bf5a791b6) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:32:00.300894 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de68b512-d402-4955-bcb2-2e6553db6300 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:00.302332 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de68b512-d402-4955-bcb2-2e6553db6300 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:00.307805 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 590/1185] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:32:00 2022] GET /identity/v3/role_assignments?user.id=3f1e67cb877f41039f30a93bf5a791b6&scope.project.id=c795bdfb3c39441c8fc7cf028b135d39&role.id=83afe883a303495b966480fb9b5bb7dd => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:32:02.286414 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91af642-52e5-497b-8d30-0397ae152463 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:02.286866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91af642-52e5-497b-8d30-0397ae152463 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:02.286994 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91af642-52e5-497b-8d30-0397ae152463 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:02.288361 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 596/1186] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:32:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:32:02.293510 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4439896-407b-432d-9a34-48a075040c26 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:02.293933 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4439896-407b-432d-9a34-48a075040c26 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:02.294066 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4439896-407b-432d-9a34-48a075040c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:02.312588 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-e4439896-407b-432d-9a34-48a075040c26 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:32:02.313765 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-e4439896-407b-432d-9a34-48a075040c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:02.378216 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 591/1187] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:32:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:32:02.400767 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91af642-52e5-497b-8d30-0397ae152463 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:02.497451 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91af642-52e5-497b-8d30-0397ae152463 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:02.530825 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f556d-258a-4cf8-80e2-58386d0b3850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:02.531415 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f556d-258a-4cf8-80e2-58386d0b3850 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:02.531701 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f556d-258a-4cf8-80e2-58386d0b3850 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:02.531979 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f556d-258a-4cf8-80e2-58386d0b3850 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:02.541635 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f556d-258a-4cf8-80e2-58386d0b3850 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:32:02.547046 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-6b5f556d-258a-4cf8-80e2-58386d0b3850 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:32:02.547046 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:32:02.547046 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:32:02.547046 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:32:02.547046 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:32:02.547046 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:32:02.547046 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:32:02.547046 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:32:02.547046 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:32:02.547046 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:32:02.547046 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:32:02.547046 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:32:02.547046 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:32:02.547046 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:32:02.547046 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:32:02.547046 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:32:02.548231 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:32:02.548231 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:32:02.548231 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:32:02.548231 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:32:02.548231 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:32:02.548231 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:32:02.548231 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:32:02.548231 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:32:02.548231 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:32:02.548231 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:32:02.548231 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:32:02.548231 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:32:02.548231 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:32:02.548231 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:32:02.548231 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:32:02.548231 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:32:02.549283 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:32:02.549283 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:32:02.549283 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:32:02.549283 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:32:02.549283 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:32:02.549283 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:32:02.549283 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:32:02.549283 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:32:02.549283 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:32:02.549283 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:32:02.549283 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:32:02.549283 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:32:02.549283 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 597/1188] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 5 02:32:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:32:02.553996 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4439896-407b-432d-9a34-48a075040c26 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:02.649697 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4439896-407b-432d-9a34-48a075040c26 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:02.674382 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:02.682390 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be191405-a446-405c-84c2-6a477cf4c00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:02.683076 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be191405-a446-405c-84c2-6a477cf4c00c None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:02.689919 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be191405-a446-405c-84c2-6a477cf4c00c None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:02.689919 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be191405-a446-405c-84c2-6a477cf4c00c None admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:02.689919 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be191405-a446-405c-84c2-6a477cf4c00c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:32:02.689919 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be191405-a446-405c-84c2-6a477cf4c00c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:02.689919 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be191405-a446-405c-84c2-6a477cf4c00c None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:02.694303 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 592/1189] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:32:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:32:02.699981 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f556d-258a-4cf8-80e2-58386d0b3850 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:02.734677 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:02.795946 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f556d-258a-4cf8-80e2-58386d0b3850 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:02.828715 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2205e-be11-40ac-b78e-48d8dacc6616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:02.829334 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2205e-be11-40ac-b78e-48d8dacc6616 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:02.829612 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2205e-be11-40ac-b78e-48d8dacc6616 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:02.829884 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2205e-be11-40ac-b78e-48d8dacc6616 None admin] PATH_INFO: `/v3/users/3f1e67cb877f41039f30a93bf5a791b6` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:02.831045 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2205e-be11-40ac-b78e-48d8dacc6616 None admin] RBAC: Authorizing `identity:get_user(user_id=3f1e67cb877f41039f30a93bf5a791b6)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:02.832465 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2205e-be11-40ac-b78e-48d8dacc6616 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:02.834041 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 598/1190] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:32:02 2022] GET /identity/v3/users/3f1e67cb877f41039f30a93bf5a791b6 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:32:02.839708 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be191405-a446-405c-84c2-6a477cf4c00c None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:02.937169 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be191405-a446-405c-84c2-6a477cf4c00c None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:02.968777 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c7fcf9-f11c-40a8-a01f-866267ecd8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:02.969397 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7fcf9-f11c-40a8-a01f-866267ecd8d6 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:02.969677 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7fcf9-f11c-40a8-a01f-866267ecd8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:02.969950 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7fcf9-f11c-40a8-a01f-866267ecd8d6 None admin] PATH_INFO: `/v3/projects/c795bdfb3c39441c8fc7cf028b135d39` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:02.971197 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c7fcf9-f11c-40a8-a01f-866267ecd8d6 None admin] RBAC: Authorizing `identity:get_project(project_id=c795bdfb3c39441c8fc7cf028b135d39)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:02.972894 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c7fcf9-f11c-40a8-a01f-866267ecd8d6 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:02.974499 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 593/1191] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:32:02 2022] GET /identity/v3/projects/c795bdfb3c39441c8fc7cf028b135d39 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:32:02.980152 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2205e-be11-40ac-b78e-48d8dacc6616 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:03.073874 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2205e-be11-40ac-b78e-48d8dacc6616 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:03.076041 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:03.110373 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf869e-fe3a-4465-8e93-7499dd03eb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:03.111090 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf869e-fe3a-4465-8e93-7499dd03eb1f None admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:03.111644 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf869e-fe3a-4465-8e93-7499dd03eb1f None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:03.111924 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf869e-fe3a-4465-8e93-7499dd03eb1f None admin] PATH_INFO: `/v3/projects/c795bdfb3c39441c8fc7cf028b135d39/users/3f1e67cb877f41039f30a93bf5a791b6/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:03.113859 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf869e-fe3a-4465-8e93-7499dd03eb1f None admin] RBAC: Authorizing `identity:create_grant(project_id=c795bdfb3c39441c8fc7cf028b135d39, user_id=3f1e67cb877f41039f30a93bf5a791b6, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:03.115316 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf869e-fe3a-4465-8e93-7499dd03eb1f None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:03.201119 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 599/1192] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 5 02:32:02 2022] PUT /identity/v3/projects/c795bdfb3c39441c8fc7cf028b135d39/users/3f1e67cb877f41039f30a93bf5a791b6/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:32:05.146644 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e62b46-9fc0-481d-ad45-dd05d1cfaff4 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:05.147218 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e62b46-9fc0-481d-ad45-dd05d1cfaff4 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:05.147218 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e62b46-9fc0-481d-ad45-dd05d1cfaff4 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:05.148538 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 594/1193] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:32:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:32:05.154134 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487425d3-a2b7-4845-b7b8-efe9a5e76aeb None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:05.154573 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487425d3-a2b7-4845-b7b8-efe9a5e76aeb None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:05.154719 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487425d3-a2b7-4845-b7b8-efe9a5e76aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:05.172788 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-487425d3-a2b7-4845-b7b8-efe9a5e76aeb None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:32:05.173946 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-487425d3-a2b7-4845-b7b8-efe9a5e76aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:05.236501 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 600/1194] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:32:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:32:05.259861 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e62b46-9fc0-481d-ad45-dd05d1cfaff4 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:05.315123 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:05.358152 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e62b46-9fc0-481d-ad45-dd05d1cfaff4 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:05.390543 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ff249-67da-44f5-b03c-0449b92b0d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:05.391198 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ff249-67da-44f5-b03c-0449b92b0d6f None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:05.391478 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ff249-67da-44f5-b03c-0449b92b0d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:05.391749 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ff249-67da-44f5-b03c-0449b92b0d6f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:05.402001 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ff249-67da-44f5-b03c-0449b92b0d6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:32:05.407320 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-639ff249-67da-44f5-b03c-0449b92b0d6f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:32:05.407320 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:32:05.407320 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:32:05.407320 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:32:05.407320 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:32:05.407320 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:32:05.407320 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:32:05.407320 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:32:05.407320 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:32:05.407320 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:32:05.407320 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:32:05.407320 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:32:05.407320 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:32:05.407320 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:32:05.407320 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:32:05.407320 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:32:05.408418 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:32:05.408418 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:32:05.408418 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:32:05.408418 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:32:05.408418 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:32:05.408418 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:32:05.408418 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:32:05.408418 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:32:05.408418 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:32:05.408418 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:32:05.408418 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:32:05.408418 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:32:05.408418 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:32:05.408418 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:32:05.408418 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:32:05.408418 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:32:05.409455 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:32:05.409455 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:32:05.409455 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:32:05.409455 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:32:05.409455 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:32:05.409455 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:32:05.409455 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:32:05.409455 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:32:05.409455 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:32:05.409455 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:32:05.409455 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:32:05.409455 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:32:05.409455 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 595/1195] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 5 02:32:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:32:05.414671 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487425d3-a2b7-4845-b7b8-efe9a5e76aeb None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:05.507006 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:05.516904 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487425d3-a2b7-4845-b7b8-efe9a5e76aeb None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:05.554695 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e8e89-a6ff-4960-a59e-8aebb2951a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:05.555339 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e8e89-a6ff-4960-a59e-8aebb2951a36 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:05.555621 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e8e89-a6ff-4960-a59e-8aebb2951a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:05.555895 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e8e89-a6ff-4960-a59e-8aebb2951a36 None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:05.556609 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712e8e89-a6ff-4960-a59e-8aebb2951a36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:32:05.556917 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712e8e89-a6ff-4960-a59e-8aebb2951a36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:05.558284 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712e8e89-a6ff-4960-a59e-8aebb2951a36 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:05.566317 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 601/1196] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:32:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:32:05.571930 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ff249-67da-44f5-b03c-0449b92b0d6f None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:05.667024 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ff249-67da-44f5-b03c-0449b92b0d6f None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:05.684217 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:05.719776 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad34d07-da96-4570-8eed-1253715fc0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:05.720465 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad34d07-da96-4570-8eed-1253715fc0b1 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:05.720940 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad34d07-da96-4570-8eed-1253715fc0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:05.721423 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad34d07-da96-4570-8eed-1253715fc0b1 None admin] PATH_INFO: `/v3/users/3f1e67cb877f41039f30a93bf5a791b6` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:05.726836 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad34d07-da96-4570-8eed-1253715fc0b1 None admin] RBAC: Authorizing `identity:get_user(user_id=3f1e67cb877f41039f30a93bf5a791b6)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:05.728339 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad34d07-da96-4570-8eed-1253715fc0b1 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:05.729929 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 596/1197] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 5 02:32:05 2022] GET /identity/v3/users/3f1e67cb877f41039f30a93bf5a791b6 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:32:05.735896 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e8e89-a6ff-4960-a59e-8aebb2951a36 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:05.831675 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e8e89-a6ff-4960-a59e-8aebb2951a36 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:05.863943 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5eb93-9537-4200-9cb9-282aebf99634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:05.864549 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5eb93-9537-4200-9cb9-282aebf99634 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:05.864831 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5eb93-9537-4200-9cb9-282aebf99634 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:05.865109 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5eb93-9537-4200-9cb9-282aebf99634 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:05.888695 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:05.929845 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a5eb93-9537-4200-9cb9-282aebf99634 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:05.931268 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a5eb93-9537-4200-9cb9-282aebf99634 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:06.030624 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 602/1198] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:32:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 02:32:06.036529 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad34d07-da96-4570-8eed-1253715fc0b1 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:06.140988 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad34d07-da96-4570-8eed-1253715fc0b1 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:06.172209 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d1d71e-7e40-4222-9416-22598f1204a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:06.172838 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1d71e-7e40-4222-9416-22598f1204a2 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:06.173121 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1d71e-7e40-4222-9416-22598f1204a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:06.173397 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1d71e-7e40-4222-9416-22598f1204a2 None admin] PATH_INFO: `/v3/projects/c795bdfb3c39441c8fc7cf028b135d39` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:06.174529 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d1d71e-7e40-4222-9416-22598f1204a2 None admin] RBAC: Authorizing `identity:get_project(project_id=c795bdfb3c39441c8fc7cf028b135d39)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:06.175996 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d1d71e-7e40-4222-9416-22598f1204a2 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:06.177637 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 597/1199] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 5 02:32:06 2022] GET /identity/v3/projects/c795bdfb3c39441c8fc7cf028b135d39 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:32:06.189490 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5eb93-9537-4200-9cb9-282aebf99634 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:06.240485 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:06.282535 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5eb93-9537-4200-9cb9-282aebf99634 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:06.314735 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3037c5-8d36-48d7-b525-e00dd52f0b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:06.315373 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3037c5-8d36-48d7-b525-e00dd52f0b35 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:06.315650 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3037c5-8d36-48d7-b525-e00dd52f0b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:06.315921 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3037c5-8d36-48d7-b525-e00dd52f0b35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:06.316695 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3037c5-8d36-48d7-b525-e00dd52f0b35 None admin] RBAC: Adding query filter params (role.id=83afe883a303495b966480fb9b5bb7dd, scope.project.id=c795bdfb3c39441c8fc7cf028b135d39, user.id=3f1e67cb877f41039f30a93bf5a791b6) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:32:06.316998 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3037c5-8d36-48d7-b525-e00dd52f0b35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:06.318412 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3037c5-8d36-48d7-b525-e00dd52f0b35 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:06.323967 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 603/1200] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:32:06 2022] GET /identity/v3/role_assignments?user.id=3f1e67cb877f41039f30a93bf5a791b6&scope.project.id=c795bdfb3c39441c8fc7cf028b135d39&role.id=83afe883a303495b966480fb9b5bb7dd => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:32:16.168185 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=74 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:16.321412 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=40 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:16.185814 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c39f2-3d22-488b-957c-27c297fd185b None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:16.186400 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c39f2-3d22-488b-957c-27c297fd185b None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:16.186400 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c39f2-3d22-488b-957c-27c297fd185b None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:16.187725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 598/1201] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:33:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:33:16.192868 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb810c8-8175-4436-ab17-fe782228db25 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:16.193821 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb810c8-8175-4436-ab17-fe782228db25 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:16.193821 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb810c8-8175-4436-ab17-fe782228db25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:16.211025 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-9bb810c8-8175-4436-ab17-fe782228db25 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:33:16.212193 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-9bb810c8-8175-4436-ab17-fe782228db25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:33:16.276336 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 604/1202] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:33:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:33:16.300386 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c39f2-3d22-488b-957c-27c297fd185b None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:16.399654 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c39f2-3d22-488b-957c-27c297fd185b None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:16.433462 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce77b41-cdd0-4bfc-9d9d-2d0bb8b0a09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:16.434082 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce77b41-cdd0-4bfc-9d9d-2d0bb8b0a09f None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:16.434361 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce77b41-cdd0-4bfc-9d9d-2d0bb8b0a09f None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:16.434630 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce77b41-cdd0-4bfc-9d9d-2d0bb8b0a09f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:16.447369 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce77b41-cdd0-4bfc-9d9d-2d0bb8b0a09f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:16.447369 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce77b41-cdd0-4bfc-9d9d-2d0bb8b0a09f None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:16.461122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-1ce77b41-cdd0-4bfc-9d9d-2d0bb8b0a09f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:33:16.461122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:33:16.461122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:33:16.461122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:33:16.461122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:33:16.461122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:33:16.461122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:33:16.461122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:33:16.461122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:33:16.461122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:33:16.461122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:33:16.461122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:33:16.461122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:33:16.461122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:33:16.461122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:33:16.462317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:33:16.462317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:33:16.462317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:33:16.462317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:33:16.462317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:33:16.462317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:33:16.462317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:33:16.462317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:33:16.462317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:33:16.462317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:33:16.462317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:33:16.462317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:33:16.462317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:33:16.462317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:33:16.462317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:33:16.462317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:33:16.462317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:33:16.463724 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:33:16.463724 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:33:16.463724 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:33:16.463724 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:33:16.463724 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 599/1203] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:33:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:33:16.469030 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb810c8-8175-4436-ab17-fe782228db25 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:16.565241 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb810c8-8175-4436-ab17-fe782228db25 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:16.594113 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:16.599815 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dba875-9fa4-432f-9b0d-163bb34a7d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:16.600436 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dba875-9fa4-432f-9b0d-163bb34a7d71 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:16.600719 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dba875-9fa4-432f-9b0d-163bb34a7d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:16.601020 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dba875-9fa4-432f-9b0d-163bb34a7d71 None admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:16.601731 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dba875-9fa4-432f-9b0d-163bb34a7d71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:33:16.602039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dba875-9fa4-432f-9b0d-163bb34a7d71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:16.603510 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dba875-9fa4-432f-9b0d-163bb34a7d71 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:16.615154 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 605/1204] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:33:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:33:16.621081 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce77b41-cdd0-4bfc-9d9d-2d0bb8b0a09f None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:16.674243 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:16.719179 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce77b41-cdd0-4bfc-9d9d-2d0bb8b0a09f None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:16.752728 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf210bc-5342-4df3-a8e1-1c93e55f5284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:16.753347 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf210bc-5342-4df3-a8e1-1c93e55f5284 None admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:16.753627 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf210bc-5342-4df3-a8e1-1c93e55f5284 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:16.753897 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf210bc-5342-4df3-a8e1-1c93e55f5284 None admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:16.754577 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf210bc-5342-4df3-a8e1-1c93e55f5284 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:16.756133 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf210bc-5342-4df3-a8e1-1c93e55f5284 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:16.859803 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 600/1205] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 5 02:33:16 2022] POST /identity/v3/users => generated 251 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:33:18.890086 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b40f1-e8c5-4479-bdfd-c5c49407b674 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:18.890634 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b40f1-e8c5-4479-bdfd-c5c49407b674 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:18.890737 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b40f1-e8c5-4479-bdfd-c5c49407b674 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:18.892058 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 606/1206] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:33:18.897703 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209ba7a-2e3a-478d-ae6c-06e60e1d59fe None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:18.903473 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209ba7a-2e3a-478d-ae6c-06e60e1d59fe None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:18.903473 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209ba7a-2e3a-478d-ae6c-06e60e1d59fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:18.916199 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-7209ba7a-2e3a-478d-ae6c-06e60e1d59fe None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:33:18.917419 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-7209ba7a-2e3a-478d-ae6c-06e60e1d59fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:33:18.982379 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 601/1207] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:33:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:33:19.005681 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b40f1-e8c5-4479-bdfd-c5c49407b674 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:19.106343 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b40f1-e8c5-4479-bdfd-c5c49407b674 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:19.138618 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11cd0fe-e6b6-4b83-b55c-fbe928e32efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:19.139288 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cd0fe-e6b6-4b83-b55c-fbe928e32efc None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:19.139570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cd0fe-e6b6-4b83-b55c-fbe928e32efc None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:19.139844 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cd0fe-e6b6-4b83-b55c-fbe928e32efc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:19.150725 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11cd0fe-e6b6-4b83-b55c-fbe928e32efc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:33:19.155844 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-b11cd0fe-e6b6-4b83-b55c-fbe928e32efc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:33:19.155844 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:33:19.155844 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:33:19.155844 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:33:19.155844 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:33:19.155844 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:33:19.155844 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:33:19.155844 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:33:19.155844 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:33:19.155844 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:33:19.155844 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:33:19.155844 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:33:19.155844 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:33:19.155844 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:33:19.155844 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:33:19.155844 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:33:19.156983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:33:19.156983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:33:19.156983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:33:19.156983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:33:19.156983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:33:19.156983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:33:19.156983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:33:19.156983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:33:19.156983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:33:19.156983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:33:19.156983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:33:19.156983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:33:19.156983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:33:19.156983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:33:19.156983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:33:19.156983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:33:19.158071 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:33:19.158071 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:33:19.158071 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:33:19.158071 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:33:19.158071 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:33:19.158071 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:33:19.158071 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:33:19.158071 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:33:19.158071 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:33:19.158071 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:33:19.158071 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:33:19.158071 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:33:19.158071 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 607/1208] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 5 02:33:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:33:19.163183 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209ba7a-2e3a-478d-ae6c-06e60e1d59fe None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:19.201794 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:19.258297 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209ba7a-2e3a-478d-ae6c-06e60e1d59fe None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:19.292613 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c60fd-4935-440a-8231-0fccc6edce7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:19.293222 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c60fd-4935-440a-8231-0fccc6edce7f None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:19.293498 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c60fd-4935-440a-8231-0fccc6edce7f None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:19.293766 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c60fd-4935-440a-8231-0fccc6edce7f None admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:19.294468 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c60fd-4935-440a-8231-0fccc6edce7f None admin] RBAC: Adding query filter params (name=service) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:33:19.294769 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c60fd-4935-440a-8231-0fccc6edce7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:19.296219 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c60fd-4935-440a-8231-0fccc6edce7f None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:19.303890 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 602/1209] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 5 02:33:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:33:19.310397 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11cd0fe-e6b6-4b83-b55c-fbe928e32efc None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:19.358287 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:19.405947 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11cd0fe-e6b6-4b83-b55c-fbe928e32efc None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:19.442646 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2762b5-52a6-48fd-ad87-e64e1abaec91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:19.443308 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2762b5-52a6-48fd-ad87-e64e1abaec91 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:19.443588 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2762b5-52a6-48fd-ad87-e64e1abaec91 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:19.443860 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2762b5-52a6-48fd-ad87-e64e1abaec91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:19.454563 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2762b5-52a6-48fd-ad87-e64e1abaec91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:19.458343 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2762b5-52a6-48fd-ad87-e64e1abaec91 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:19.470905 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-2e2762b5-52a6-48fd-ad87-e64e1abaec91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:33:19.470905 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:33:19.470905 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:33:19.470905 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:33:19.470905 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:33:19.470905 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:33:19.470905 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:33:19.470905 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:33:19.470905 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:33:19.470905 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:33:19.470905 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:33:19.470905 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:33:19.470905 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:33:19.470905 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:33:19.470905 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:33:19.472000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:33:19.472000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:33:19.472000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:33:19.472000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:33:19.472000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:33:19.472000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:33:19.472000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:33:19.472000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:33:19.472000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:33:19.472000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:33:19.472000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:33:19.472000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:33:19.472000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:33:19.472000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:33:19.472000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:33:19.472000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:33:19.472000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:33:19.473235 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:33:19.473235 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:33:19.473235 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:33:19.473235 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:33:19.473235 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 608/1210] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:33:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:33:19.478032 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c60fd-4935-440a-8231-0fccc6edce7f None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:19.571310 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:19.574200 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c60fd-4935-440a-8231-0fccc6edce7f None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:19.606915 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203fed0-8ccb-46b3-ac3b-d4cbdc88bec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:19.607545 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203fed0-8ccb-46b3-ac3b-d4cbdc88bec3 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:19.607823 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203fed0-8ccb-46b3-ac3b-d4cbdc88bec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:19.608094 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203fed0-8ccb-46b3-ac3b-d4cbdc88bec3 None admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:19.608763 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203fed0-8ccb-46b3-ac3b-d4cbdc88bec3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:33:19.609059 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203fed0-8ccb-46b3-ac3b-d4cbdc88bec3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:19.610411 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203fed0-8ccb-46b3-ac3b-d4cbdc88bec3 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:19.621835 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 603/1211] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:33:19.627573 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2762b5-52a6-48fd-ad87-e64e1abaec91 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:19.726157 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2762b5-52a6-48fd-ad87-e64e1abaec91 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:19.727594 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:19.758828 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5192e-4c75-4d5d-8631-e24dea1d2a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:19.759493 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5192e-4c75-4d5d-8631-e24dea1d2a8a None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:19.759776 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5192e-4c75-4d5d-8631-e24dea1d2a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:19.760050 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5192e-4c75-4d5d-8631-e24dea1d2a8a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:19.767719 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac5192e-4c75-4d5d-8631-e24dea1d2a8a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:19.769159 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac5192e-4c75-4d5d-8631-e24dea1d2a8a None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:19.780745 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-dac5192e-4c75-4d5d-8631-e24dea1d2a8a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 05 02:33:19.780745 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:33:19.780745 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:33:19.780745 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:33:19.780745 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:33:19.780745 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:33:19.780745 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:33:19.780745 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:33:19.780745 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:33:19.780745 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:33:19.780745 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:33:19.780745 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:33:19.780745 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:33:19.780745 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:33:19.780745 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:33:19.780745 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:33:19.786594 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:33:19.786594 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:33:19.786594 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:33:19.786594 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:33:19.786594 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:33:19.786594 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:33:19.786594 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:33:19.786594 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:33:19.786594 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:33:19.786594 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:33:19.786594 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:33:19.786594 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:33:19.786594 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:33:19.786594 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:33:19.786594 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:33:19.786594 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:33:19.786594 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:33:19.786594 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:33:19.787893 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:33:19.787893 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:33:19.787893 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:33:19.787893 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:33:19.787893 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:33:19.787893 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:33:19.787893 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:33:19.787893 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:33:19.787893 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 05 02:33:19.787893 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:33:19.787893 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 609/1212] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:33:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:33:19.788668 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203fed0-8ccb-46b3-ac3b-d4cbdc88bec3 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:19.886022 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203fed0-8ccb-46b3-ac3b-d4cbdc88bec3 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:19.926478 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674d0ac-75b6-4a87-86a2-abf7a9828f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:19.927209 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674d0ac-75b6-4a87-86a2-abf7a9828f18 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:19.927432 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674d0ac-75b6-4a87-86a2-abf7a9828f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:19.927704 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674d0ac-75b6-4a87-86a2-abf7a9828f18 None admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:19.928489 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f674d0ac-75b6-4a87-86a2-abf7a9828f18 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:33:19.928793 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f674d0ac-75b6-4a87-86a2-abf7a9828f18 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:19.930255 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f674d0ac-75b6-4a87-86a2-abf7a9828f18 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:19.947335 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 604/1213] 10.222.0.42 () {56 vars in 1143 bytes} [Fri Aug 5 02:33:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:33:19.953592 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5192e-4c75-4d5d-8631-e24dea1d2a8a None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:20.050886 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5192e-4c75-4d5d-8631-e24dea1d2a8a None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:20.083597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc0573-e991-4eed-ae01-bc1f25826942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:20.084210 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc0573-e991-4eed-ae01-bc1f25826942 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:20.084488 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc0573-e991-4eed-ae01-bc1f25826942 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:20.084761 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc0573-e991-4eed-ae01-bc1f25826942 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:20.114312 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:20.151284 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc0573-e991-4eed-ae01-bc1f25826942 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:20.152734 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc0573-e991-4eed-ae01-bc1f25826942 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:20.250640 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 610/1214] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:33:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 02:33:20.256518 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674d0ac-75b6-4a87-86a2-abf7a9828f18 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:20.276150 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:20.356412 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674d0ac-75b6-4a87-86a2-abf7a9828f18 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:20.390121 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b5a7a-df47-4918-b2a1-8760e3636bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:20.390754 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b5a7a-df47-4918-b2a1-8760e3636bf1 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:20.391072 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b5a7a-df47-4918-b2a1-8760e3636bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:20.391352 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b5a7a-df47-4918-b2a1-8760e3636bf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:20.401126 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b5a7a-df47-4918-b2a1-8760e3636bf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:20.402591 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b5a7a-df47-4918-b2a1-8760e3636bf1 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:20.416891 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-338b5a7a-df47-4918-b2a1-8760e3636bf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:33:20.416891 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:33:20.416891 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:33:20.416891 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:33:20.416891 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:33:20.416891 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:33:20.416891 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:33:20.416891 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:33:20.416891 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:33:20.416891 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:33:20.416891 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:33:20.416891 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:33:20.416891 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:33:20.416891 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:33:20.416891 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:33:20.418002 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:33:20.418002 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:33:20.418002 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:33:20.418002 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:33:20.418002 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:33:20.418002 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:33:20.418002 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:33:20.418002 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:33:20.418002 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:33:20.418002 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:33:20.418002 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:33:20.418002 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:33:20.418002 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:33:20.418002 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:33:20.418002 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:33:20.418002 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:33:20.418002 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:33:20.419126 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:33:20.419126 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:33:20.419126 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:33:20.419126 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:33:20.419126 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 605/1215] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:33:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:33:20.423864 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc0573-e991-4eed-ae01-bc1f25826942 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:20.486289 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:20.523546 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc0573-e991-4eed-ae01-bc1f25826942 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:20.556798 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ceac8-344f-4fb7-be03-9ee3384b77ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:20.557421 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ceac8-344f-4fb7-be03-9ee3384b77ea None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:20.557703 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ceac8-344f-4fb7-be03-9ee3384b77ea None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:20.557978 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ceac8-344f-4fb7-be03-9ee3384b77ea None admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:20.558734 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ceac8-344f-4fb7-be03-9ee3384b77ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:33:20.559640 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ceac8-344f-4fb7-be03-9ee3384b77ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:20.561026 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ceac8-344f-4fb7-be03-9ee3384b77ea None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:20.571804 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 611/1216] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:33:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:33:20.577651 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b5a7a-df47-4918-b2a1-8760e3636bf1 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:20.644961 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:20.675176 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b5a7a-df47-4918-b2a1-8760e3636bf1 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:20.707345 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42e8a5-eb65-45fe-bce1-c4bed01a0766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:20.707962 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42e8a5-eb65-45fe-bce1-c4bed01a0766 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:20.708242 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42e8a5-eb65-45fe-bce1-c4bed01a0766 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:20.708513 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42e8a5-eb65-45fe-bce1-c4bed01a0766 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:20.714790 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb42e8a5-eb65-45fe-bce1-c4bed01a0766 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:20.716267 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb42e8a5-eb65-45fe-bce1-c4bed01a0766 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:20.727390 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-bb42e8a5-eb65-45fe-bce1-c4bed01a0766 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:33:20.727390 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:33:20.727390 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:33:20.727390 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:33:20.727390 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:33:20.727390 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:33:20.727390 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:33:20.727390 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:33:20.727390 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:33:20.727390 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:33:20.727390 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:33:20.727390 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:33:20.727390 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:33:20.727390 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:33:20.727390 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:33:20.728466 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:33:20.728466 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:33:20.728466 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:33:20.728466 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:33:20.728466 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:33:20.728466 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:33:20.728466 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:33:20.728466 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:33:20.728466 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:33:20.728466 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:33:20.728466 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:33:20.728466 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:33:20.728466 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:33:20.728466 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:33:20.728466 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:33:20.728466 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:33:20.728466 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:33:20.729721 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:33:20.729721 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:33:20.729721 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:33:20.729721 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:33:20.729721 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:33:20.729721 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:33:20.729721 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:33:20.729721 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:33:20.729721 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 606/1217] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:33:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:33:20.734900 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ceac8-344f-4fb7-be03-9ee3384b77ea None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:20.832357 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ceac8-344f-4fb7-be03-9ee3384b77ea None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:20.853462 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:20.864927 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fd1894-00eb-4db9-b1d6-eac2b4834e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:20.865535 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd1894-00eb-4db9-b1d6-eac2b4834e4a None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:20.865812 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd1894-00eb-4db9-b1d6-eac2b4834e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:20.866081 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd1894-00eb-4db9-b1d6-eac2b4834e4a None admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:20.866814 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fd1894-00eb-4db9-b1d6-eac2b4834e4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:33:20.867142 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fd1894-00eb-4db9-b1d6-eac2b4834e4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:20.868557 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fd1894-00eb-4db9-b1d6-eac2b4834e4a None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:20.880357 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 612/1218] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 5 02:33:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:33:20.886472 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42e8a5-eb65-45fe-bce1-c4bed01a0766 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:20.986146 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42e8a5-eb65-45fe-bce1-c4bed01a0766 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:21.014062 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:21.019692 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0d930-33f9-44e7-bd49-a956d42f452c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:21.020298 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0d930-33f9-44e7-bd49-a956d42f452c None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:21.020585 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0d930-33f9-44e7-bd49-a956d42f452c None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:21.020858 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0d930-33f9-44e7-bd49-a956d42f452c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:21.021629 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0d930-33f9-44e7-bd49-a956d42f452c None admin] RBAC: Adding query filter params (role.id=2642213efc7d4861b3d3b4f5fbc9ad73, scope.project.id=63b323c02a614fc28aac6e7a060064ba, user.id=8b647f2cb18a41d6a9e124e886faa994) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:33:21.021936 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0d930-33f9-44e7-bd49-a956d42f452c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:21.023599 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0d930-33f9-44e7-bd49-a956d42f452c None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:21.029399 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 607/1219] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:33:20 2022] GET /identity/v3/role_assignments?user.id=8b647f2cb18a41d6a9e124e886faa994&scope.project.id=63b323c02a614fc28aac6e7a060064ba&role.id=2642213efc7d4861b3d3b4f5fbc9ad73 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:33:23.014169 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da369148-d490-4080-b7fa-e91212f162ab None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:23.014745 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da369148-d490-4080-b7fa-e91212f162ab None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:23.014745 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da369148-d490-4080-b7fa-e91212f162ab None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:23.016118 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 613/1220] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:33:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:33:23.021330 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a15b1-6d08-4049-8573-96f59afd8d86 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:23.021781 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a15b1-6d08-4049-8573-96f59afd8d86 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:23.021911 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a15b1-6d08-4049-8573-96f59afd8d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:23.040390 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-cc3a15b1-6d08-4049-8573-96f59afd8d86 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:33:23.041667 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-cc3a15b1-6d08-4049-8573-96f59afd8d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:33:23.108398 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 608/1221] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:33:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:33:23.130553 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da369148-d490-4080-b7fa-e91212f162ab None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:23.236028 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da369148-d490-4080-b7fa-e91212f162ab None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:23.269466 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3f23b-f999-4c4e-a8de-a0553ea5b013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:23.270053 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3f23b-f999-4c4e-a8de-a0553ea5b013 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:23.270338 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3f23b-f999-4c4e-a8de-a0553ea5b013 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:23.270617 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3f23b-f999-4c4e-a8de-a0553ea5b013 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:23.280702 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c3f23b-f999-4c4e-a8de-a0553ea5b013 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:33:23.285657 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-a7c3f23b-f999-4c4e-a8de-a0553ea5b013 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:33:23.285657 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:33:23.285657 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:33:23.285657 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:33:23.285657 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:33:23.285657 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:33:23.285657 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:33:23.285657 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:33:23.285657 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:33:23.285657 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:33:23.285657 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:33:23.285657 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:33:23.285657 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:33:23.285657 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:33:23.285657 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:33:23.285657 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:33:23.286781 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:33:23.286781 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:33:23.286781 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:33:23.286781 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:33:23.286781 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:33:23.286781 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:33:23.286781 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:33:23.286781 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:33:23.286781 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:33:23.286781 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:33:23.286781 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:33:23.286781 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:33:23.286781 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:33:23.286781 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:33:23.286781 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:33:23.286781 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:33:23.287696 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:33:23.287696 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:33:23.287696 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:33:23.287696 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:33:23.287696 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:33:23.287696 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:33:23.287696 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:33:23.287696 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:33:23.287696 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:33:23.287696 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:33:23.287696 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:33:23.287696 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:33:23.287696 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 614/1222] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 5 02:33:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:33:23.293074 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a15b1-6d08-4049-8573-96f59afd8d86 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:23.389129 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a15b1-6d08-4049-8573-96f59afd8d86 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:23.411481 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:23.421720 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804bf987-2033-44d4-b73f-949df4b2e68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:23.422330 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bf987-2033-44d4-b73f-949df4b2e68b None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:23.422611 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bf987-2033-44d4-b73f-949df4b2e68b None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:23.422886 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bf987-2033-44d4-b73f-949df4b2e68b None admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:23.423618 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804bf987-2033-44d4-b73f-949df4b2e68b None admin] RBAC: Adding query filter params (name=service) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:33:23.423921 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804bf987-2033-44d4-b73f-949df4b2e68b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:23.425302 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804bf987-2033-44d4-b73f-949df4b2e68b None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:23.432827 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 609/1223] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 5 02:33:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:33:23.443857 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3f23b-f999-4c4e-a8de-a0553ea5b013 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:23.487149 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:23.540282 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3f23b-f999-4c4e-a8de-a0553ea5b013 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:23.574648 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f5768-4d7b-4aba-967a-74e08db594ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:23.575385 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f5768-4d7b-4aba-967a-74e08db594ee None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:23.575668 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f5768-4d7b-4aba-967a-74e08db594ee None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:23.575944 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f5768-4d7b-4aba-967a-74e08db594ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:23.585705 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f5768-4d7b-4aba-967a-74e08db594ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:23.587203 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f5768-4d7b-4aba-967a-74e08db594ee None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:23.601602 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-2f7f5768-4d7b-4aba-967a-74e08db594ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:33:23.601602 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:33:23.601602 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:33:23.601602 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:33:23.601602 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:33:23.601602 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:33:23.601602 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:33:23.601602 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:33:23.601602 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:33:23.601602 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:33:23.601602 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:33:23.601602 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:33:23.601602 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:33:23.601602 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:33:23.601602 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:33:23.602628 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:33:23.602628 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:33:23.602628 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:33:23.602628 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:33:23.602628 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:33:23.602628 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:33:23.602628 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:33:23.602628 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:33:23.602628 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:33:23.602628 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:33:23.602628 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:33:23.602628 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:33:23.602628 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:33:23.602628 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:33:23.602628 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:33:23.602628 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:33:23.602628 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:33:23.604054 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:33:23.604054 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:33:23.604054 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:33:23.604054 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:33:23.604054 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 615/1224] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:33:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:33:23.609153 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804bf987-2033-44d4-b73f-949df4b2e68b None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:23.707831 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804bf987-2033-44d4-b73f-949df4b2e68b None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:23.740783 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45bddc3-cf20-4fbd-b64f-6a37ba11f766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:23.741394 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bddc3-cf20-4fbd-b64f-6a37ba11f766 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:23.741668 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bddc3-cf20-4fbd-b64f-6a37ba11f766 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:23.741971 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bddc3-cf20-4fbd-b64f-6a37ba11f766 None admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:23.742649 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45bddc3-cf20-4fbd-b64f-6a37ba11f766 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:33:23.742991 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45bddc3-cf20-4fbd-b64f-6a37ba11f766 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:23.744357 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45bddc3-cf20-4fbd-b64f-6a37ba11f766 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:23.755746 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 610/1225] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:33:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:33:23.761439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f5768-4d7b-4aba-967a-74e08db594ee None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:23.853553 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:23.860199 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f5768-4d7b-4aba-967a-74e08db594ee None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:23.892575 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bacdf64-67b6-43b5-89c6-07a9954ad1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:23.893208 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacdf64-67b6-43b5-89c6-07a9954ad1bb None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:23.893492 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacdf64-67b6-43b5-89c6-07a9954ad1bb None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:23.893769 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacdf64-67b6-43b5-89c6-07a9954ad1bb None admin] PATH_INFO: `/v3/users/placement` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:23.901205 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bacdf64-67b6-43b5-89c6-07a9954ad1bb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:23.903278 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bacdf64-67b6-43b5-89c6-07a9954ad1bb None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:23.914193 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-2bacdf64-67b6-43b5-89c6-07a9954ad1bb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 05 02:33:23.914193 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:33:23.914193 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:33:23.914193 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:33:23.914193 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:33:23.914193 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:33:23.914193 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:33:23.914193 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:33:23.914193 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:33:23.914193 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:33:23.914193 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:33:23.914193 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:33:23.914193 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:33:23.914193 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:33:23.914193 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:33:23.914193 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:33:23.915263 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:33:23.915263 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:33:23.915263 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:33:23.915263 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:33:23.915263 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:33:23.915263 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:33:23.915263 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:33:23.915263 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:33:23.915263 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:33:23.915263 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:33:23.915263 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:33:23.915263 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:33:23.915263 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:33:23.915263 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:33:23.915263 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:33:23.915263 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:33:23.915263 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:33:23.915263 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:33:23.916311 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:33:23.916311 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:33:23.916311 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:33:23.916311 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:33:23.916311 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:33:23.916311 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:33:23.916311 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:33:23.916311 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:33:23.916311 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 05 02:33:23.916311 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:33:23.916311 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 616/1226] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:33:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:33:23.921404 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45bddc3-cf20-4fbd-b64f-6a37ba11f766 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:23.976127 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:24.027126 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45bddc3-cf20-4fbd-b64f-6a37ba11f766 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:24.061050 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a95ec7-498a-43a7-a365-3da9528daa4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:24.061664 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a95ec7-498a-43a7-a365-3da9528daa4d None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:24.061945 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a95ec7-498a-43a7-a365-3da9528daa4d None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:24.062220 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a95ec7-498a-43a7-a365-3da9528daa4d None admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:24.063028 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a95ec7-498a-43a7-a365-3da9528daa4d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:33:24.063336 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a95ec7-498a-43a7-a365-3da9528daa4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:24.064769 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a95ec7-498a-43a7-a365-3da9528daa4d None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:24.081789 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 611/1227] 10.222.0.42 () {56 vars in 1143 bytes} [Fri Aug 5 02:33:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:33:24.087536 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bacdf64-67b6-43b5-89c6-07a9954ad1bb None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:24.189258 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bacdf64-67b6-43b5-89c6-07a9954ad1bb None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:24.221419 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349f624-a7de-456d-be53-2213c50567b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:24.222377 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349f624-a7de-456d-be53-2213c50567b3 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:24.222655 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349f624-a7de-456d-be53-2213c50567b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:24.222927 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349f624-a7de-456d-be53-2213c50567b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:24.232970 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b349f624-a7de-456d-be53-2213c50567b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:24.234397 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b349f624-a7de-456d-be53-2213c50567b3 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:24.248772 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-b349f624-a7de-456d-be53-2213c50567b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:33:24.248772 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:33:24.248772 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:33:24.248772 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:33:24.248772 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:33:24.248772 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:33:24.248772 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:33:24.248772 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:33:24.248772 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:33:24.248772 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:33:24.248772 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:33:24.248772 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:33:24.248772 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:33:24.248772 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:33:24.248772 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:33:24.249825 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:33:24.249825 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:33:24.249825 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:33:24.249825 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:33:24.249825 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:33:24.249825 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:33:24.249825 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:33:24.249825 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:33:24.249825 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:33:24.249825 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:33:24.249825 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:33:24.249825 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:33:24.249825 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:33:24.249825 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:33:24.249825 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:33:24.249825 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:33:24.249825 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:33:24.250855 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:33:24.250855 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:33:24.250855 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:33:24.250855 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:33:24.250855 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 617/1228] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:33:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:33:24.255719 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a95ec7-498a-43a7-a365-3da9528daa4d None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:24.353166 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a95ec7-498a-43a7-a365-3da9528daa4d None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:24.355452 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:24.386725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d6cee-25a3-4705-a124-37423cb184e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:24.387364 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d6cee-25a3-4705-a124-37423cb184e3 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:24.387646 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d6cee-25a3-4705-a124-37423cb184e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:24.387922 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d6cee-25a3-4705-a124-37423cb184e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:24.388599 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0d6cee-25a3-4705-a124-37423cb184e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:33:24.388901 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0d6cee-25a3-4705-a124-37423cb184e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:24.390274 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0d6cee-25a3-4705-a124-37423cb184e3 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:24.401815 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 612/1229] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:33:24.406652 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349f624-a7de-456d-be53-2213c50567b3 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:24.415846 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:24.507276 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349f624-a7de-456d-be53-2213c50567b3 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:24.540453 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70217a-79dd-4d19-9a46-a5f732fc3059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:24.541091 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70217a-79dd-4d19-9a46-a5f732fc3059 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:24.541374 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70217a-79dd-4d19-9a46-a5f732fc3059 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:24.541650 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70217a-79dd-4d19-9a46-a5f732fc3059 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:24.548176 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d70217a-79dd-4d19-9a46-a5f732fc3059 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:24.549668 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d70217a-79dd-4d19-9a46-a5f732fc3059 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:24.560870 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-5d70217a-79dd-4d19-9a46-a5f732fc3059 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:33:24.560870 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:33:24.560870 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:33:24.560870 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:33:24.560870 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:33:24.560870 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:33:24.560870 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:33:24.560870 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:33:24.560870 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:33:24.560870 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:33:24.560870 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:33:24.560870 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:33:24.560870 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:33:24.560870 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:33:24.560870 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:33:24.564714 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:33:24.564714 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:33:24.564714 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:33:24.564714 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:33:24.564714 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:33:24.564714 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:33:24.564714 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:33:24.564714 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:33:24.564714 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:33:24.564714 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:33:24.564714 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:33:24.564714 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:33:24.564714 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:33:24.564714 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:33:24.564714 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:33:24.564714 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:33:24.564714 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:33:24.565615 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:33:24.565615 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:33:24.565615 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:33:24.565615 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:33:24.565615 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:33:24.565615 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:33:24.565615 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:33:24.565615 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:33:24.565615 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 618/1230] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:33:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:33:24.568371 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d6cee-25a3-4705-a124-37423cb184e3 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:24.667756 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d6cee-25a3-4705-a124-37423cb184e3 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:24.700925 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec7c3f-66d7-4077-81ee-1ebe4332b5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:24.701535 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec7c3f-66d7-4077-81ee-1ebe4332b5cb None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:24.701815 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec7c3f-66d7-4077-81ee-1ebe4332b5cb None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:24.702088 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec7c3f-66d7-4077-81ee-1ebe4332b5cb None admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:24.702819 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec7c3f-66d7-4077-81ee-1ebe4332b5cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:33:24.703154 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec7c3f-66d7-4077-81ee-1ebe4332b5cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:24.704600 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec7c3f-66d7-4077-81ee-1ebe4332b5cb None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:24.716511 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 613/1231] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 5 02:33:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:33:24.722829 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70217a-79dd-4d19-9a46-a5f732fc3059 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:24.786717 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:24.830191 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70217a-79dd-4d19-9a46-a5f732fc3059 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:24.867691 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2299c1ed-1dc9-47a9-a495-1eabefd340d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:24.868361 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299c1ed-1dc9-47a9-a495-1eabefd340d9 None admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:24.868643 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299c1ed-1dc9-47a9-a495-1eabefd340d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:24.868921 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299c1ed-1dc9-47a9-a495-1eabefd340d9 None admin] PATH_INFO: `/v3/projects/63b323c02a614fc28aac6e7a060064ba/users/8b647f2cb18a41d6a9e124e886faa994/roles/2642213efc7d4861b3d3b4f5fbc9ad73` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:24.883569 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2299c1ed-1dc9-47a9-a495-1eabefd340d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=63b323c02a614fc28aac6e7a060064ba, user_id=8b647f2cb18a41d6a9e124e886faa994, role_id=2642213efc7d4861b3d3b4f5fbc9ad73)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:24.885013 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2299c1ed-1dc9-47a9-a495-1eabefd340d9 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:24.983613 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 619/1232] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 5 02:33:24 2022] PUT /identity/v3/projects/63b323c02a614fc28aac6e7a060064ba/users/8b647f2cb18a41d6a9e124e886faa994/roles/2642213efc7d4861b3d3b4f5fbc9ad73 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:33:26.973575 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd82596-dc9d-4b62-a7f8-5c44b219e750 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:26.974139 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd82596-dc9d-4b62-a7f8-5c44b219e750 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:26.974139 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd82596-dc9d-4b62-a7f8-5c44b219e750 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:26.975501 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 614/1233] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:33:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:33:26.980574 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e6cc1-8741-416e-9efc-43b429c58cba None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:26.981013 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e6cc1-8741-416e-9efc-43b429c58cba None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:26.981160 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e6cc1-8741-416e-9efc-43b429c58cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:26.999766 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-5f2e6cc1-8741-416e-9efc-43b429c58cba None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:33:27.000952 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-5f2e6cc1-8741-416e-9efc-43b429c58cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:33:27.064686 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 620/1234] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:33:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:33:27.088366 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd82596-dc9d-4b62-a7f8-5c44b219e750 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:27.113636 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:27.187366 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd82596-dc9d-4b62-a7f8-5c44b219e750 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:27.221307 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c052b-3aea-49a1-8ce2-256cc37cfa0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:27.221933 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c052b-3aea-49a1-8ce2-256cc37cfa0f None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:27.222210 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c052b-3aea-49a1-8ce2-256cc37cfa0f None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:27.222477 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c052b-3aea-49a1-8ce2-256cc37cfa0f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:27.232321 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c052b-3aea-49a1-8ce2-256cc37cfa0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:33:27.237152 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-1d7c052b-3aea-49a1-8ce2-256cc37cfa0f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:33:27.237152 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:33:27.237152 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:33:27.237152 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:33:27.237152 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:33:27.237152 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:33:27.237152 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:33:27.237152 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:33:27.237152 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:33:27.237152 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:33:27.237152 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:33:27.237152 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:33:27.237152 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:33:27.237152 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:33:27.237152 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:33:27.237152 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:33:27.242001 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:33:27.242001 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:33:27.242001 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:33:27.242001 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:33:27.242001 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:33:27.242001 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:33:27.242001 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:33:27.242001 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:33:27.242001 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:33:27.242001 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:33:27.242001 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:33:27.242001 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:33:27.242001 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:33:27.242001 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:33:27.242001 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:33:27.242001 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:33:27.243342 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:33:27.243342 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:33:27.243342 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:33:27.243342 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:33:27.243342 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:33:27.243342 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:33:27.243342 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:33:27.243342 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:33:27.243342 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:33:27.243342 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:33:27.243342 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:33:27.243342 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:33:27.243342 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 615/1235] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 5 02:33:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:33:27.244570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e6cc1-8741-416e-9efc-43b429c58cba None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:27.299155 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:27.349804 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e6cc1-8741-416e-9efc-43b429c58cba None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:27.382024 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0d020-81ce-4b33-9a7c-db44040bc375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:27.382632 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0d020-81ce-4b33-9a7c-db44040bc375 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:27.382911 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0d020-81ce-4b33-9a7c-db44040bc375 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:27.383213 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0d020-81ce-4b33-9a7c-db44040bc375 None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:27.383920 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd0d020-81ce-4b33-9a7c-db44040bc375 None admin] RBAC: Adding query filter params (name=service) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:33:27.384218 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd0d020-81ce-4b33-9a7c-db44040bc375 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:27.385590 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd0d020-81ce-4b33-9a7c-db44040bc375 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:27.393268 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 621/1236] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 5 02:33:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:33:27.399368 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c052b-3aea-49a1-8ce2-256cc37cfa0f None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:27.483177 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:27.498559 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c052b-3aea-49a1-8ce2-256cc37cfa0f None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:27.534516 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db75516-52a1-45e6-9a2f-b818eed1516d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:27.535213 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db75516-52a1-45e6-9a2f-b818eed1516d None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:27.535493 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db75516-52a1-45e6-9a2f-b818eed1516d None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:27.535767 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db75516-52a1-45e6-9a2f-b818eed1516d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:27.545609 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db75516-52a1-45e6-9a2f-b818eed1516d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:27.547077 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db75516-52a1-45e6-9a2f-b818eed1516d None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:27.561015 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-1db75516-52a1-45e6-9a2f-b818eed1516d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:33:27.561015 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:33:27.561015 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:33:27.561015 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:33:27.561015 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:33:27.561015 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:33:27.561015 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:33:27.561015 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:33:27.561015 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:33:27.561015 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:33:27.561015 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:33:27.561015 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:33:27.561015 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:33:27.561015 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:33:27.561015 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:33:27.567186 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:33:27.567186 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:33:27.567186 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:33:27.567186 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:33:27.567186 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:33:27.567186 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:33:27.567186 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:33:27.567186 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:33:27.567186 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:33:27.567186 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:33:27.567186 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:33:27.567186 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:33:27.567186 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:33:27.567186 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:33:27.567186 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:33:27.567186 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:33:27.567186 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:33:27.568345 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:33:27.568345 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:33:27.568345 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:33:27.568345 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:33:27.568345 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 616/1237] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:33:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:33:27.568708 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0d020-81ce-4b33-9a7c-db44040bc375 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:27.664251 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0d020-81ce-4b33-9a7c-db44040bc375 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:27.695842 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8f7aa-4b8a-4f5f-a54a-18d416109211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:27.696451 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8f7aa-4b8a-4f5f-a54a-18d416109211 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:27.696730 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8f7aa-4b8a-4f5f-a54a-18d416109211 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:27.697000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8f7aa-4b8a-4f5f-a54a-18d416109211 None admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:27.697716 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8f7aa-4b8a-4f5f-a54a-18d416109211 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:33:27.698015 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8f7aa-4b8a-4f5f-a54a-18d416109211 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:27.699990 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8f7aa-4b8a-4f5f-a54a-18d416109211 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:27.711228 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 622/1238] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:33:27.712634 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:27.717119 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db75516-52a1-45e6-9a2f-b818eed1516d None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:27.820726 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db75516-52a1-45e6-9a2f-b818eed1516d None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:27.853240 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3f989-3f4b-46fe-82e8-3f673c115d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:27.853866 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3f989-3f4b-46fe-82e8-3f673c115d83 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:27.854145 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3f989-3f4b-46fe-82e8-3f673c115d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:27.854414 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3f989-3f4b-46fe-82e8-3f673c115d83 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:27.857071 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:27.861791 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f3f989-3f4b-46fe-82e8-3f673c115d83 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:27.863316 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f3f989-3f4b-46fe-82e8-3f673c115d83 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:27.874662 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-b4f3f989-3f4b-46fe-82e8-3f673c115d83 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 05 02:33:27.874662 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:33:27.874662 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:33:27.874662 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:33:27.874662 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:33:27.874662 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:33:27.874662 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:33:27.874662 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:33:27.874662 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:33:27.874662 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:33:27.874662 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:33:27.874662 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:33:27.874662 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:33:27.874662 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:33:27.874662 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:33:27.874662 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:33:27.878744 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:33:27.878744 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:33:27.878744 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:33:27.878744 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:33:27.878744 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:33:27.878744 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:33:27.878744 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:33:27.878744 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:33:27.878744 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:33:27.878744 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:33:27.878744 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:33:27.878744 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:33:27.878744 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:33:27.878744 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:33:27.878744 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:33:27.878744 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:33:27.878744 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:33:27.878744 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:33:27.880660 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:33:27.880660 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:33:27.880660 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:33:27.880660 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:33:27.880660 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:33:27.880660 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:33:27.880660 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:33:27.880660 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:33:27.880660 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 05 02:33:27.880660 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:33:27.880660 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 617/1239] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:33:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:33:27.881864 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8f7aa-4b8a-4f5f-a54a-18d416109211 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:27.979563 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8f7aa-4b8a-4f5f-a54a-18d416109211 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:28.012504 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9005cf7d-93d5-48be-95a5-6aec9058c098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:28.013105 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9005cf7d-93d5-48be-95a5-6aec9058c098 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:28.013374 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9005cf7d-93d5-48be-95a5-6aec9058c098 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:28.013645 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9005cf7d-93d5-48be-95a5-6aec9058c098 None admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:28.014418 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9005cf7d-93d5-48be-95a5-6aec9058c098 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:33:28.014717 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9005cf7d-93d5-48be-95a5-6aec9058c098 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:28.016169 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9005cf7d-93d5-48be-95a5-6aec9058c098 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:28.032438 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 623/1240] 10.222.0.42 () {56 vars in 1143 bytes} [Fri Aug 5 02:33:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:33:28.038370 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3f989-3f4b-46fe-82e8-3f673c115d83 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:28.142296 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3f989-3f4b-46fe-82e8-3f673c115d83 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:28.174653 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb4f59-8d83-4626-965a-1b0e89eaa4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:28.175281 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb4f59-8d83-4626-965a-1b0e89eaa4a4 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:28.175562 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb4f59-8d83-4626-965a-1b0e89eaa4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:28.175834 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb4f59-8d83-4626-965a-1b0e89eaa4a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:28.235441 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:28.241894 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb4f59-8d83-4626-965a-1b0e89eaa4a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:28.243386 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb4f59-8d83-4626-965a-1b0e89eaa4a4 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:28.345998 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 618/1241] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:33:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 02:33:28.351886 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9005cf7d-93d5-48be-95a5-6aec9058c098 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:28.379789 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:28.449617 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9005cf7d-93d5-48be-95a5-6aec9058c098 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:28.483288 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc192dd-cf3a-4e89-a6af-e6633dcd142c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:28.483927 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc192dd-cf3a-4e89-a6af-e6633dcd142c None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:28.484214 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc192dd-cf3a-4e89-a6af-e6633dcd142c None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:28.484484 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc192dd-cf3a-4e89-a6af-e6633dcd142c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:28.494169 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc192dd-cf3a-4e89-a6af-e6633dcd142c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:28.495652 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc192dd-cf3a-4e89-a6af-e6633dcd142c None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:28.510603 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-1cc192dd-cf3a-4e89-a6af-e6633dcd142c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:33:28.510603 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:33:28.510603 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:33:28.510603 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:33:28.510603 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:33:28.510603 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:33:28.510603 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:33:28.510603 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:33:28.510603 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:33:28.510603 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:33:28.510603 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:33:28.510603 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:33:28.510603 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:33:28.510603 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:33:28.510603 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:33:28.516653 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:33:28.516653 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:33:28.516653 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:33:28.516653 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:33:28.516653 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:33:28.516653 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:33:28.516653 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:33:28.516653 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:33:28.516653 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:33:28.516653 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:33:28.516653 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:33:28.516653 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:33:28.516653 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:33:28.516653 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:33:28.516653 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:33:28.516653 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:33:28.516653 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:33:28.517606 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:33:28.517606 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:33:28.517606 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:33:28.517606 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:33:28.517606 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 624/1242] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:33:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:33:28.517907 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb4f59-8d83-4626-965a-1b0e89eaa4a4 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:28.610458 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:28.616156 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb4f59-8d83-4626-965a-1b0e89eaa4a4 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:28.649527 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41fe10-4240-468c-9ee0-e0dd6efc095c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:28.650145 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41fe10-4240-468c-9ee0-e0dd6efc095c None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:28.650428 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41fe10-4240-468c-9ee0-e0dd6efc095c None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:28.650730 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41fe10-4240-468c-9ee0-e0dd6efc095c None admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:28.651452 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e41fe10-4240-468c-9ee0-e0dd6efc095c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:33:28.654307 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e41fe10-4240-468c-9ee0-e0dd6efc095c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:28.654307 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e41fe10-4240-468c-9ee0-e0dd6efc095c None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:28.665558 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 619/1243] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:33:28.671316 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc192dd-cf3a-4e89-a6af-e6633dcd142c None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:28.747970 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:28.768250 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc192dd-cf3a-4e89-a6af-e6633dcd142c None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:28.801106 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865c0cc-36d2-45fd-8e89-94f5ee82b532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:28.801755 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865c0cc-36d2-45fd-8e89-94f5ee82b532 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:28.802188 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865c0cc-36d2-45fd-8e89-94f5ee82b532 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:28.802922 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865c0cc-36d2-45fd-8e89-94f5ee82b532 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:28.809479 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c865c0cc-36d2-45fd-8e89-94f5ee82b532 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:28.810911 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c865c0cc-36d2-45fd-8e89-94f5ee82b532 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:28.821961 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-c865c0cc-36d2-45fd-8e89-94f5ee82b532 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:33:28.821961 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:33:28.821961 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:33:28.821961 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:33:28.821961 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:33:28.821961 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:33:28.821961 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:33:28.821961 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:33:28.821961 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:33:28.821961 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:33:28.821961 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:33:28.821961 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:33:28.821961 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:33:28.821961 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:33:28.821961 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:33:28.823021 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:33:28.823021 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:33:28.823021 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:33:28.823021 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:33:28.823021 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:33:28.823021 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:33:28.823021 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:33:28.823021 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:33:28.823021 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:33:28.823021 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:33:28.823021 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:33:28.823021 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:33:28.823021 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:33:28.823021 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:33:28.823021 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:33:28.823021 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:33:28.823021 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:33:28.824691 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:33:28.824691 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:33:28.824691 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:33:28.824691 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:33:28.824691 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:33:28.824691 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:33:28.824691 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:33:28.824691 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:33:28.824691 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 625/1244] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:33:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:33:28.829582 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41fe10-4240-468c-9ee0-e0dd6efc095c None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:28.928528 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41fe10-4240-468c-9ee0-e0dd6efc095c None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:28.961351 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf9372-71ed-4222-aae9-96f42fea88e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:28.961967 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf9372-71ed-4222-aae9-96f42fea88e1 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:28.962248 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf9372-71ed-4222-aae9-96f42fea88e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:28.962520 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf9372-71ed-4222-aae9-96f42fea88e1 None admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:28.963302 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf9372-71ed-4222-aae9-96f42fea88e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:33:28.963590 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf9372-71ed-4222-aae9-96f42fea88e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:28.965633 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf9372-71ed-4222-aae9-96f42fea88e1 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:28.977484 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 620/1245] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 5 02:33:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:33:28.983594 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865c0cc-36d2-45fd-8e89-94f5ee82b532 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:29.079704 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865c0cc-36d2-45fd-8e89-94f5ee82b532 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:29.112875 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69a7a11-c387-40cd-a438-e2c8953afcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:29.113485 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a7a11-c387-40cd-a438-e2c8953afcf4 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:29.113797 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a7a11-c387-40cd-a438-e2c8953afcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:29.114040 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a7a11-c387-40cd-a438-e2c8953afcf4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:29.114818 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69a7a11-c387-40cd-a438-e2c8953afcf4 None admin] RBAC: Adding query filter params (role.id=2642213efc7d4861b3d3b4f5fbc9ad73, scope.project.id=63b323c02a614fc28aac6e7a060064ba, user.id=8b647f2cb18a41d6a9e124e886faa994) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:33:29.115153 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69a7a11-c387-40cd-a438-e2c8953afcf4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:29.116584 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69a7a11-c387-40cd-a438-e2c8953afcf4 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:29.122326 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 626/1246] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:33:28 2022] GET /identity/v3/role_assignments?user.id=8b647f2cb18a41d6a9e124e886faa994&scope.project.id=63b323c02a614fc28aac6e7a060064ba&role.id=2642213efc7d4861b3d3b4f5fbc9ad73 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:33:31.173707 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f0739-463c-47b5-b02d-c13aa0651a8e None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:31.174259 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f0739-463c-47b5-b02d-c13aa0651a8e None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:31.174259 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f0739-463c-47b5-b02d-c13aa0651a8e None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:31.175618 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 621/1247] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:33:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:33:31.180692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d815ab-f0aa-4574-a976-52cf6542a6ae None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:31.181104 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d815ab-f0aa-4574-a976-52cf6542a6ae None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:31.181286 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d815ab-f0aa-4574-a976-52cf6542a6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:31.188200 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:31.200819 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-41d815ab-f0aa-4574-a976-52cf6542a6ae None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:33:31.202005 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-41d815ab-f0aa-4574-a976-52cf6542a6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:33:31.266086 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 627/1248] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:33:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:33:31.289615 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f0739-463c-47b5-b02d-c13aa0651a8e None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:31.307385 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:31.390299 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f0739-463c-47b5-b02d-c13aa0651a8e None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:31.424673 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd58442-d29f-4296-a196-088467bbe621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:31.425458 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd58442-d29f-4296-a196-088467bbe621 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:31.425748 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd58442-d29f-4296-a196-088467bbe621 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:31.426099 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd58442-d29f-4296-a196-088467bbe621 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:31.436679 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd58442-d29f-4296-a196-088467bbe621 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:33:31.441551 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-fdd58442-d29f-4296-a196-088467bbe621 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:33:31.441551 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:33:31.441551 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:33:31.441551 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:33:31.441551 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:33:31.441551 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:33:31.441551 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:33:31.441551 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:33:31.441551 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:33:31.441551 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:33:31.441551 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:33:31.441551 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:33:31.441551 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:33:31.441551 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:33:31.441551 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:33:31.441551 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:33:31.446857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:33:31.446857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:33:31.446857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:33:31.446857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:33:31.446857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:33:31.446857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:33:31.446857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:33:31.446857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:33:31.446857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:33:31.446857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:33:31.446857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:33:31.446857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:33:31.446857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:33:31.446857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:33:31.446857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:33:31.446857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:33:31.447961 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:33:31.447961 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:33:31.447961 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:33:31.447961 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:33:31.447961 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:33:31.447961 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:33:31.447961 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:33:31.447961 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:33:31.447961 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:33:31.447961 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:33:31.447961 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:33:31.447961 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:33:31.447961 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 622/1249] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 5 02:33:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:33:31.449783 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d815ab-f0aa-4574-a976-52cf6542a6ae None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:31.545729 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d815ab-f0aa-4574-a976-52cf6542a6ae None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:31.574573 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:31.579385 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6833fa-fb34-476b-ae29-178b4a57b299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:31.580003 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6833fa-fb34-476b-ae29-178b4a57b299 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:31.580294 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6833fa-fb34-476b-ae29-178b4a57b299 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:31.580565 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6833fa-fb34-476b-ae29-178b4a57b299 None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:31.581276 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6833fa-fb34-476b-ae29-178b4a57b299 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:33:31.581579 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6833fa-fb34-476b-ae29-178b4a57b299 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:31.582976 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6833fa-fb34-476b-ae29-178b4a57b299 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:31.590740 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 628/1250] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:33:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:33:31.596733 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd58442-d29f-4296-a196-088467bbe621 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:31.672929 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:31.698720 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd58442-d29f-4296-a196-088467bbe621 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:31.731737 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5c51b-2903-47cf-939c-8ddf4e88041c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:31.732373 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5c51b-2903-47cf-939c-8ddf4e88041c None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:31.732653 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5c51b-2903-47cf-939c-8ddf4e88041c None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:31.732928 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5c51b-2903-47cf-939c-8ddf4e88041c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:31.743516 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e5c51b-2903-47cf-939c-8ddf4e88041c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:31.744956 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e5c51b-2903-47cf-939c-8ddf4e88041c None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:31.759892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-d9e5c51b-2903-47cf-939c-8ddf4e88041c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:33:31.759892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:33:31.759892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:33:31.759892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:33:31.759892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:33:31.759892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:33:31.759892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:33:31.759892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:33:31.759892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:33:31.759892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:33:31.759892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:33:31.759892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:33:31.759892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:33:31.759892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:33:31.759892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:33:31.760968 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:33:31.760968 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:33:31.760968 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:33:31.760968 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:33:31.760968 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:33:31.760968 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:33:31.760968 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:33:31.760968 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:33:31.760968 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:33:31.760968 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:33:31.760968 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:33:31.760968 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:33:31.760968 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:33:31.760968 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:33:31.760968 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:33:31.760968 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:33:31.760968 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:33:31.762610 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:33:31.762610 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:33:31.762610 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:33:31.762610 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:33:31.762610 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 623/1251] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:33:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:33:31.767374 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6833fa-fb34-476b-ae29-178b4a57b299 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:31.865581 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6833fa-fb34-476b-ae29-178b4a57b299 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:31.897713 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e067a42-4239-40d4-acdf-9b276df17eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:31.898320 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e067a42-4239-40d4-acdf-9b276df17eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:31.898597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e067a42-4239-40d4-acdf-9b276df17eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:31.898872 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e067a42-4239-40d4-acdf-9b276df17eb3 None admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:31.899642 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e067a42-4239-40d4-acdf-9b276df17eb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:33:31.899941 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e067a42-4239-40d4-acdf-9b276df17eb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:31.901346 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e067a42-4239-40d4-acdf-9b276df17eb3 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:31.914052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 629/1252] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:33:31.919736 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5c51b-2903-47cf-939c-8ddf4e88041c None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:32.025100 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5c51b-2903-47cf-939c-8ddf4e88041c None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:32.050429 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:32.058238 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec94df-d148-4239-9f99-cd7899cfb014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:32.058867 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec94df-d148-4239-9f99-cd7899cfb014 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:32.059178 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec94df-d148-4239-9f99-cd7899cfb014 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:32.059458 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec94df-d148-4239-9f99-cd7899cfb014 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:32.066596 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec94df-d148-4239-9f99-cd7899cfb014 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:32.068065 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec94df-d148-4239-9f99-cd7899cfb014 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:32.079387 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-9aec94df-d148-4239-9f99-cd7899cfb014 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 05 02:33:32.079387 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:33:32.079387 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:33:32.079387 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:33:32.079387 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:33:32.079387 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:33:32.079387 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:33:32.079387 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:33:32.079387 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:33:32.079387 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:33:32.079387 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:33:32.079387 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:33:32.079387 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:33:32.079387 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:33:32.079387 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:33:32.079387 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:33:32.080508 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:33:32.080508 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:33:32.080508 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:33:32.080508 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:33:32.080508 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:33:32.080508 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:33:32.080508 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:33:32.080508 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:33:32.080508 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:33:32.080508 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:33:32.080508 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:33:32.080508 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:33:32.080508 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:33:32.080508 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:33:32.080508 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:33:32.080508 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:33:32.080508 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:33:32.080508 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:33:32.081718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:33:32.081718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:33:32.081718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:33:32.081718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:33:32.081718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:33:32.081718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:33:32.081718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:33:32.081718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:33:32.081718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 05 02:33:32.081718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:33:32.081718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 624/1253] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:33:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:33:32.088364 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e067a42-4239-40d4-acdf-9b276df17eb3 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:32.145810 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:32.189083 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e067a42-4239-40d4-acdf-9b276df17eb3 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:32.221502 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866850a7-f769-4ead-a4cf-2e736f053b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:32.222115 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866850a7-f769-4ead-a4cf-2e736f053b8e None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:32.222394 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866850a7-f769-4ead-a4cf-2e736f053b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:32.222680 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866850a7-f769-4ead-a4cf-2e736f053b8e None admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:32.223490 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866850a7-f769-4ead-a4cf-2e736f053b8e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:33:32.223792 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866850a7-f769-4ead-a4cf-2e736f053b8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:32.225232 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866850a7-f769-4ead-a4cf-2e736f053b8e None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:32.241567 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 630/1254] 10.222.0.42 () {56 vars in 1143 bytes} [Fri Aug 5 02:33:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:33:32.248187 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec94df-d148-4239-9f99-cd7899cfb014 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:32.346765 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec94df-d148-4239-9f99-cd7899cfb014 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:32.379323 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b72bc-f518-4087-a9fa-60509d2c558c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:32.379939 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b72bc-f518-4087-a9fa-60509d2c558c None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:32.380222 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b72bc-f518-4087-a9fa-60509d2c558c None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:32.380499 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b72bc-f518-4087-a9fa-60509d2c558c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:32.438800 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:32.452273 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b72bc-f518-4087-a9fa-60509d2c558c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:32.453765 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b72bc-f518-4087-a9fa-60509d2c558c None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:32.552996 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 625/1255] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:33:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 02:33:32.559472 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866850a7-f769-4ead-a4cf-2e736f053b8e None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:32.656415 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866850a7-f769-4ead-a4cf-2e736f053b8e None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:32.669589 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:32.689971 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7459dd-2558-4ca2-a190-0e7b2ce06ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:32.690612 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7459dd-2558-4ca2-a190-0e7b2ce06ec6 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:32.690894 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7459dd-2558-4ca2-a190-0e7b2ce06ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:32.691253 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7459dd-2558-4ca2-a190-0e7b2ce06ec6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:32.700981 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7459dd-2558-4ca2-a190-0e7b2ce06ec6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:32.702422 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7459dd-2558-4ca2-a190-0e7b2ce06ec6 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:32.716753 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-ae7459dd-2558-4ca2-a190-0e7b2ce06ec6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:33:32.716753 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:33:32.716753 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:33:32.716753 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:33:32.716753 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:33:32.716753 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:33:32.716753 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:33:32.716753 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:33:32.716753 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:33:32.716753 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:33:32.716753 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:33:32.716753 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:33:32.716753 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:33:32.716753 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:33:32.716753 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:33:32.718780 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:33:32.718780 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:33:32.718780 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:33:32.718780 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:33:32.718780 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:33:32.718780 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:33:32.718780 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:33:32.718780 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:33:32.718780 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:33:32.718780 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:33:32.718780 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:33:32.718780 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:33:32.718780 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:33:32.718780 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:33:32.718780 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:33:32.718780 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:33:32.718780 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:33:32.720736 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:33:32.720736 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:33:32.720736 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:33:32.720736 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:33:32.720736 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 631/1256] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:33:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:33:32.724373 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b72bc-f518-4087-a9fa-60509d2c558c None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:32.811580 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:32.823115 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b72bc-f518-4087-a9fa-60509d2c558c None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:32.855970 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227efe1b-5495-4407-89e3-c5fb9f84f4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:32.856581 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227efe1b-5495-4407-89e3-c5fb9f84f4a2 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:32.856863 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227efe1b-5495-4407-89e3-c5fb9f84f4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:32.857134 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227efe1b-5495-4407-89e3-c5fb9f84f4a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:32.857812 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227efe1b-5495-4407-89e3-c5fb9f84f4a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:33:32.858117 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227efe1b-5495-4407-89e3-c5fb9f84f4a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:32.859515 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227efe1b-5495-4407-89e3-c5fb9f84f4a2 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:32.870163 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 626/1257] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:33:32.876428 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7459dd-2558-4ca2-a190-0e7b2ce06ec6 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:32.974721 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7459dd-2558-4ca2-a190-0e7b2ce06ec6 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:33.008125 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3574589-9fb7-44bc-bf1c-1c881b7f4a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:33.008760 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3574589-9fb7-44bc-bf1c-1c881b7f4a53 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:33.009042 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3574589-9fb7-44bc-bf1c-1c881b7f4a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:33.009315 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3574589-9fb7-44bc-bf1c-1c881b7f4a53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:33.015823 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3574589-9fb7-44bc-bf1c-1c881b7f4a53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:33.017264 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3574589-9fb7-44bc-bf1c-1c881b7f4a53 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:33.028957 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-b3574589-9fb7-44bc-bf1c-1c881b7f4a53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:33:33.028957 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:33:33.028957 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:33:33.028957 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:33:33.028957 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:33:33.028957 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:33:33.028957 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:33:33.028957 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:33:33.028957 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:33:33.028957 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:33:33.028957 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:33:33.028957 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:33:33.028957 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:33:33.028957 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:33:33.028957 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:33:33.030052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:33:33.030052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:33:33.030052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:33:33.030052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:33:33.030052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:33:33.030052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:33:33.030052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:33:33.030052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:33:33.030052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:33:33.030052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:33:33.030052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:33:33.030052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:33:33.030052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:33:33.030052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:33:33.030052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:33:33.030052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:33:33.030052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:33:33.031298 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:33:33.031298 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:33:33.031298 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:33:33.031298 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:33:33.031298 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:33:33.031298 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:33:33.031298 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:33:33.031298 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:33:33.031298 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 632/1258] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:33:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:33:33.036151 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227efe1b-5495-4407-89e3-c5fb9f84f4a2 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:33.135192 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227efe1b-5495-4407-89e3-c5fb9f84f4a2 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:33.168416 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a978f9-6adb-43aa-b190-9b3e6007400f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:33.169028 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a978f9-6adb-43aa-b190-9b3e6007400f None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:33.169338 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a978f9-6adb-43aa-b190-9b3e6007400f None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:33.169616 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a978f9-6adb-43aa-b190-9b3e6007400f None admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:33.170355 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a978f9-6adb-43aa-b190-9b3e6007400f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:33:33.170665 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a978f9-6adb-43aa-b190-9b3e6007400f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:33.172226 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a978f9-6adb-43aa-b190-9b3e6007400f None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:33.184727 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 627/1259] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 5 02:33:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:33:33.190780 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3574589-9fb7-44bc-bf1c-1c881b7f4a53 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:33.216222 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:33.288488 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3574589-9fb7-44bc-bf1c-1c881b7f4a53 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:33.320824 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf2e1d-9757-4187-a841-b01294fedd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:33.321632 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf2e1d-9757-4187-a841-b01294fedd18 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:33.322096 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf2e1d-9757-4187-a841-b01294fedd18 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:33.322426 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf2e1d-9757-4187-a841-b01294fedd18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:33.324343 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf2e1d-9757-4187-a841-b01294fedd18 None admin] RBAC: Adding query filter params (role.id=83afe883a303495b966480fb9b5bb7dd, scope.project.id=63b323c02a614fc28aac6e7a060064ba, user.id=8b647f2cb18a41d6a9e124e886faa994) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:33:33.324650 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf2e1d-9757-4187-a841-b01294fedd18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:33.326083 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf2e1d-9757-4187-a841-b01294fedd18 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:33.331567 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 633/1260] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:33:33 2022] GET /identity/v3/role_assignments?user.id=8b647f2cb18a41d6a9e124e886faa994&scope.project.id=63b323c02a614fc28aac6e7a060064ba&role.id=83afe883a303495b966480fb9b5bb7dd => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:33:35.308778 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d607ce-ad11-4851-82ea-7f1799c1fc91 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:35.309288 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d607ce-ad11-4851-82ea-7f1799c1fc91 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:35.309393 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d607ce-ad11-4851-82ea-7f1799c1fc91 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:35.310671 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 628/1261] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:33:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:33:35.315795 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da1523-813d-4113-be9c-d0e45518802b None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:35.316198 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da1523-813d-4113-be9c-d0e45518802b None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:35.316352 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da1523-813d-4113-be9c-d0e45518802b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:35.335094 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-88da1523-813d-4113-be9c-d0e45518802b None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:33:35.336282 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-88da1523-813d-4113-be9c-d0e45518802b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:33:35.402248 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 634/1262] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:33:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:33:35.423774 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d607ce-ad11-4851-82ea-7f1799c1fc91 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:35.434756 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:35.522338 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d607ce-ad11-4851-82ea-7f1799c1fc91 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:35.555163 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221cc485-24c8-4f2e-bc95-8cab4aea1128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:35.555767 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cc485-24c8-4f2e-bc95-8cab4aea1128 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:35.556045 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cc485-24c8-4f2e-bc95-8cab4aea1128 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:35.556340 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cc485-24c8-4f2e-bc95-8cab4aea1128 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:35.566018 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221cc485-24c8-4f2e-bc95-8cab4aea1128 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:33:35.570864 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-221cc485-24c8-4f2e-bc95-8cab4aea1128 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:33:35.570864 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:33:35.570864 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:33:35.570864 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:33:35.570864 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:33:35.570864 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:33:35.570864 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:33:35.570864 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:33:35.570864 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:33:35.570864 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:33:35.570864 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:33:35.570864 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:33:35.570864 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:33:35.570864 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:33:35.570864 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:33:35.570864 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:33:35.572109 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:33:35.572109 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:33:35.572109 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:33:35.572109 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:33:35.572109 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:33:35.572109 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:33:35.572109 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:33:35.572109 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:33:35.572109 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:33:35.572109 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:33:35.572109 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:33:35.572109 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:33:35.572109 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:33:35.572109 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:33:35.572109 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:33:35.572109 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:33:35.573892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:33:35.573892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:33:35.573892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:33:35.573892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:33:35.573892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:33:35.573892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:33:35.573892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:33:35.573892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:33:35.573892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:33:35.573892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:33:35.573892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:33:35.573892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:33:35.573892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 629/1263] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 5 02:33:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:33:35.578613 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da1523-813d-4113-be9c-d0e45518802b None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:35.597166 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:35.675679 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da1523-813d-4113-be9c-d0e45518802b None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:35.708460 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7f5a3-35de-4e98-a8bc-9b0c8224fcfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:35.709080 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7f5a3-35de-4e98-a8bc-9b0c8224fcfb None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:35.709356 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7f5a3-35de-4e98-a8bc-9b0c8224fcfb None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:35.709631 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7f5a3-35de-4e98-a8bc-9b0c8224fcfb None admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:35.710349 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7f5a3-35de-4e98-a8bc-9b0c8224fcfb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:33:35.710654 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7f5a3-35de-4e98-a8bc-9b0c8224fcfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:35.712064 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7f5a3-35de-4e98-a8bc-9b0c8224fcfb None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:35.720815 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 635/1264] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:33:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:33:35.726862 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221cc485-24c8-4f2e-bc95-8cab4aea1128 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:35.792271 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:35.826267 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221cc485-24c8-4f2e-bc95-8cab4aea1128 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:35.859887 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd8414-180d-46d5-9bbc-29d41e9be82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:35.861155 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd8414-180d-46d5-9bbc-29d41e9be82f None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:35.861155 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd8414-180d-46d5-9bbc-29d41e9be82f None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:35.861155 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd8414-180d-46d5-9bbc-29d41e9be82f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:35.870750 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd8414-180d-46d5-9bbc-29d41e9be82f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:35.872215 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd8414-180d-46d5-9bbc-29d41e9be82f None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:35.886926 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-b3cd8414-180d-46d5-9bbc-29d41e9be82f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:33:35.886926 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:33:35.886926 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:33:35.886926 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:33:35.886926 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:33:35.886926 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:33:35.886926 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:33:35.886926 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:33:35.886926 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:33:35.886926 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:33:35.886926 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:33:35.886926 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:33:35.886926 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:33:35.886926 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:33:35.886926 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:33:35.890389 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:33:35.890389 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:33:35.890389 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:33:35.890389 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:33:35.890389 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:33:35.890389 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:33:35.890389 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:33:35.890389 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:33:35.890389 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:33:35.890389 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:33:35.890389 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:33:35.890389 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:33:35.890389 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:33:35.890389 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:33:35.890389 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:33:35.890389 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:33:35.890389 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:33:35.891549 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:33:35.891549 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:33:35.891549 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:33:35.891549 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:33:35.891549 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 630/1265] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:33:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:33:35.894065 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7f5a3-35de-4e98-a8bc-9b0c8224fcfb None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:35.975491 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:35.995773 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7f5a3-35de-4e98-a8bc-9b0c8224fcfb None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:36.029930 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d7594-6705-4c58-b761-9bf009672fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:36.030544 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d7594-6705-4c58-b761-9bf009672fb3 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:36.030822 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d7594-6705-4c58-b761-9bf009672fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:36.031129 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d7594-6705-4c58-b761-9bf009672fb3 None admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:36.031811 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d7594-6705-4c58-b761-9bf009672fb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:33:36.032115 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d7594-6705-4c58-b761-9bf009672fb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:36.033534 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d7594-6705-4c58-b761-9bf009672fb3 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:36.044795 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 636/1266] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:33:36.050606 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd8414-180d-46d5-9bbc-29d41e9be82f None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:36.148773 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd8414-180d-46d5-9bbc-29d41e9be82f None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:36.169310 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:36.183397 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38faeea-6cec-4be8-bc71-1feb31fe771a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:36.184036 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38faeea-6cec-4be8-bc71-1feb31fe771a None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:36.184318 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38faeea-6cec-4be8-bc71-1feb31fe771a None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:36.184592 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38faeea-6cec-4be8-bc71-1feb31fe771a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:36.191950 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38faeea-6cec-4be8-bc71-1feb31fe771a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:36.193396 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38faeea-6cec-4be8-bc71-1feb31fe771a None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:36.204861 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-e38faeea-6cec-4be8-bc71-1feb31fe771a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 05 02:33:36.204861 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:33:36.204861 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:33:36.204861 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:33:36.204861 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:33:36.204861 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:33:36.204861 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:33:36.204861 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:33:36.204861 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:33:36.204861 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:33:36.204861 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:33:36.204861 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:33:36.204861 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:33:36.204861 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:33:36.204861 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:33:36.204861 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:33:36.212182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:33:36.212182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:33:36.212182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:33:36.212182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:33:36.212182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:33:36.212182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:33:36.212182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:33:36.212182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:33:36.212182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:33:36.212182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:33:36.212182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:33:36.212182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:33:36.212182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:33:36.212182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:33:36.212182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:33:36.212182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:33:36.212182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:33:36.212182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:33:36.213367 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:33:36.213367 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:33:36.213367 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:33:36.213367 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:33:36.213367 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:33:36.213367 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:33:36.213367 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:33:36.213367 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:33:36.213367 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 05 02:33:36.213367 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:33:36.213367 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 631/1267] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:33:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:33:36.214288 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d7594-6705-4c58-b761-9bf009672fb3 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:36.313762 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d7594-6705-4c58-b761-9bf009672fb3 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:36.346763 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e018c-4c81-45a4-80bf-6f96421a813f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:36.347491 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e018c-4c81-45a4-80bf-6f96421a813f None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:36.347699 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e018c-4c81-45a4-80bf-6f96421a813f None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:36.347969 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e018c-4c81-45a4-80bf-6f96421a813f None admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:36.348751 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e018c-4c81-45a4-80bf-6f96421a813f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:33:36.349052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e018c-4c81-45a4-80bf-6f96421a813f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:36.350461 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e018c-4c81-45a4-80bf-6f96421a813f None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:36.359325 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:36.367449 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 637/1268] 10.222.0.42 () {56 vars in 1143 bytes} [Fri Aug 5 02:33:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:33:36.373953 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38faeea-6cec-4be8-bc71-1feb31fe771a None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:36.469610 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38faeea-6cec-4be8-bc71-1feb31fe771a None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:36.502596 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514bd5b-2e19-40be-9a2c-f65a390aea58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:36.503274 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514bd5b-2e19-40be-9a2c-f65a390aea58 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:36.503596 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514bd5b-2e19-40be-9a2c-f65a390aea58 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:36.503877 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514bd5b-2e19-40be-9a2c-f65a390aea58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:36.515233 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e514bd5b-2e19-40be-9a2c-f65a390aea58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:36.516702 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e514bd5b-2e19-40be-9a2c-f65a390aea58 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:36.530548 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-e514bd5b-2e19-40be-9a2c-f65a390aea58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:33:36.530548 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:33:36.530548 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:33:36.530548 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:33:36.530548 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:33:36.530548 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:33:36.530548 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:33:36.530548 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:33:36.530548 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:33:36.530548 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:33:36.530548 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:33:36.530548 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:33:36.530548 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:33:36.530548 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:33:36.530548 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:33:36.531727 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:33:36.531727 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:33:36.531727 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:33:36.531727 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:33:36.531727 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:33:36.531727 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:33:36.531727 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:33:36.531727 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:33:36.531727 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:33:36.531727 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:33:36.531727 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:33:36.531727 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:33:36.531727 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:33:36.531727 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:33:36.531727 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:33:36.531727 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:33:36.531727 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:33:36.532822 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:33:36.532822 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:33:36.532822 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:33:36.532822 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:33:36.532822 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 632/1269] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:33:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:33:36.537576 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e018c-4c81-45a4-80bf-6f96421a813f None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:36.639309 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e018c-4c81-45a4-80bf-6f96421a813f None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:36.673004 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd64a1-19d1-4233-b0c7-7320bbc96e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:36.673663 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd64a1-19d1-4233-b0c7-7320bbc96e93 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:36.673944 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd64a1-19d1-4233-b0c7-7320bbc96e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:36.674220 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd64a1-19d1-4233-b0c7-7320bbc96e93 None admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:36.674904 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd64a1-19d1-4233-b0c7-7320bbc96e93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:33:36.675252 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd64a1-19d1-4233-b0c7-7320bbc96e93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:36.676638 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd64a1-19d1-4233-b0c7-7320bbc96e93 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:36.687509 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 638/1270] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:33:36.693233 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514bd5b-2e19-40be-9a2c-f65a390aea58 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:36.725024 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:36.791841 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514bd5b-2e19-40be-9a2c-f65a390aea58 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:36.823937 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3985ea-877c-4893-a7ef-bda50931c31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:36.824564 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3985ea-877c-4893-a7ef-bda50931c31d None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:36.824843 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3985ea-877c-4893-a7ef-bda50931c31d None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:36.825112 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3985ea-877c-4893-a7ef-bda50931c31d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:36.831612 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3985ea-877c-4893-a7ef-bda50931c31d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:36.833165 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3985ea-877c-4893-a7ef-bda50931c31d None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:36.845116 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-ab3985ea-877c-4893-a7ef-bda50931c31d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:33:36.845116 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:33:36.845116 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:33:36.845116 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:33:36.845116 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:33:36.845116 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:33:36.845116 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:33:36.845116 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:33:36.845116 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:33:36.845116 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:33:36.845116 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:33:36.845116 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:33:36.845116 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:33:36.845116 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:33:36.845116 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:33:36.846255 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:33:36.846255 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:33:36.846255 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:33:36.846255 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:33:36.846255 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:33:36.846255 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:33:36.846255 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:33:36.846255 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:33:36.846255 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:33:36.846255 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:33:36.846255 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:33:36.846255 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:33:36.846255 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:33:36.846255 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:33:36.846255 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:33:36.846255 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:33:36.846255 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:33:36.847371 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:33:36.847371 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:33:36.847371 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:33:36.847371 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:33:36.847371 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:33:36.847371 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:33:36.847371 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:33:36.847371 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:33:36.847371 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 633/1271] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:33:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:33:36.852308 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd64a1-19d1-4233-b0c7-7320bbc96e93 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:36.911281 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:36.951297 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd64a1-19d1-4233-b0c7-7320bbc96e93 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:36.983920 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5cb16c-b115-4bf8-ae43-690885981607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:36.984584 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5cb16c-b115-4bf8-ae43-690885981607 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:36.984844 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5cb16c-b115-4bf8-ae43-690885981607 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:36.985115 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5cb16c-b115-4bf8-ae43-690885981607 None admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:36.985852 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5cb16c-b115-4bf8-ae43-690885981607 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:33:36.986153 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5cb16c-b115-4bf8-ae43-690885981607 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:36.987646 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5cb16c-b115-4bf8-ae43-690885981607 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:36.999164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 639/1272] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 5 02:33:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:33:37.005539 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3985ea-877c-4893-a7ef-bda50931c31d None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:37.095827 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:37.104613 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3985ea-877c-4893-a7ef-bda50931c31d None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:37.138368 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af6b65f-c449-49a8-9765-f4946d23e912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:37.139132 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6b65f-c449-49a8-9765-f4946d23e912 None admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:37.139410 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6b65f-c449-49a8-9765-f4946d23e912 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:37.139682 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6b65f-c449-49a8-9765-f4946d23e912 None admin] PATH_INFO: `/v3/projects/63b323c02a614fc28aac6e7a060064ba/users/8b647f2cb18a41d6a9e124e886faa994/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:37.141571 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af6b65f-c449-49a8-9765-f4946d23e912 None admin] RBAC: Authorizing `identity:create_grant(project_id=63b323c02a614fc28aac6e7a060064ba, user_id=8b647f2cb18a41d6a9e124e886faa994, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:37.143018 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af6b65f-c449-49a8-9765-f4946d23e912 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:37.248220 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 634/1273] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 5 02:33:37 2022] PUT /identity/v3/projects/63b323c02a614fc28aac6e7a060064ba/users/8b647f2cb18a41d6a9e124e886faa994/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:33:39.293197 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04493e49-23d5-499d-9e21-21acdf517b34 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:39.293755 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04493e49-23d5-499d-9e21-21acdf517b34 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:39.293755 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04493e49-23d5-499d-9e21-21acdf517b34 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:39.295153 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 640/1274] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:33:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:33:39.300706 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c83e10-ba13-4670-a9c5-990594e71a0f None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:39.301183 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c83e10-ba13-4670-a9c5-990594e71a0f None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:39.301277 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c83e10-ba13-4670-a9c5-990594e71a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:39.319306 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-22c83e10-ba13-4670-a9c5-990594e71a0f None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:33:39.320491 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-22c83e10-ba13-4670-a9c5-990594e71a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:33:39.392019 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 635/1275] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:33:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:33:39.417088 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04493e49-23d5-499d-9e21-21acdf517b34 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:39.533989 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04493e49-23d5-499d-9e21-21acdf517b34 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:39.552304 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:39.570006 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a2ada-bf00-422e-8918-12197295dda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:39.570645 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a2ada-bf00-422e-8918-12197295dda2 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:39.570923 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a2ada-bf00-422e-8918-12197295dda2 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:39.571227 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a2ada-bf00-422e-8918-12197295dda2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:39.581772 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a2ada-bf00-422e-8918-12197295dda2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:33:39.586614 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-1d1a2ada-bf00-422e-8918-12197295dda2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:33:39.586614 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:33:39.586614 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:33:39.586614 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:33:39.586614 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:33:39.586614 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:33:39.586614 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:33:39.586614 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:33:39.586614 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:33:39.586614 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:33:39.586614 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:33:39.586614 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:33:39.586614 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:33:39.586614 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:33:39.586614 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:33:39.586614 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:33:39.587686 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:33:39.587686 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:33:39.587686 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:33:39.587686 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:33:39.587686 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:33:39.587686 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:33:39.587686 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:33:39.587686 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:33:39.587686 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:33:39.587686 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:33:39.587686 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:33:39.587686 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:33:39.587686 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:33:39.587686 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:33:39.587686 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:33:39.587686 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:33:39.588575 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:33:39.588575 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:33:39.588575 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:33:39.588575 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:33:39.588575 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:33:39.588575 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:33:39.588575 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:33:39.588575 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:33:39.588575 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:33:39.588575 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:33:39.588575 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:33:39.588575 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:33:39.588575 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 641/1276] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 5 02:33:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:33:39.594974 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c83e10-ba13-4670-a9c5-990594e71a0f None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:39.677953 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:39.695696 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c83e10-ba13-4670-a9c5-990594e71a0f None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:39.728859 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108426b9-4278-4c61-8d03-3d228462f17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:39.729499 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108426b9-4278-4c61-8d03-3d228462f17f None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:39.729786 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108426b9-4278-4c61-8d03-3d228462f17f None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:39.730061 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108426b9-4278-4c61-8d03-3d228462f17f None admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:39.730767 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108426b9-4278-4c61-8d03-3d228462f17f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:33:39.731105 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108426b9-4278-4c61-8d03-3d228462f17f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:39.732483 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108426b9-4278-4c61-8d03-3d228462f17f None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:39.740182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 636/1277] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 5 02:33:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:33:39.746718 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a2ada-bf00-422e-8918-12197295dda2 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:39.850388 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a2ada-bf00-422e-8918-12197295dda2 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:39.882576 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a952e222-b7bc-4bf6-ad88-480855dc0738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:39.883245 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a952e222-b7bc-4bf6-ad88-480855dc0738 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:39.883531 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a952e222-b7bc-4bf6-ad88-480855dc0738 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:39.883802 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a952e222-b7bc-4bf6-ad88-480855dc0738 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:39.894157 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a952e222-b7bc-4bf6-ad88-480855dc0738 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:39.895643 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a952e222-b7bc-4bf6-ad88-480855dc0738 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:39.909725 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-a952e222-b7bc-4bf6-ad88-480855dc0738 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:33:39.909725 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:33:39.909725 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:33:39.909725 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:33:39.909725 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:33:39.909725 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:33:39.909725 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:33:39.909725 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:33:39.909725 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:33:39.909725 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:33:39.909725 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:33:39.909725 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:33:39.909725 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:33:39.909725 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:33:39.909725 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:33:39.910808 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:33:39.910808 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:33:39.910808 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:33:39.910808 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:33:39.910808 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:33:39.910808 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:33:39.910808 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:33:39.910808 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:33:39.910808 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:33:39.910808 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:33:39.910808 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:33:39.910808 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:33:39.910808 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:33:39.910808 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:33:39.910808 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:33:39.910808 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:33:39.910808 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:33:39.911983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:33:39.911983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:33:39.911983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:33:39.911983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:33:39.911983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 642/1278] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:33:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:33:39.916662 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108426b9-4278-4c61-8d03-3d228462f17f None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:40.017587 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108426b9-4278-4c61-8d03-3d228462f17f None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:40.049558 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e0880-a5b2-4c9c-a7cf-9d9c28c84902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:40.050154 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e0880-a5b2-4c9c-a7cf-9d9c28c84902 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:40.050431 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e0880-a5b2-4c9c-a7cf-9d9c28c84902 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:40.050699 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e0880-a5b2-4c9c-a7cf-9d9c28c84902 None admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:40.051399 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59e0880-a5b2-4c9c-a7cf-9d9c28c84902 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:33:40.051698 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59e0880-a5b2-4c9c-a7cf-9d9c28c84902 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:40.053065 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59e0880-a5b2-4c9c-a7cf-9d9c28c84902 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:40.064881 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 637/1279] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:33:40.070549 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a952e222-b7bc-4bf6-ad88-480855dc0738 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:40.100300 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:40.171530 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a952e222-b7bc-4bf6-ad88-480855dc0738 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:40.204117 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98372d10-4bf8-479d-91bb-e4ea6d2d6a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:40.204741 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98372d10-4bf8-479d-91bb-e4ea6d2d6a23 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:40.205024 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98372d10-4bf8-479d-91bb-e4ea6d2d6a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:40.205303 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98372d10-4bf8-479d-91bb-e4ea6d2d6a23 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:40.212541 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98372d10-4bf8-479d-91bb-e4ea6d2d6a23 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:40.214000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98372d10-4bf8-479d-91bb-e4ea6d2d6a23 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:40.226288 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-98372d10-4bf8-479d-91bb-e4ea6d2d6a23 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 05 02:33:40.226288 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:33:40.226288 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:33:40.226288 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:33:40.226288 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:33:40.226288 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:33:40.226288 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:33:40.226288 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:33:40.226288 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:33:40.226288 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:33:40.226288 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:33:40.226288 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:33:40.226288 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:33:40.226288 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:33:40.226288 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:33:40.226288 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:33:40.227490 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:33:40.227490 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:33:40.227490 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:33:40.227490 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:33:40.227490 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:33:40.227490 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:33:40.227490 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:33:40.227490 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:33:40.227490 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:33:40.227490 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:33:40.227490 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:33:40.227490 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:33:40.227490 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:33:40.227490 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:33:40.227490 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:33:40.227490 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:33:40.227490 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:33:40.227490 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:33:40.228665 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:33:40.228665 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:33:40.228665 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:33:40.228665 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:33:40.228665 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:33:40.228665 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:33:40.228665 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:33:40.228665 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:33:40.228665 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 05 02:33:40.228665 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:33:40.228665 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 643/1280] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:33:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:33:40.233876 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e0880-a5b2-4c9c-a7cf-9d9c28c84902 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:40.237930 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:40.330546 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e0880-a5b2-4c9c-a7cf-9d9c28c84902 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:40.363472 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58121f1-1c35-486f-8b15-dee0278cd420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:40.364082 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58121f1-1c35-486f-8b15-dee0278cd420 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:40.364360 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58121f1-1c35-486f-8b15-dee0278cd420 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:40.364630 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58121f1-1c35-486f-8b15-dee0278cd420 None admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:40.365403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58121f1-1c35-486f-8b15-dee0278cd420 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:33:40.365704 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58121f1-1c35-486f-8b15-dee0278cd420 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:40.367165 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58121f1-1c35-486f-8b15-dee0278cd420 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:40.383833 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 638/1281] 10.222.0.42 () {56 vars in 1143 bytes} [Fri Aug 5 02:33:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:33:40.389658 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98372d10-4bf8-479d-91bb-e4ea6d2d6a23 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:40.480663 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:40.490103 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98372d10-4bf8-479d-91bb-e4ea6d2d6a23 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:40.522183 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919add9-a5a8-4dc5-bcb6-f74658f9c1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:40.522818 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919add9-a5a8-4dc5-bcb6-f74658f9c1c0 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:40.523145 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919add9-a5a8-4dc5-bcb6-f74658f9c1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:40.523470 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919add9-a5a8-4dc5-bcb6-f74658f9c1c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:40.592904 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2919add9-a5a8-4dc5-bcb6-f74658f9c1c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:40.594378 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2919add9-a5a8-4dc5-bcb6-f74658f9c1c0 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:40.681644 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:40.691425 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 644/1282] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 5 02:33:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 02:33:40.697739 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58121f1-1c35-486f-8b15-dee0278cd420 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:40.763244 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:40.796373 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58121f1-1c35-486f-8b15-dee0278cd420 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:40.830247 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def0090-2285-42db-84f6-105f39cf969e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:40.831043 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def0090-2285-42db-84f6-105f39cf969e None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:40.831329 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def0090-2285-42db-84f6-105f39cf969e None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:40.831602 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def0090-2285-42db-84f6-105f39cf969e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:40.842735 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def0090-2285-42db-84f6-105f39cf969e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:40.844228 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def0090-2285-42db-84f6-105f39cf969e None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:40.858462 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-8def0090-2285-42db-84f6-105f39cf969e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:33:40.858462 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:33:40.858462 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:33:40.858462 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:33:40.858462 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:33:40.858462 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:33:40.858462 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:33:40.858462 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:33:40.858462 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:33:40.858462 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:33:40.858462 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:33:40.858462 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:33:40.858462 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:33:40.858462 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:33:40.858462 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:33:40.859557 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:33:40.859557 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:33:40.859557 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:33:40.859557 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:33:40.859557 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:33:40.859557 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:33:40.859557 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:33:40.859557 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:33:40.859557 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:33:40.859557 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:33:40.859557 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:33:40.859557 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:33:40.859557 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:33:40.859557 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:33:40.859557 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:33:40.859557 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:33:40.859557 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:33:40.860515 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:33:40.860515 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:33:40.860515 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:33:40.860515 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:33:40.860515 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 639/1283] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:33:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:33:40.865479 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919add9-a5a8-4dc5-bcb6-f74658f9c1c0 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:40.960604 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919add9-a5a8-4dc5-bcb6-f74658f9c1c0 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:40.993346 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6393c7e-4831-4a50-9075-20c1a746946b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:40.993954 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6393c7e-4831-4a50-9075-20c1a746946b None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:40.994233 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6393c7e-4831-4a50-9075-20c1a746946b None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:40.994504 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6393c7e-4831-4a50-9075-20c1a746946b None admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:40.995238 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6393c7e-4831-4a50-9075-20c1a746946b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:33:40.995538 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6393c7e-4831-4a50-9075-20c1a746946b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:40.996889 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6393c7e-4831-4a50-9075-20c1a746946b None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:41.007828 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 645/1284] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 5 02:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:33:41.014216 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def0090-2285-42db-84f6-105f39cf969e None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:41.111015 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def0090-2285-42db-84f6-105f39cf969e None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:41.124084 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:41.144053 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e622b-209d-4f1d-87ab-cde927d0d94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:41.144678 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e622b-209d-4f1d-87ab-cde927d0d94c None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:41.144954 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e622b-209d-4f1d-87ab-cde927d0d94c None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:41.145221 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e622b-209d-4f1d-87ab-cde927d0d94c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:41.152178 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e622b-209d-4f1d-87ab-cde927d0d94c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:41.153641 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e622b-209d-4f1d-87ab-cde927d0d94c None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:41.164613 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application [None req-a97e622b-209d-4f1d-87ab-cde927d0d94c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:33:41.164613 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:33:41.164613 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:33:41.164613 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:33:41.164613 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:33:41.164613 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:33:41.164613 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:33:41.164613 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:33:41.164613 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:33:41.164613 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:33:41.164613 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:33:41.164613 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:33:41.164613 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:33:41.164613 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:33:41.164613 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:33:41.167062 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:33:41.167062 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:33:41.167062 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:33:41.167062 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:33:41.167062 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:33:41.167062 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:33:41.167062 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:33:41.167062 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:33:41.167062 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application with Lock( Aug 05 02:33:41.167062 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:33:41.167062 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:33:41.167062 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:33:41.167062 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:33:41.167062 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:33:41.167062 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:33:41.167062 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:33:41.167062 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:33:41.168012 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:33:41.168012 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:33:41.168012 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:33:41.168012 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:33:41.168012 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:33:41.168012 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:33:41.168012 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:33:41.168012 dv-cinder-815582-13-smb devstack@keystone.service[80823]: ERROR keystone.server.flask.application Aug 05 02:33:41.168012 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 640/1285] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 5 02:33:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:33:41.172010 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6393c7e-4831-4a50-9075-20c1a746946b None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:41.222500 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:41.270897 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6393c7e-4831-4a50-9075-20c1a746946b None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:41.303273 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56ee78-7a85-4e61-9aba-66af76604777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:41.303889 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56ee78-7a85-4e61-9aba-66af76604777 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:41.304172 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56ee78-7a85-4e61-9aba-66af76604777 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:41.304450 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56ee78-7a85-4e61-9aba-66af76604777 None admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:41.305190 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d56ee78-7a85-4e61-9aba-66af76604777 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:33:41.305496 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d56ee78-7a85-4e61-9aba-66af76604777 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:41.307902 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d56ee78-7a85-4e61-9aba-66af76604777 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:41.318974 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 646/1286] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 5 02:33:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:33:41.325559 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e622b-209d-4f1d-87ab-cde927d0d94c None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:41.422698 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e622b-209d-4f1d-87ab-cde927d0d94c None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:41.456433 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cecc7e-b21d-4b86-8634-65ea40098b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:41.457082 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cecc7e-b21d-4b86-8634-65ea40098b99 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:41.457357 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cecc7e-b21d-4b86-8634-65ea40098b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:41.457628 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cecc7e-b21d-4b86-8634-65ea40098b99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:41.458402 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cecc7e-b21d-4b86-8634-65ea40098b99 None admin] RBAC: Adding query filter params (role.id=83afe883a303495b966480fb9b5bb7dd, scope.project.id=63b323c02a614fc28aac6e7a060064ba, user.id=8b647f2cb18a41d6a9e124e886faa994) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:33:41.458710 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cecc7e-b21d-4b86-8634-65ea40098b99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:41.460172 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cecc7e-b21d-4b86-8634-65ea40098b99 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:41.465843 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 641/1287] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 5 02:33:41 2022] GET /identity/v3/role_assignments?user.id=8b647f2cb18a41d6a9e124e886faa994&scope.project.id=63b323c02a614fc28aac6e7a060064ba&role.id=83afe883a303495b966480fb9b5bb7dd => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:33:43.491645 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1eab0-43e5-44f7-b318-76e008c44671 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:43.492199 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1eab0-43e5-44f7-b318-76e008c44671 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:43.492199 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1eab0-43e5-44f7-b318-76e008c44671 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:43.493575 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 647/1288] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:33:43.499241 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b711555-e376-4d3a-9086-bb8505e86318 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:43.499657 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b711555-e376-4d3a-9086-bb8505e86318 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:43.499794 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b711555-e376-4d3a-9086-bb8505e86318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:43.518237 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-4b711555-e376-4d3a-9086-bb8505e86318 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:33:43.519504 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-4b711555-e376-4d3a-9086-bb8505e86318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:33:43.548704 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:43.585127 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 642/1289] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:33:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:33:43.607488 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1eab0-43e5-44f7-b318-76e008c44671 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:43.707673 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1eab0-43e5-44f7-b318-76e008c44671 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:43.718223 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:43.739896 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285841d8-6773-47c6-9de9-3b8569904ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:43.740723 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285841d8-6773-47c6-9de9-3b8569904ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:43.740848 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285841d8-6773-47c6-9de9-3b8569904ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:43.741100 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285841d8-6773-47c6-9de9-3b8569904ac1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:43.741721 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285841d8-6773-47c6-9de9-3b8569904ac1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:43.743126 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285841d8-6773-47c6-9de9-3b8569904ac1 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:43.752210 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-285841d8-6773-47c6-9de9-3b8569904ac1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 02:33:43.752210 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:33:43.752210 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:33:43.752210 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:33:43.752210 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:33:43.752210 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:33:43.752210 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:33:43.752210 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:33:43.752210 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 02:33:43.752210 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:33:43.752210 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:33:43.752210 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:33:43.752210 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:33:43.752210 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:33:43.752210 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:33:43.752210 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:33:43.752210 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:33:43.753428 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:33:43.753428 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:33:43.753428 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:33:43.753428 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:33:43.753428 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:33:43.753428 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:33:43.753428 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:33:43.753428 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:33:43.753428 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:33:43.753428 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:33:43.753428 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:33:43.753428 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:33:43.753428 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:33:43.753428 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:33:43.753428 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:33:43.753428 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:33:43.754319 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:33:43.754319 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:33:43.754319 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:33:43.754319 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:33:43.754319 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:33:43.754319 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:33:43.754319 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:33:43.754319 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:33:43.754319 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:33:43.754319 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:33:43.754319 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:33:43.754319 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:33:43.754319 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 02:33:43.754319 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:33:43.754319 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 648/1290] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Aug 5 02:33:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:33:43.759370 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b711555-e376-4d3a-9086-bb8505e86318 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:43.855700 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b711555-e376-4d3a-9086-bb8505e86318 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:43.888575 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d7ec1-91af-48bb-a76e-1a03950588e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:43.889186 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d7ec1-91af-48bb-a76e-1a03950588e3 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:43.889471 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d7ec1-91af-48bb-a76e-1a03950588e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:43.889744 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d7ec1-91af-48bb-a76e-1a03950588e3 None admin] PATH_INFO: `/v3/services` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:43.890409 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d7ec1-91af-48bb-a76e-1a03950588e3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:33:43.890713 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d7ec1-91af-48bb-a76e-1a03950588e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:43.892122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d7ec1-91af-48bb-a76e-1a03950588e3 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:43.896837 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 643/1291] 10.222.0.42 () {56 vars in 1116 bytes} [Fri Aug 5 02:33:43 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:33:43.902606 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285841d8-6773-47c6-9de9-3b8569904ac1 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:44.009022 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285841d8-6773-47c6-9de9-3b8569904ac1 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:44.045650 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f7e477-59f1-405e-8013-e1675e624140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:44.046267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7e477-59f1-405e-8013-e1675e624140 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:44.046551 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7e477-59f1-405e-8013-e1675e624140 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:44.046828 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7e477-59f1-405e-8013-e1675e624140 None admin] PATH_INFO: `/v3/services` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:44.047541 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f7e477-59f1-405e-8013-e1675e624140 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:33:44.047849 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f7e477-59f1-405e-8013-e1675e624140 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:44.049223 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f7e477-59f1-405e-8013-e1675e624140 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:44.053675 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 649/1292] 10.222.0.42 () {56 vars in 1116 bytes} [Fri Aug 5 02:33:43 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:33:46.048793 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae58b5c-8cff-4591-b7c5-e757dcf78b4d None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:46.049366 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae58b5c-8cff-4591-b7c5-e757dcf78b4d None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:46.049366 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae58b5c-8cff-4591-b7c5-e757dcf78b4d None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:46.050730 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 644/1293] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:33:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:33:46.055820 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4236d-53a6-482a-8449-400208b6c67e None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:46.056257 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4236d-53a6-482a-8449-400208b6c67e None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:46.056406 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4236d-53a6-482a-8449-400208b6c67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:46.074626 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-8cb4236d-53a6-482a-8449-400208b6c67e None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:33:46.075854 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-8cb4236d-53a6-482a-8449-400208b6c67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:33:46.104459 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:46.139286 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 650/1294] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:33:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:33:46.169952 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae58b5c-8cff-4591-b7c5-e757dcf78b4d None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:46.201180 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:46.269540 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae58b5c-8cff-4591-b7c5-e757dcf78b4d None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:46.307907 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163fe189-26f4-4bec-9f1e-6f2cd7203cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:46.307907 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163fe189-26f4-4bec-9f1e-6f2cd7203cfe None admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:46.307907 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163fe189-26f4-4bec-9f1e-6f2cd7203cfe None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:46.307907 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163fe189-26f4-4bec-9f1e-6f2cd7203cfe None admin] PATH_INFO: `/v3/services` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:46.308305 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163fe189-26f4-4bec-9f1e-6f2cd7203cfe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:46.308305 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163fe189-26f4-4bec-9f1e-6f2cd7203cfe None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:46.393693 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 645/1295] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Aug 5 02:33:46 2022] POST /identity/v3/services => generated 246 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:33:48.414695 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21036b59-84a9-4027-a3da-06cedb2f64f8 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:48.415284 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21036b59-84a9-4027-a3da-06cedb2f64f8 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:48.415284 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21036b59-84a9-4027-a3da-06cedb2f64f8 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:48.416649 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 651/1296] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:33:48.422573 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f3859-363a-43de-bcf0-c7e19a2ab8d0 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:48.423006 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f3859-363a-43de-bcf0-c7e19a2ab8d0 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:48.423164 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f3859-363a-43de-bcf0-c7e19a2ab8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:48.441453 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-cf0f3859-363a-43de-bcf0-c7e19a2ab8d0 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:33:48.442633 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-cf0f3859-363a-43de-bcf0-c7e19a2ab8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:33:48.513335 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 646/1297] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:33:48 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:33:48.535822 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21036b59-84a9-4027-a3da-06cedb2f64f8 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:48.635010 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21036b59-84a9-4027-a3da-06cedb2f64f8 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:48.669200 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6de4e6-27c6-4ce5-b57b-b17d89404d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:48.669836 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6de4e6-27c6-4ce5-b57b-b17d89404d80 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:48.670115 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6de4e6-27c6-4ce5-b57b-b17d89404d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:48.670389 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6de4e6-27c6-4ce5-b57b-b17d89404d80 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:48.671043 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6de4e6-27c6-4ce5-b57b-b17d89404d80 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:48.672409 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6de4e6-27c6-4ce5-b57b-b17d89404d80 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:48.681239 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-dc6de4e6-27c6-4ce5-b57b-b17d89404d80 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 02:33:48.681239 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:33:48.681239 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:33:48.681239 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:33:48.681239 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:33:48.681239 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:33:48.681239 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:33:48.681239 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:33:48.681239 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 02:33:48.681239 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:33:48.681239 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:33:48.681239 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:33:48.681239 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:33:48.681239 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:33:48.681239 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:33:48.681239 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:33:48.681239 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:33:48.682356 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:33:48.682356 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:33:48.682356 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:33:48.682356 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:33:48.682356 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:33:48.682356 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:33:48.682356 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:33:48.682356 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:33:48.682356 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:33:48.682356 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:33:48.682356 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:33:48.682356 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:33:48.682356 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:33:48.682356 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:33:48.682356 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:33:48.682356 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:33:48.683661 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:33:48.683661 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:33:48.683661 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:33:48.683661 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:33:48.683661 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:33:48.683661 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:33:48.683661 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:33:48.683661 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:33:48.683661 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:33:48.683661 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:33:48.683661 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:33:48.683661 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:33:48.683661 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 02:33:48.683661 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:33:48.683661 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 652/1298] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Aug 5 02:33:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:33:48.688469 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f3859-363a-43de-bcf0-c7e19a2ab8d0 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:48.706482 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:48.784408 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f3859-363a-43de-bcf0-c7e19a2ab8d0 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:48.817764 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0369749-1533-49dd-a42c-e9c5e7633ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:48.818311 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0369749-1533-49dd-a42c-e9c5e7633ed5 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:48.818589 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0369749-1533-49dd-a42c-e9c5e7633ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:48.818860 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0369749-1533-49dd-a42c-e9c5e7633ed5 None admin] PATH_INFO: `/v3/services` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:48.819556 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0369749-1533-49dd-a42c-e9c5e7633ed5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:33:48.819856 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0369749-1533-49dd-a42c-e9c5e7633ed5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:48.830877 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0369749-1533-49dd-a42c-e9c5e7633ed5 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:48.830877 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 647/1299] 10.222.0.42 () {56 vars in 1116 bytes} [Fri Aug 5 02:33:48 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:33:48.832064 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6de4e6-27c6-4ce5-b57b-b17d89404d80 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:48.863990 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:48.927943 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6de4e6-27c6-4ce5-b57b-b17d89404d80 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:48.961124 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a2d07-0ca0-48e9-ae78-151abcb6b6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:48.961728 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a2d07-0ca0-48e9-ae78-151abcb6b6ff None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:48.962007 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a2d07-0ca0-48e9-ae78-151abcb6b6ff None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:48.962276 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a2d07-0ca0-48e9-ae78-151abcb6b6ff None admin] PATH_INFO: `/v3/endpoints` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:48.963045 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a2d07-0ca0-48e9-ae78-151abcb6b6ff None admin] RBAC: Adding query filter params (interface=public, service_id=fea524237ce24a70b4f994546b4af998, region_id=RegionOne) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:33:48.963351 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a2d07-0ca0-48e9-ae78-151abcb6b6ff None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:48.965462 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a2d07-0ca0-48e9-ae78-151abcb6b6ff None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:48.975146 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 653/1300] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Aug 5 02:33:48 2022] GET /identity/v3/endpoints?service_id=fea524237ce24a70b4f994546b4af998&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:33:48.976535 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0369749-1533-49dd-a42c-e9c5e7633ed5 None admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:49.055286 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:49.074038 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0369749-1533-49dd-a42c-e9c5e7633ed5 None admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:49.109350 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61444d-0a08-41b2-bc10-fda8827e49c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:49.110279 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61444d-0a08-41b2-bc10-fda8827e49c4 None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:49.110815 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61444d-0a08-41b2-bc10-fda8827e49c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:49.111322 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61444d-0a08-41b2-bc10-fda8827e49c4 None admin] PATH_INFO: `/v3/services` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:49.112459 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb61444d-0a08-41b2-bc10-fda8827e49c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:49.113963 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb61444d-0a08-41b2-bc10-fda8827e49c4 None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:49.120868 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 648/1301] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Aug 5 02:33:48 2022] GET /identity/v3/services => generated 2191 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:33:51.106972 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f2180-1f4d-4230-afc5-a1828280c432 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:51.107528 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f2180-1f4d-4230-afc5-a1828280c432 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:51.107633 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f2180-1f4d-4230-afc5-a1828280c432 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:51.108901 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 654/1302] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:33:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:33:51.114179 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141ad29-858f-49b6-b2c1-7d76f828a3f1 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:51.118509 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141ad29-858f-49b6-b2c1-7d76f828a3f1 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:51.118509 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141ad29-858f-49b6-b2c1-7d76f828a3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:51.132240 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-b141ad29-858f-49b6-b2c1-7d76f828a3f1 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:33:51.133402 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-b141ad29-858f-49b6-b2c1-7d76f828a3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:33:51.198529 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 649/1303] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:33:51 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 02:33:51.221395 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f2180-1f4d-4230-afc5-a1828280c432 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:51.315959 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:51.322718 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f2180-1f4d-4230-afc5-a1828280c432 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:51.355840 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05cab6-8151-4b5b-a241-bbdf21588647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:51.356474 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05cab6-8151-4b5b-a241-bbdf21588647 None admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:51.356755 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05cab6-8151-4b5b-a241-bbdf21588647 None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:51.357077 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05cab6-8151-4b5b-a241-bbdf21588647 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:51.357650 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e05cab6-8151-4b5b-a241-bbdf21588647 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:51.359036 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e05cab6-8151-4b5b-a241-bbdf21588647 None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:51.367548 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application [None req-8e05cab6-8151-4b5b-a241-bbdf21588647 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 02:33:51.367548 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:33:51.367548 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:33:51.367548 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:33:51.367548 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:33:51.367548 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:33:51.367548 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:33:51.367548 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:33:51.367548 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 02:33:51.367548 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:33:51.367548 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:33:51.367548 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:33:51.367548 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:33:51.367548 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:33:51.367548 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:33:51.367548 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:33:51.367548 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:33:51.368792 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:33:51.368792 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:33:51.368792 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:33:51.368792 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:33:51.368792 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:33:51.368792 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:33:51.368792 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:33:51.368792 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:33:51.368792 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:33:51.368792 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:33:51.368792 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:33:51.368792 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:33:51.368792 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:33:51.368792 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:33:51.368792 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:33:51.368792 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:33:51.369986 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:33:51.369986 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application with Lock( Aug 05 02:33:51.369986 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:33:51.369986 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:33:51.369986 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:33:51.369986 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:33:51.369986 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:33:51.369986 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:33:51.369986 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:33:51.369986 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:33:51.369986 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:33:51.369986 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:33:51.369986 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 02:33:51.369986 dv-cinder-815582-13-smb devstack@keystone.service[80822]: ERROR keystone.server.flask.application Aug 05 02:33:51.369986 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 655/1304] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Aug 5 02:33:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:33:51.374835 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141ad29-858f-49b6-b2c1-7d76f828a3f1 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:51.449763 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:51.472428 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141ad29-858f-49b6-b2c1-7d76f828a3f1 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:51.504829 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb946b1b-2fcd-4988-a89d-49469d476b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:51.505471 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb946b1b-2fcd-4988-a89d-49469d476b5c None admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:51.505749 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb946b1b-2fcd-4988-a89d-49469d476b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:51.506018 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb946b1b-2fcd-4988-a89d-49469d476b5c None admin] PATH_INFO: `/v3/services` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:51.506680 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb946b1b-2fcd-4988-a89d-49469d476b5c None admin] RBAC: Adding query filter params (name=placement) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:33:51.506999 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb946b1b-2fcd-4988-a89d-49469d476b5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:51.508462 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb946b1b-2fcd-4988-a89d-49469d476b5c None admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:51.514626 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 650/1305] 10.222.0.42 () {56 vars in 1116 bytes} [Fri Aug 5 02:33:51 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:33:51.520479 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05cab6-8151-4b5b-a241-bbdf21588647 None admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:51.618139 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05cab6-8151-4b5b-a241-bbdf21588647 None admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:51.650680 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557da036-4da9-4938-8aa4-de95e73ab43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:51.651312 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557da036-4da9-4938-8aa4-de95e73ab43d None admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:51.651596 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557da036-4da9-4938-8aa4-de95e73ab43d None admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:51.651867 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557da036-4da9-4938-8aa4-de95e73ab43d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:51.652570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557da036-4da9-4938-8aa4-de95e73ab43d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:51.653924 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557da036-4da9-4938-8aa4-de95e73ab43d None admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:51.720163 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 656/1306] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:33:51 2022] POST /identity/v3/endpoints => generated 331 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:34:01.511090 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=30 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:34:01.715597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:39:51.746592 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743fd77-40ce-45f5-b6b6-9d039bf57747 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:39:51.747198 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743fd77-40ce-45f5-b6b6-9d039bf57747 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:39:51.747198 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743fd77-40ce-45f5-b6b6-9d039bf57747 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:39:51.754101 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc7dd1-b3c6-4fd2-9e0b-2e3974da0d38 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:39:51.754669 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc7dd1-b3c6-4fd2-9e0b-2e3974da0d38 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:39:51.754669 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc7dd1-b3c6-4fd2-9e0b-2e3974da0d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:39:51.759553 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 651/1307] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:39:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:39:51.845705 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-18dc7dd1-b3c6-4fd2-9e0b-2e3974da0d38 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:39:51.847208 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-18dc7dd1-b3c6-4fd2-9e0b-2e3974da0d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:39:51.969051 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 657/1308] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:39:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:39:52.028111 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a5033-4e45-4b36-af96-dd58f890f566 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:39:52.028404 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a5033-4e45-4b36-af96-dd58f890f566 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:39:52.028811 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a5033-4e45-4b36-af96-dd58f890f566 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:39:52.030043 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 652/1309] 10.222.0.42 () {54 vars in 965 bytes} [Fri Aug 5 02:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:39:52.037105 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc7c6d-c302-4822-85ea-7a11b582827f None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:39:52.037607 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc7c6d-c302-4822-85ea-7a11b582827f None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:39:52.038115 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc7c6d-c302-4822-85ea-7a11b582827f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:39:52.163079 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-03cc7c6d-c302-4822-85ea-7a11b582827f None None] MFA Rules not processed for user `a0035fcd8b06400bb7946f7ac37393a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:39:52.164480 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-03cc7c6d-c302-4822-85ea-7a11b582827f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:39:52.190359 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:39:52.257069 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 658/1310] 10.222.0.42 () {58 vars in 1062 bytes} [Fri Aug 5 02:39:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:39:52.266722 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a5033-4e45-4b36-af96-dd58f890f566 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:39:52.268554 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-184a5033-4e45-4b36-af96-dd58f890f566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:39:52.399639 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a5033-4e45-4b36-af96-dd58f890f566 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:39:52.476433 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ec050-7af7-4cad-9ae6-47a646d63648 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:39:52.477225 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ec050-7af7-4cad-9ae6-47a646d63648 service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:39:52.478050 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ec050-7af7-4cad-9ae6-47a646d63648 service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:39:52.478306 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ec050-7af7-4cad-9ae6-47a646d63648 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:39:52.479951 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-f42ec050-7af7-4cad-9ae6-47a646d63648 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:39:52.537121 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:39:52.594111 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42ec050-7af7-4cad-9ae6-47a646d63648 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:39:52.595628 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42ec050-7af7-4cad-9ae6-47a646d63648 service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:39:52.616125 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 653/1311] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:39:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:39:54.907777 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdade57-5f41-4584-84f1-a5a2cbee830c None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:39:54.908315 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdade57-5f41-4584-84f1-a5a2cbee830c None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:39:54.908315 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdade57-5f41-4584-84f1-a5a2cbee830c None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:39:54.909697 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 659/1312] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:39:54.914823 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952e58e-4f45-4b32-8484-1295fa587694 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:39:54.915789 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952e58e-4f45-4b32-8484-1295fa587694 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:39:54.915962 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952e58e-4f45-4b32-8484-1295fa587694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:39:54.990282 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-6952e58e-4f45-4b32-8484-1295fa587694 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:39:54.991565 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-6952e58e-4f45-4b32-8484-1295fa587694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:39:55.101078 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 654/1313] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:39:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:39:55.141049 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdade57-5f41-4584-84f1-a5a2cbee830c None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:39:55.142782 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-2fdade57-5f41-4584-84f1-a5a2cbee830c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:39:55.252057 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdade57-5f41-4584-84f1-a5a2cbee830c None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:39:55.339573 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:39:55.342479 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52394e0e-b3a3-43dd-b270-302b697f888f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:39:55.343455 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52394e0e-b3a3-43dd-b270-302b697f888f service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:39:55.343838 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52394e0e-b3a3-43dd-b270-302b697f888f service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:39:55.344212 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52394e0e-b3a3-43dd-b270-302b697f888f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:39:55.345946 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-52394e0e-b3a3-43dd-b270-302b697f888f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:39:55.471092 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52394e0e-b3a3-43dd-b270-302b697f888f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:39:55.472547 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52394e0e-b3a3-43dd-b270-302b697f888f service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:39:55.492357 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 660/1314] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:39:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:39:58.012429 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20526184-2a8b-44f9-8afb-aeea9791e1e5 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:39:58.012976 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20526184-2a8b-44f9-8afb-aeea9791e1e5 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:39:58.012976 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20526184-2a8b-44f9-8afb-aeea9791e1e5 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:39:58.014327 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 655/1315] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:39:58.019471 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7620a5-61e9-486d-b93b-380d931ed94b None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:39:58.019872 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7620a5-61e9-486d-b93b-380d931ed94b None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:39:58.020116 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7620a5-61e9-486d-b93b-380d931ed94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:39:58.084008 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-fe7620a5-61e9-486d-b93b-380d931ed94b None None] MFA Rules not processed for user `ff4872f4d7ca4f069406cc8c9ff750f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:39:58.085225 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-fe7620a5-61e9-486d-b93b-380d931ed94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:39:58.136697 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:39:58.179056 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 661/1316] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:39:58 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:39:58.219235 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20526184-2a8b-44f9-8afb-aeea9791e1e5 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:39:58.220766 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-20526184-2a8b-44f9-8afb-aeea9791e1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:39:58.230589 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:39:58.322334 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20526184-2a8b-44f9-8afb-aeea9791e1e5 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:39:58.392336 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e10c83-b4e9-4500-a45b-0f4d1545e2f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:39:58.392945 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e10c83-b4e9-4500-a45b-0f4d1545e2f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:39:58.393224 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e10c83-b4e9-4500-a45b-0f4d1545e2f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:39:58.393497 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e10c83-b4e9-4500-a45b-0f4d1545e2f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:39:58.395125 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-21e10c83-b4e9-4500-a45b-0f4d1545e2f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:39:58.455360 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:39:58.504962 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e10c83-b4e9-4500-a45b-0f4d1545e2f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:39:58.506417 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e10c83-b4e9-4500-a45b-0f4d1545e2f6 service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:39:58.525534 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 656/1317] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:39:58 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:40:01.239995 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f09ce2-7a88-4009-8662-b3efaf448b4c None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:01.240534 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f09ce2-7a88-4009-8662-b3efaf448b4c None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:01.240534 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f09ce2-7a88-4009-8662-b3efaf448b4c None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:01.241952 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 662/1318] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:40:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:40:01.247579 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192badb-3fec-4970-a7eb-7e345792d04d None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:01.248001 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192badb-3fec-4970-a7eb-7e345792d04d None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:01.248145 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192badb-3fec-4970-a7eb-7e345792d04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:01.314534 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-2192badb-3fec-4970-a7eb-7e345792d04d None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:40:01.315843 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-2192badb-3fec-4970-a7eb-7e345792d04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:01.409798 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 657/1319] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:40:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:40:01.449130 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f09ce2-7a88-4009-8662-b3efaf448b4c None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:40:01.450666 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-02f09ce2-7a88-4009-8662-b3efaf448b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:01.551379 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f09ce2-7a88-4009-8662-b3efaf448b4c None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:40:01.622941 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f5e6b5-5d43-4177-a002-5b845b403000 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:40:01.623580 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5e6b5-5d43-4177-a002-5b845b403000 service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:01.623863 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5e6b5-5d43-4177-a002-5b845b403000 service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:01.624140 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5e6b5-5d43-4177-a002-5b845b403000 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:01.625762 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-e9f5e6b5-5d43-4177-a002-5b845b403000 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:01.632467 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:40:01.732428 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f5e6b5-5d43-4177-a002-5b845b403000 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:40:01.733863 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f5e6b5-5d43-4177-a002-5b845b403000 service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:40:01.751135 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 663/1320] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:40:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:40:04.703269 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23839d37-1829-435e-91d4-347d29b60754 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:04.703817 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23839d37-1829-435e-91d4-347d29b60754 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:04.703817 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23839d37-1829-435e-91d4-347d29b60754 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:04.705501 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 658/1321] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:40:04.710843 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85088999-24f6-41fd-8927-4a9f434f861a None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:04.711300 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85088999-24f6-41fd-8927-4a9f434f861a None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:04.712184 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85088999-24f6-41fd-8927-4a9f434f861a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:04.786237 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-85088999-24f6-41fd-8927-4a9f434f861a None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:40:04.787500 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-85088999-24f6-41fd-8927-4a9f434f861a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:04.844726 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:40:04.882995 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 664/1322] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:40:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:40:04.918771 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23839d37-1829-435e-91d4-347d29b60754 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:40:04.920411 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-23839d37-1829-435e-91d4-347d29b60754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:04.940330 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:40:05.033474 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23839d37-1829-435e-91d4-347d29b60754 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:40:05.125611 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6761be4a-d78c-43bb-a891-a6391a20eb7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:40:05.126258 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761be4a-d78c-43bb-a891-a6391a20eb7c service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:05.126541 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761be4a-d78c-43bb-a891-a6391a20eb7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:05.126818 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761be4a-d78c-43bb-a891-a6391a20eb7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:05.128652 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-6761be4a-d78c-43bb-a891-a6391a20eb7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:05.212949 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:40:05.252409 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6761be4a-d78c-43bb-a891-a6391a20eb7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:40:05.253913 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6761be4a-d78c-43bb-a891-a6391a20eb7c service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:40:05.272194 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 659/1323] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:40:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:40:07.336027 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1142e8-342e-4628-bab9-1222bea43365 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:07.336552 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1142e8-342e-4628-bab9-1222bea43365 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:07.336648 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1142e8-342e-4628-bab9-1222bea43365 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:07.337979 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 665/1324] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:40:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:40:07.343061 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195939c7-3ae0-409e-9e13-f0568696dc50 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:07.343567 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195939c7-3ae0-409e-9e13-f0568696dc50 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:07.343664 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195939c7-3ae0-409e-9e13-f0568696dc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:07.408108 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-195939c7-3ae0-409e-9e13-f0568696dc50 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:40:07.409255 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-195939c7-3ae0-409e-9e13-f0568696dc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:07.514975 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 660/1325] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:40:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:40:07.551099 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1142e8-342e-4628-bab9-1222bea43365 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:40:07.552850 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-4b1142e8-342e-4628-bab9-1222bea43365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:07.655010 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1142e8-342e-4628-bab9-1222bea43365 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:40:07.726459 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a788e0-3169-4cc6-aca0-82918a941209 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:40:07.727064 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a788e0-3169-4cc6-aca0-82918a941209 service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:07.727606 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a788e0-3169-4cc6-aca0-82918a941209 service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:07.727883 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a788e0-3169-4cc6-aca0-82918a941209 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:07.732862 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-33a788e0-3169-4cc6-aca0-82918a941209 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:07.748914 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:40:07.845195 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a788e0-3169-4cc6-aca0-82918a941209 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:40:07.846665 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a788e0-3169-4cc6-aca0-82918a941209 service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:40:07.866019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 666/1326] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:40:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:40:09.908660 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe592a-8906-4120-bdd3-01322bee990f None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:09.909172 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe592a-8906-4120-bdd3-01322bee990f None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:09.909267 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe592a-8906-4120-bdd3-01322bee990f None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:09.910543 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 661/1327] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:40:09.916145 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd291302-27a4-42fd-a618-38d229ca39c7 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:09.916541 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd291302-27a4-42fd-a618-38d229ca39c7 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:09.916695 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd291302-27a4-42fd-a618-38d229ca39c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:09.988030 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-bd291302-27a4-42fd-a618-38d229ca39c7 None None] MFA Rules not processed for user `ff4872f4d7ca4f069406cc8c9ff750f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:40:09.989251 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-bd291302-27a4-42fd-a618-38d229ca39c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:10.053997 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:40:10.085872 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 667/1328] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:40:09 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:40:10.123580 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe592a-8906-4120-bdd3-01322bee990f None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:40:10.125114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-0cbe592a-8906-4120-bdd3-01322bee990f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:10.157087 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:40:10.231001 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe592a-8906-4120-bdd3-01322bee990f None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:40:10.307074 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c64b92-815c-444a-9367-3dd36e0a0fcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:40:10.307695 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c64b92-815c-444a-9367-3dd36e0a0fcd service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:10.307972 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c64b92-815c-444a-9367-3dd36e0a0fcd service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:10.308245 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c64b92-815c-444a-9367-3dd36e0a0fcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:10.309855 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-58c64b92-815c-444a-9367-3dd36e0a0fcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:10.384927 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:40:10.417725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c64b92-815c-444a-9367-3dd36e0a0fcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:40:10.419137 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c64b92-815c-444a-9367-3dd36e0a0fcd service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:40:10.436845 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 662/1329] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:40:10 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:40:12.837369 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bdc2ad-d598-4683-b0e8-7314691b35e7 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:12.837962 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bdc2ad-d598-4683-b0e8-7314691b35e7 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:12.837962 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bdc2ad-d598-4683-b0e8-7314691b35e7 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:12.839327 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 668/1330] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:40:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:40:12.844317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd277cf4-dc4d-484a-a07c-a90fd5a3ae32 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:12.844717 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd277cf4-dc4d-484a-a07c-a90fd5a3ae32 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:12.844877 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd277cf4-dc4d-484a-a07c-a90fd5a3ae32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:12.909475 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-dd277cf4-dc4d-484a-a07c-a90fd5a3ae32 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:40:12.910690 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-dd277cf4-dc4d-484a-a07c-a90fd5a3ae32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:13.004566 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 663/1331] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:40:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:40:13.040903 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bdc2ad-d598-4683-b0e8-7314691b35e7 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:40:13.042431 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-08bdc2ad-d598-4683-b0e8-7314691b35e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:13.145293 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bdc2ad-d598-4683-b0e8-7314691b35e7 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:40:13.216229 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75730d16-3989-4abe-bce3-a757c2ce4552 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:40:13.216846 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75730d16-3989-4abe-bce3-a757c2ce4552 service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:13.217127 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75730d16-3989-4abe-bce3-a757c2ce4552 service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:13.217399 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75730d16-3989-4abe-bce3-a757c2ce4552 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:13.219036 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-75730d16-3989-4abe-bce3-a757c2ce4552 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:13.247730 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:40:13.328151 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75730d16-3989-4abe-bce3-a757c2ce4552 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:40:13.329584 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75730d16-3989-4abe-bce3-a757c2ce4552 service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:40:13.346750 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 669/1332] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:40:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:40:15.390306 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf41f01-beed-448a-b884-9845f412b523 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:15.390851 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf41f01-beed-448a-b884-9845f412b523 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:15.390851 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf41f01-beed-448a-b884-9845f412b523 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:15.392254 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 664/1333] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:40:15.397352 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddeafba-3328-443e-a95b-d29aa0c778f0 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:15.397730 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddeafba-3328-443e-a95b-d29aa0c778f0 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:15.397904 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddeafba-3328-443e-a95b-d29aa0c778f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:15.463446 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-bddeafba-3328-443e-a95b-d29aa0c778f0 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:40:15.464640 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-bddeafba-3328-443e-a95b-d29aa0c778f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:15.538814 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:40:15.560956 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 670/1334] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:40:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:40:15.613677 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02a975-aabb-40ff-a266-df21c31081f7 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:15.613966 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02a975-aabb-40ff-a266-df21c31081f7 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:15.614253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02a975-aabb-40ff-a266-df21c31081f7 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:15.615624 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 665/1335] 10.222.0.42 () {54 vars in 965 bytes} [Fri Aug 5 02:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:40:15.621954 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfdba3b-b60b-4a0e-9581-be858b704d5c None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:15.622247 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfdba3b-b60b-4a0e-9581-be858b704d5c None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:15.622526 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfdba3b-b60b-4a0e-9581-be858b704d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:15.696814 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-ccfdba3b-b60b-4a0e-9581-be858b704d5c None None] MFA Rules not processed for user `a0035fcd8b06400bb7946f7ac37393a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:40:15.698026 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-ccfdba3b-b60b-4a0e-9581-be858b704d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:15.771304 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 671/1336] 10.222.0.42 () {58 vars in 1062 bytes} [Fri Aug 5 02:40:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:40:15.780102 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02a975-aabb-40ff-a266-df21c31081f7 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:40:15.781629 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-bd02a975-aabb-40ff-a266-df21c31081f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:15.822191 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:40:15.884671 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02a975-aabb-40ff-a266-df21c31081f7 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:40:15.955587 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53ed7c-c0d2-4be3-afca-3b277419fac6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:40:15.956201 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53ed7c-c0d2-4be3-afca-3b277419fac6 service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:15.956485 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53ed7c-c0d2-4be3-afca-3b277419fac6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:15.956760 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53ed7c-c0d2-4be3-afca-3b277419fac6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:15.958373 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-5f53ed7c-c0d2-4be3-afca-3b277419fac6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:16.039218 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:40:16.064672 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f53ed7c-c0d2-4be3-afca-3b277419fac6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:40:16.066112 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f53ed7c-c0d2-4be3-afca-3b277419fac6 service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:40:16.083952 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 666/1337] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:40:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:40:19.186984 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a00810-b02b-4f8b-8614-05ffe3ca0255 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:19.187559 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a00810-b02b-4f8b-8614-05ffe3ca0255 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:19.187559 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a00810-b02b-4f8b-8614-05ffe3ca0255 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:19.188922 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 672/1338] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:40:19.194056 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf97030-5d76-4d5e-a497-11bd02ccb5ac None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:19.194497 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf97030-5d76-4d5e-a497-11bd02ccb5ac None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:19.194603 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf97030-5d76-4d5e-a497-11bd02ccb5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:19.266093 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-5bf97030-5d76-4d5e-a497-11bd02ccb5ac None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:40:19.267330 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-5bf97030-5d76-4d5e-a497-11bd02ccb5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:19.362700 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 667/1339] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:40:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:40:19.398278 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a00810-b02b-4f8b-8614-05ffe3ca0255 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:40:19.400422 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-c3a00810-b02b-4f8b-8614-05ffe3ca0255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:19.482224 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:40:19.509738 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a00810-b02b-4f8b-8614-05ffe3ca0255 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:40:19.581095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653dfe8-c267-4b0e-9788-38a7fc3eb4b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:40:19.581718 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653dfe8-c267-4b0e-9788-38a7fc3eb4b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:19.582001 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653dfe8-c267-4b0e-9788-38a7fc3eb4b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:19.582279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653dfe8-c267-4b0e-9788-38a7fc3eb4b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:19.583928 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-f653dfe8-c267-4b0e-9788-38a7fc3eb4b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:19.689728 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653dfe8-c267-4b0e-9788-38a7fc3eb4b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:40:19.691189 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653dfe8-c267-4b0e-9788-38a7fc3eb4b6 service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:40:19.709162 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 673/1340] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:40:19 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:40:24.001717 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ed4ba-7301-4110-916d-2e8fea0eccfb None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:24.002187 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ed4ba-7301-4110-916d-2e8fea0eccfb None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:24.002296 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ed4ba-7301-4110-916d-2e8fea0eccfb None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:24.003624 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 668/1341] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:40:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:40:24.009220 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75196afc-9658-4767-b8bd-dc5e5a9a624a None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:24.009670 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75196afc-9658-4767-b8bd-dc5e5a9a624a None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:24.009767 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75196afc-9658-4767-b8bd-dc5e5a9a624a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:24.015313 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:40:24.080889 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-75196afc-9658-4767-b8bd-dc5e5a9a624a None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:40:24.082223 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-75196afc-9658-4767-b8bd-dc5e5a9a624a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:24.178809 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 674/1342] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:40:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:40:24.218291 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ed4ba-7301-4110-916d-2e8fea0eccfb None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:40:24.219907 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-6f5ed4ba-7301-4110-916d-2e8fea0eccfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:24.268597 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:40:24.324928 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ed4ba-7301-4110-916d-2e8fea0eccfb None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:40:24.398440 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd3050-b3c9-4741-b7c2-a32e3a06d28d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:40:24.399032 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd3050-b3c9-4741-b7c2-a32e3a06d28d service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:24.399315 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd3050-b3c9-4741-b7c2-a32e3a06d28d service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:24.399589 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd3050-b3c9-4741-b7c2-a32e3a06d28d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:24.401195 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-96cd3050-b3c9-4741-b7c2-a32e3a06d28d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:24.492064 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:40:24.511939 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd3050-b3c9-4741-b7c2-a32e3a06d28d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:40:24.513381 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd3050-b3c9-4741-b7c2-a32e3a06d28d service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:40:24.531520 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 669/1343] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:40:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:40:27.437189 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbdcfc4-0680-45fb-a077-0369bf3310b7 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:27.437717 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbdcfc4-0680-45fb-a077-0369bf3310b7 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:27.437812 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbdcfc4-0680-45fb-a077-0369bf3310b7 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:27.439168 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 675/1344] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:40:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:40:27.444411 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cfcf01-5b50-4c9e-89db-f95bfa94f3dc None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:27.444835 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cfcf01-5b50-4c9e-89db-f95bfa94f3dc None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:27.444977 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cfcf01-5b50-4c9e-89db-f95bfa94f3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:27.513000 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-08cfcf01-5b50-4c9e-89db-f95bfa94f3dc None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:40:27.514227 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-08cfcf01-5b50-4c9e-89db-f95bfa94f3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:27.614870 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 670/1345] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:40:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:40:27.653329 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbdcfc4-0680-45fb-a077-0369bf3310b7 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:40:27.654801 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-5dbdcfc4-0680-45fb-a077-0369bf3310b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:27.740416 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:40:27.757161 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbdcfc4-0680-45fb-a077-0369bf3310b7 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:40:27.831545 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b761b-c354-4997-b5b6-6b9f01d406f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:40:27.832177 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b761b-c354-4997-b5b6-6b9f01d406f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:27.832459 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b761b-c354-4997-b5b6-6b9f01d406f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:27.832734 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b761b-c354-4997-b5b6-6b9f01d406f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:27.834444 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-fc3b761b-c354-4997-b5b6-6b9f01d406f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:27.945177 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b761b-c354-4997-b5b6-6b9f01d406f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:40:27.946570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b761b-c354-4997-b5b6-6b9f01d406f4 service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:40:27.964917 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 676/1346] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:40:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:40:32.423978 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc7a27-122e-4452-a22a-bf0a897b016c None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:32.424460 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc7a27-122e-4452-a22a-bf0a897b016c None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:32.424568 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc7a27-122e-4452-a22a-bf0a897b016c None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:32.425876 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 671/1347] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:40:32.431811 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9fd89-f8d5-4994-a0a3-e99d8e611b26 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:32.432258 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9fd89-f8d5-4994-a0a3-e99d8e611b26 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:32.432373 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9fd89-f8d5-4994-a0a3-e99d8e611b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:32.447832 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:40:32.501238 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-5de9fd89-f8d5-4994-a0a3-e99d8e611b26 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:40:32.502450 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-5de9fd89-f8d5-4994-a0a3-e99d8e611b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:32.603354 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 677/1348] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:40:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:40:32.642101 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc7a27-122e-4452-a22a-bf0a897b016c None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:40:32.643657 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-85bc7a27-122e-4452-a22a-bf0a897b016c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:32.701534 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:40:32.749121 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc7a27-122e-4452-a22a-bf0a897b016c None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:40:32.837516 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99073fed-19bc-42ed-bdf7-85ee29685d57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:40:32.838135 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99073fed-19bc-42ed-bdf7-85ee29685d57 service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:32.838412 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99073fed-19bc-42ed-bdf7-85ee29685d57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:32.838681 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99073fed-19bc-42ed-bdf7-85ee29685d57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:32.840318 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-99073fed-19bc-42ed-bdf7-85ee29685d57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:32.944042 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:40:32.948104 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99073fed-19bc-42ed-bdf7-85ee29685d57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:40:32.949542 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99073fed-19bc-42ed-bdf7-85ee29685d57 service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:40:32.966746 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 672/1349] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:40:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:40:37.923896 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e063fae-b1af-43b3-b830-548238e782cb None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:37.924430 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e063fae-b1af-43b3-b830-548238e782cb None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:37.924730 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e063fae-b1af-43b3-b830-548238e782cb None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:37.933918 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 678/1350] 10.222.0.42 () {54 vars in 921 bytes} [Fri Aug 5 02:40:37 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:40:37.944278 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e232d25-f248-46a0-97c9-e85d27969280 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:37.944784 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e232d25-f248-46a0-97c9-e85d27969280 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:37.944913 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e232d25-f248-46a0-97c9-e85d27969280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:38.028227 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-1e232d25-f248-46a0-97c9-e85d27969280 None None] MFA Rules not processed for user `8b647f2cb18a41d6a9e124e886faa994`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:40:38.029417 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-1e232d25-f248-46a0-97c9-e85d27969280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:38.148533 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 673/1351] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Aug 5 02:40:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:40:42.200871 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee806ff-9ecd-488a-899b-8b2159a7475b None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:42.201381 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee806ff-9ecd-488a-899b-8b2159a7475b None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:42.201381 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee806ff-9ecd-488a-899b-8b2159a7475b None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:42.202887 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 679/1352] 10.222.0.42 () {54 vars in 921 bytes} [Fri Aug 5 02:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:40:42.208194 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d352a-48aa-484e-990a-687e91085eed None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:42.209032 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d352a-48aa-484e-990a-687e91085eed None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:42.209580 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d352a-48aa-484e-990a-687e91085eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:42.285713 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:40:42.313959 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-db9d352a-48aa-484e-990a-687e91085eed None None] MFA Rules not processed for user `8b647f2cb18a41d6a9e124e886faa994`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:40:42.315192 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-db9d352a-48aa-484e-990a-687e91085eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:42.425038 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 674/1353] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Aug 5 02:40:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:40:42.601006 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=59 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:40:43.759611 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793a87c-9dc5-47cf-9af6-08ffe7905bb6 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:43.760552 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793a87c-9dc5-47cf-9af6-08ffe7905bb6 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:43.760552 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793a87c-9dc5-47cf-9af6-08ffe7905bb6 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:43.761517 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 680/1354] 10.222.0.42 () {54 vars in 921 bytes} [Fri Aug 5 02:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:40:43.766406 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd6a9d-6444-495b-af32-d2154570512d None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:43.766865 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd6a9d-6444-495b-af32-d2154570512d None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:43.767162 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd6a9d-6444-495b-af32-d2154570512d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:43.847536 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-0dfd6a9d-6444-495b-af32-d2154570512d None None] MFA Rules not processed for user `8b647f2cb18a41d6a9e124e886faa994`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:40:43.848749 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-0dfd6a9d-6444-495b-af32-d2154570512d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:43.890881 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:40:43.956401 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 675/1355] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Aug 5 02:40:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:40:47.435660 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab286d-c952-445f-a5c3-2c1c9419cded None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:47.436080 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab286d-c952-445f-a5c3-2c1c9419cded None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:47.436196 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab286d-c952-445f-a5c3-2c1c9419cded None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:47.437577 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 681/1356] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:40:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:40:47.442881 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb68da7-a4a0-4099-9091-75a409100c87 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:47.443339 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb68da7-a4a0-4099-9091-75a409100c87 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:47.443477 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb68da7-a4a0-4099-9091-75a409100c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:47.532080 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-fdb68da7-a4a0-4099-9091-75a409100c87 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:40:47.533584 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-fdb68da7-a4a0-4099-9091-75a409100c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:47.645908 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 676/1357] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:40:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:40:47.700670 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78670cf-3a95-45a2-9637-f2ddc8052318 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:47.701209 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78670cf-3a95-45a2-9637-f2ddc8052318 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:47.701795 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78670cf-3a95-45a2-9637-f2ddc8052318 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:47.703758 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 682/1358] 10.222.0.42 () {54 vars in 962 bytes} [Fri Aug 5 02:40:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:40:47.712654 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656a6d7-a4ab-4dda-8298-edf02c3b51d7 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:47.713173 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656a6d7-a4ab-4dda-8298-edf02c3b51d7 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:47.720213 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656a6d7-a4ab-4dda-8298-edf02c3b51d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:47.731656 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:40:47.794063 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-5656a6d7-a4ab-4dda-8298-edf02c3b51d7 None None] MFA Rules not processed for user `55374d3bccd541c9a8f82da9b21c2fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:40:47.795393 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-5656a6d7-a4ab-4dda-8298-edf02c3b51d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:47.921515 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 677/1359] 10.222.0.42 () {58 vars in 1059 bytes} [Fri Aug 5 02:40:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:40:47.929967 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78670cf-3a95-45a2-9637-f2ddc8052318 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:40:47.931828 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-c78670cf-3a95-45a2-9637-f2ddc8052318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:48.084394 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78670cf-3a95-45a2-9637-f2ddc8052318 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:40:48.159647 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:40:48.201485 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa94d1eb-48d6-49af-9d0f-3685b5cfd4b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:40:48.202176 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94d1eb-48d6-49af-9d0f-3685b5cfd4b3 service nova] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:48.202460 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94d1eb-48d6-49af-9d0f-3685b5cfd4b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:48.202732 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94d1eb-48d6-49af-9d0f-3685b5cfd4b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:48.204387 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-fa94d1eb-48d6-49af-9d0f-3685b5cfd4b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:48.309225 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa94d1eb-48d6-49af-9d0f-3685b5cfd4b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:40:48.311123 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa94d1eb-48d6-49af-9d0f-3685b5cfd4b3 service nova] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:40:48.330733 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 683/1360] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:40:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:40:50.580901 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df1ef2-edd0-41f9-8678-03344e0943bd None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:50.581445 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df1ef2-edd0-41f9-8678-03344e0943bd None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:50.581445 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df1ef2-edd0-41f9-8678-03344e0943bd None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:50.582895 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 678/1361] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:40:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:40:50.588451 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e001388-90d1-4c9c-a62c-27a597d4541f None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:50.588851 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e001388-90d1-4c9c-a62c-27a597d4541f None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:50.589014 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e001388-90d1-4c9c-a62c-27a597d4541f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:50.673227 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-5e001388-90d1-4c9c-a62c-27a597d4541f None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:40:50.674633 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-5e001388-90d1-4c9c-a62c-27a597d4541f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:50.716313 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:40:50.782561 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 684/1362] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:40:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:40:50.828568 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df1ef2-edd0-41f9-8678-03344e0943bd None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:40:50.830129 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-19df1ef2-edd0-41f9-8678-03344e0943bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:50.906100 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:40:51.018759 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df1ef2-edd0-41f9-8678-03344e0943bd None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:40:51.161767 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9bd5a-098b-4195-af6a-77d6455b9f33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:40:51.162415 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9bd5a-098b-4195-af6a-77d6455b9f33 service nova] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:51.162749 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9bd5a-098b-4195-af6a-77d6455b9f33 service nova] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:51.163097 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9bd5a-098b-4195-af6a-77d6455b9f33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:51.165276 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-84f9bd5a-098b-4195-af6a-77d6455b9f33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:51.190995 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:40:51.263237 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f9bd5a-098b-4195-af6a-77d6455b9f33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:40:51.265073 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f9bd5a-098b-4195-af6a-77d6455b9f33 service nova] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:40:51.293485 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 679/1363] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:40:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:40:53.788995 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341695e9-354d-460c-8abc-55ee75de1fe6 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:53.790010 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341695e9-354d-460c-8abc-55ee75de1fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:53.790511 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341695e9-354d-460c-8abc-55ee75de1fe6 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:53.792808 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 685/1364] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:40:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:40:53.799920 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de3669-c069-4dc9-a58c-6f14c91c637e None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:53.800739 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de3669-c069-4dc9-a58c-6f14c91c637e None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:53.801176 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de3669-c069-4dc9-a58c-6f14c91c637e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:53.880979 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-a7de3669-c069-4dc9-a58c-6f14c91c637e None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:40:53.882340 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-a7de3669-c069-4dc9-a58c-6f14c91c637e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:53.991323 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:40:53.994005 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 680/1365] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:40:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:40:54.042131 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6d58a-b3c0-4dd7-b7e6-0b36d9b9f180 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:54.042544 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6d58a-b3c0-4dd7-b7e6-0b36d9b9f180 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:54.042923 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6d58a-b3c0-4dd7-b7e6-0b36d9b9f180 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:54.044543 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 686/1366] 10.222.0.42 () {54 vars in 962 bytes} [Fri Aug 5 02:40:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:40:54.050714 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a3ba4-e4ff-4f80-a0d3-65ed8902f8f2 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:54.051322 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a3ba4-e4ff-4f80-a0d3-65ed8902f8f2 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:54.051605 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a3ba4-e4ff-4f80-a0d3-65ed8902f8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:54.132476 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-7b5a3ba4-e4ff-4f80-a0d3-65ed8902f8f2 None None] MFA Rules not processed for user `55374d3bccd541c9a8f82da9b21c2fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:40:54.133625 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-7b5a3ba4-e4ff-4f80-a0d3-65ed8902f8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:54.259929 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 681/1367] 10.222.0.42 () {58 vars in 1059 bytes} [Fri Aug 5 02:40:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:40:54.267940 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6d58a-b3c0-4dd7-b7e6-0b36d9b9f180 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:40:54.269894 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-17a6d58a-b3c0-4dd7-b7e6-0b36d9b9f180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:54.431730 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6d58a-b3c0-4dd7-b7e6-0b36d9b9f180 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:40:54.453836 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:40:54.551085 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8967493-b63c-4c3a-b56f-a36471201cfd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:40:54.551908 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8967493-b63c-4c3a-b56f-a36471201cfd service nova] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:54.552294 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8967493-b63c-4c3a-b56f-a36471201cfd service nova] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:54.552673 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8967493-b63c-4c3a-b56f-a36471201cfd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:54.555061 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-f8967493-b63c-4c3a-b56f-a36471201cfd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:54.647783 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8967493-b63c-4c3a-b56f-a36471201cfd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:40:54.649551 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8967493-b63c-4c3a-b56f-a36471201cfd service nova] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:40:54.668904 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 687/1368] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:40:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:40:55.662347 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0743450-dcd5-4a28-934b-ccdd5712fbe6 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:55.662882 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0743450-dcd5-4a28-934b-ccdd5712fbe6 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:55.662882 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0743450-dcd5-4a28-934b-ccdd5712fbe6 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:55.664373 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 682/1369] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:40:55.669345 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942de3d6-edf1-46f8-b9d3-7fbe9b918809 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:55.669734 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942de3d6-edf1-46f8-b9d3-7fbe9b918809 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:55.669935 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942de3d6-edf1-46f8-b9d3-7fbe9b918809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:55.702659 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:40:55.738781 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-942de3d6-edf1-46f8-b9d3-7fbe9b918809 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:40:55.740849 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-942de3d6-edf1-46f8-b9d3-7fbe9b918809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:55.846605 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 688/1370] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:40:56.189165 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a5b62-936b-4741-9293-0da360b90466 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:56.189165 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a5b62-936b-4741-9293-0da360b90466 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:56.189165 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a5b62-936b-4741-9293-0da360b90466 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:56.190064 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 683/1371] 10.222.0.42 () {54 vars in 964 bytes} [Fri Aug 5 02:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:40:56.195439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2824d-a42d-44fc-820d-0f246d2bdeca None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:56.195729 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2824d-a42d-44fc-820d-0f246d2bdeca None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:56.196006 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2824d-a42d-44fc-820d-0f246d2bdeca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:56.290496 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-4df2824d-a42d-44fc-820d-0f246d2bdeca None None] MFA Rules not processed for user `e60a3568771842e294858e5868068f84`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:40:56.291790 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-4df2824d-a42d-44fc-820d-0f246d2bdeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:56.342547 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:40:56.374546 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 689/1372] 10.222.0.42 () {58 vars in 1061 bytes} [Fri Aug 5 02:40:56 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:40:56.382242 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a5b62-936b-4741-9293-0da360b90466 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:40:56.383993 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-520a5b62-936b-4741-9293-0da360b90466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:56.437168 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:40:56.497172 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a5b62-936b-4741-9293-0da360b90466 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:40:56.576288 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cec408-ac93-47e7-a62f-caacf95018ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:40:56.577452 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cec408-ac93-47e7-a62f-caacf95018ce service cinder] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:56.577939 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cec408-ac93-47e7-a62f-caacf95018ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:56.578416 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cec408-ac93-47e7-a62f-caacf95018ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:56.580479 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-77cec408-ac93-47e7-a62f-caacf95018ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:56.687909 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:40:56.703024 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cec408-ac93-47e7-a62f-caacf95018ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:40:56.705060 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cec408-ac93-47e7-a62f-caacf95018ce service cinder] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:40:56.725888 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 684/1373] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:40:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:40:56.915072 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538b87a-4b97-4afd-91e9-829c7c2a95e6 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:56.915914 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538b87a-4b97-4afd-91e9-829c7c2a95e6 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:56.915914 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538b87a-4b97-4afd-91e9-829c7c2a95e6 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:56.917192 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 690/1374] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:40:56.922205 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452161b2-c911-4c70-b7a9-a4359397bd78 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:56.922371 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452161b2-c911-4c70-b7a9-a4359397bd78 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:56.922684 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452161b2-c911-4c70-b7a9-a4359397bd78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:56.998107 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-452161b2-c911-4c70-b7a9-a4359397bd78 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:40:56.999330 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-452161b2-c911-4c70-b7a9-a4359397bd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:57.106999 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 685/1375] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:40:57.151147 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538b87a-4b97-4afd-91e9-829c7c2a95e6 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:40:57.152762 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-d538b87a-4b97-4afd-91e9-829c7c2a95e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:57.302637 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538b87a-4b97-4afd-91e9-829c7c2a95e6 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:40:57.359396 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:40:57.428289 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a81948-6d4a-4cb6-96ff-2d0b3c3d1e28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:40:57.428934 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a81948-6d4a-4cb6-96ff-2d0b3c3d1e28 service nova] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:57.429199 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a81948-6d4a-4cb6-96ff-2d0b3c3d1e28 service nova] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:57.429477 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a81948-6d4a-4cb6-96ff-2d0b3c3d1e28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:57.431147 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-11a81948-6d4a-4cb6-96ff-2d0b3c3d1e28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:57.521537 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a81948-6d4a-4cb6-96ff-2d0b3c3d1e28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:40:57.523787 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a81948-6d4a-4cb6-96ff-2d0b3c3d1e28 service nova] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:40:57.543602 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 691/1376] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:40:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:40:59.696337 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4b707-c72c-4bc3-9d21-0f417a7097f5 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:59.697498 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4b707-c72c-4bc3-9d21-0f417a7097f5 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:59.698083 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4b707-c72c-4bc3-9d21-0f417a7097f5 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:59.699727 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 686/1377] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:40:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:40:59.705101 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb47d66-1177-4645-9cef-a2c3bd73b932 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:59.705520 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb47d66-1177-4645-9cef-a2c3bd73b932 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:59.705629 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb47d66-1177-4645-9cef-a2c3bd73b932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:59.771470 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-3bb47d66-1177-4645-9cef-a2c3bd73b932 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:40:59.773188 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-3bb47d66-1177-4645-9cef-a2c3bd73b932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:59.779857 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:40:59.909755 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 692/1378] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:40:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:40:59.954490 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb4b707-c72c-4bc3-9d21-0f417a7097f5 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:40:59.956053 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-3eb4b707-c72c-4bc3-9d21-0f417a7097f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:00.017684 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:00.102060 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb4b707-c72c-4bc3-9d21-0f417a7097f5 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:41:00.216642 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9d0ce-9e28-4401-9f9f-08a5d2390eac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:41:00.217272 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9d0ce-9e28-4401-9f9f-08a5d2390eac service nova] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:00.217557 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9d0ce-9e28-4401-9f9f-08a5d2390eac service nova] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:00.217834 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9d0ce-9e28-4401-9f9f-08a5d2390eac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:00.219505 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-33a9d0ce-9e28-4401-9f9f-08a5d2390eac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:00.248141 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:00.346040 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a9d0ce-9e28-4401-9f9f-08a5d2390eac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:41:00.348731 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a9d0ce-9e28-4401-9f9f-08a5d2390eac service nova] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:41:00.375060 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 687/1379] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:40:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:41:02.496134 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3e1b7-d74b-4fcb-b692-d94197912479 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:02.496672 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3e1b7-d74b-4fcb-b692-d94197912479 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:02.496672 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3e1b7-d74b-4fcb-b692-d94197912479 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:02.498190 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 693/1380] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:41:02.503136 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ec431-92b2-4bde-a032-770765b65b6a None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:02.503555 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ec431-92b2-4bde-a032-770765b65b6a None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:02.503725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ec431-92b2-4bde-a032-770765b65b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:02.572478 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-798ec431-92b2-4bde-a032-770765b65b6a None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:41:02.573601 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-798ec431-92b2-4bde-a032-770765b65b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:02.679567 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:02.683484 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 688/1381] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:41:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:41:02.728118 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3e1b7-d74b-4fcb-b692-d94197912479 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:41:02.730001 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-e4e3e1b7-d74b-4fcb-b692-d94197912479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:02.874158 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:02.886923 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3e1b7-d74b-4fcb-b692-d94197912479 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:41:03.008690 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf975fd-c2ad-4a1c-94a7-5d5a6b8d30d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:41:03.009476 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf975fd-c2ad-4a1c-94a7-5d5a6b8d30d4 service nova] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:03.009863 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf975fd-c2ad-4a1c-94a7-5d5a6b8d30d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:03.010243 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf975fd-c2ad-4a1c-94a7-5d5a6b8d30d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:03.012098 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-fdf975fd-c2ad-4a1c-94a7-5d5a6b8d30d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:03.112174 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf975fd-c2ad-4a1c-94a7-5d5a6b8d30d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:41:03.114021 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf975fd-c2ad-4a1c-94a7-5d5a6b8d30d4 service nova] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:41:03.127053 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:03.138039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 694/1382] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:41:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:41:05.300366 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8c83a-4525-4c87-a174-d6e25e299984 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:05.301069 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8c83a-4525-4c87-a174-d6e25e299984 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:05.301069 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8c83a-4525-4c87-a174-d6e25e299984 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:05.302268 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 689/1383] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:41:05.309053 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c693d3-8bf1-4f69-abd5-794288d63e2e None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:05.309514 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c693d3-8bf1-4f69-abd5-794288d63e2e None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:05.309612 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c693d3-8bf1-4f69-abd5-794288d63e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:05.380524 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-73c693d3-8bf1-4f69-abd5-794288d63e2e None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:41:05.382052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-73c693d3-8bf1-4f69-abd5-794288d63e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:05.527982 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 695/1384] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:41:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:41:05.572923 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8c83a-4525-4c87-a174-d6e25e299984 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:41:05.574785 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-19b8c83a-4525-4c87-a174-d6e25e299984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:05.746737 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8c83a-4525-4c87-a174-d6e25e299984 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:41:05.829607 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:05.877481 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0b5fe-1358-4d8d-98c8-d9935bac18f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:41:05.878106 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0b5fe-1358-4d8d-98c8-d9935bac18f9 service nova] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:05.878387 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0b5fe-1358-4d8d-98c8-d9935bac18f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:05.878666 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0b5fe-1358-4d8d-98c8-d9935bac18f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:05.880323 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-f0a0b5fe-1358-4d8d-98c8-d9935bac18f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:05.981938 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a0b5fe-1358-4d8d-98c8-d9935bac18f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:41:05.983588 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a0b5fe-1358-4d8d-98c8-d9935bac18f9 service nova] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:41:06.002253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 690/1385] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:41:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:41:08.044520 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f04881-5a96-45ef-bc22-4df6c25ef2d1 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:08.045308 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f04881-5a96-45ef-bc22-4df6c25ef2d1 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:08.045308 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f04881-5a96-45ef-bc22-4df6c25ef2d1 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:08.046450 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 696/1386] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:41:08.051795 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b2a7f-72e9-4c59-9257-35362549f3f2 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:08.052295 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b2a7f-72e9-4c59-9257-35362549f3f2 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:08.052392 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b2a7f-72e9-4c59-9257-35362549f3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:08.129990 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-994b2a7f-72e9-4c59-9257-35362549f3f2 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:41:08.131261 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-994b2a7f-72e9-4c59-9257-35362549f3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:08.166972 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:08.232168 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 691/1387] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:41:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:41:08.278126 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f04881-5a96-45ef-bc22-4df6c25ef2d1 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:41:08.280103 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-d6f04881-5a96-45ef-bc22-4df6c25ef2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:08.375038 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:08.455077 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f04881-5a96-45ef-bc22-4df6c25ef2d1 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:41:08.586363 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56258cfc-3827-489c-95f8-58a477651aa3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:41:08.587128 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56258cfc-3827-489c-95f8-58a477651aa3 service nova] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:08.587483 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56258cfc-3827-489c-95f8-58a477651aa3 service nova] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:08.587956 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56258cfc-3827-489c-95f8-58a477651aa3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:08.590214 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-56258cfc-3827-489c-95f8-58a477651aa3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:08.639198 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:08.691996 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56258cfc-3827-489c-95f8-58a477651aa3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:41:08.693684 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56258cfc-3827-489c-95f8-58a477651aa3 service nova] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:41:08.712558 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 697/1388] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:41:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:41:10.946244 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be2b8e-e155-400a-acb2-4e2900fcba5b None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:10.946810 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be2b8e-e155-400a-acb2-4e2900fcba5b None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:10.946810 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be2b8e-e155-400a-acb2-4e2900fcba5b None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:10.948263 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 692/1389] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:41:10.953745 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f856ea-5457-41ce-aa58-0b965d93826f None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:10.954152 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f856ea-5457-41ce-aa58-0b965d93826f None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:10.954364 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f856ea-5457-41ce-aa58-0b965d93826f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:11.020953 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-05f856ea-5457-41ce-aa58-0b965d93826f None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:41:11.022180 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-05f856ea-5457-41ce-aa58-0b965d93826f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:11.120793 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 698/1390] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:41:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:41:11.165085 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be2b8e-e155-400a-acb2-4e2900fcba5b None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:41:11.166667 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-46be2b8e-e155-400a-acb2-4e2900fcba5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:11.312333 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be2b8e-e155-400a-acb2-4e2900fcba5b None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:41:11.328394 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:11.425628 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908e205-93da-40c6-9195-4c0cbd293cce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:41:11.426248 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908e205-93da-40c6-9195-4c0cbd293cce service nova] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:11.426534 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908e205-93da-40c6-9195-4c0cbd293cce service nova] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:11.426812 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908e205-93da-40c6-9195-4c0cbd293cce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:11.429034 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-1908e205-93da-40c6-9195-4c0cbd293cce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:11.522227 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1908e205-93da-40c6-9195-4c0cbd293cce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:41:11.523785 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1908e205-93da-40c6-9195-4c0cbd293cce service nova] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:41:11.541964 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 693/1391] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:41:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:41:11.976083 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4fd0e-6ce9-4476-8706-5563581f3d01 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:11.976599 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4fd0e-6ce9-4476-8706-5563581f3d01 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:11.976599 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4fd0e-6ce9-4476-8706-5563581f3d01 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:11.978185 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 699/1392] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:41:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:41:11.983620 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902f9d7-1350-437c-bb20-0144a80cbc49 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:11.984080 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902f9d7-1350-437c-bb20-0144a80cbc49 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:11.984285 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902f9d7-1350-437c-bb20-0144a80cbc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:12.010287 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:12.052409 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-3902f9d7-1350-437c-bb20-0144a80cbc49 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:41:12.053666 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-3902f9d7-1350-437c-bb20-0144a80cbc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:12.152078 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 694/1393] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:41:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:41:12.206930 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc0d9e-77a4-4841-a30a-9639523d3f38 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:12.207310 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc0d9e-77a4-4841-a30a-9639523d3f38 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:12.207657 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc0d9e-77a4-4841-a30a-9639523d3f38 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:12.209080 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 700/1394] 10.222.0.42 () {54 vars in 966 bytes} [Fri Aug 5 02:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:41:12.214563 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d89bd-b72a-4883-a591-c976168834ae None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:12.214851 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d89bd-b72a-4883-a591-c976168834ae None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:12.215159 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d89bd-b72a-4883-a591-c976168834ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:12.297479 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-c69d89bd-b72a-4883-a591-c976168834ae None None] MFA Rules not processed for user `116f66d7dd7b42878f71bd29dc55729c`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:41:12.298678 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-c69d89bd-b72a-4883-a591-c976168834ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:12.339036 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:12.375890 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 695/1395] 10.222.0.42 () {58 vars in 1063 bytes} [Fri Aug 5 02:41:12 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:41:12.384126 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc0d9e-77a4-4841-a30a-9639523d3f38 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:41:12.385700 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-adcc0d9e-77a4-4841-a30a-9639523d3f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:12.399124 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:12.494863 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc0d9e-77a4-4841-a30a-9639523d3f38 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:41:12.565239 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7870b-440b-4381-a5e3-74d87538bff3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '116f66d7dd7b42878f71bd29dc55729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:41:12.565784 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7870b-440b-4381-a5e3-74d87538bff3 service glance] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:12.566062 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7870b-440b-4381-a5e3-74d87538bff3 service glance] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:12.566335 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7870b-440b-4381-a5e3-74d87538bff3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:12.567966 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-57b7870b-440b-4381-a5e3-74d87538bff3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:12.635526 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:12.675198 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b7870b-440b-4381-a5e3-74d87538bff3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:41:12.676629 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b7870b-440b-4381-a5e3-74d87538bff3 service glance] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:41:12.695371 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 701/1396] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:41:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:41:13.568683 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc60317-9b66-4f46-95b7-1a1c12217d15 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:13.569940 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc60317-9b66-4f46-95b7-1a1c12217d15 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:13.569940 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc60317-9b66-4f46-95b7-1a1c12217d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:13.651870 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-0bc60317-9b66-4f46-95b7-1a1c12217d15 None None] MFA Rules not processed for user `6bea520676244effbbe212aa62b1cc68`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:41:13.653083 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-0bc60317-9b66-4f46-95b7-1a1c12217d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:13.701851 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5722b0e-69f5-4ce3-b310-0b8b4e6ee091 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:13.702619 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5722b0e-69f5-4ce3-b310-0b8b4e6ee091 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:13.702879 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5722b0e-69f5-4ce3-b310-0b8b4e6ee091 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:13.704272 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 702/1397] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:41:13.709136 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5329f3-e95e-4cea-a024-35c205930436 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:13.710066 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5329f3-e95e-4cea-a024-35c205930436 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:13.710372 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5329f3-e95e-4cea-a024-35c205930436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:13.749743 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 696/1398] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Aug 5 02:41:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:41:13.799928 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-cc5329f3-e95e-4cea-a024-35c205930436 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:41:13.800093 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426b01c-4ac7-4f41-a130-d5c74a23e210 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:13.800271 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426b01c-4ac7-4f41-a130-d5c74a23e210 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:13.800534 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426b01c-4ac7-4f41-a130-d5c74a23e210 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:13.801152 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-cc5329f3-e95e-4cea-a024-35c205930436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:13.802160 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 697/1399] 10.222.0.42 () {54 vars in 943 bytes} [Fri Aug 5 02:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:41:13.808089 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea38f6-fc08-4899-a335-d11ff4d79514 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:13.808372 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea38f6-fc08-4899-a335-d11ff4d79514 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:13.808648 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea38f6-fc08-4899-a335-d11ff4d79514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:13.882857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:13.890264 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-b6ea38f6-fc08-4899-a335-d11ff4d79514 None None] MFA Rules not processed for user `40f706f1eb2b4137afd367cb5060ced0`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:41:13.891578 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-b6ea38f6-fc08-4899-a335-d11ff4d79514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:13.904467 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 703/1400] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:41:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:41:13.949777 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5329f3-e95e-4cea-a024-35c205930436 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:41:13.950996 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-cc5329f3-e95e-4cea-a024-35c205930436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:13.979116 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:13.998999 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 698/1401] 10.222.0.42 () {58 vars in 1040 bytes} [Fri Aug 5 02:41:13 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:41:14.009269 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea38f6-fc08-4899-a335-d11ff4d79514 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:41:14.018770 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea38f6-fc08-4899-a335-d11ff4d79514 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:41:14.072858 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5329f3-e95e-4cea-a024-35c205930436 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:41:14.128809 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4fc71-c9f3-4bfa-83b4-034c67529804 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40f706f1eb2b4137afd367cb5060ced0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:41:14.129429 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4fc71-c9f3-4bfa-83b4-034c67529804 service swift] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:14.129708 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4fc71-c9f3-4bfa-83b4-034c67529804 service swift] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:14.129981 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4fc71-c9f3-4bfa-83b4-034c67529804 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:14.132537 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-15a4fc71-c9f3-4bfa-83b4-034c67529804 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:14.135141 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:14.187846 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e68857-c383-45ba-be1e-0f01051bf2ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:41:14.188469 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e68857-c383-45ba-be1e-0f01051bf2ac service nova] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:14.188767 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e68857-c383-45ba-be1e-0f01051bf2ac service nova] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:14.189135 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e68857-c383-45ba-be1e-0f01051bf2ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:14.190745 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-60e68857-c383-45ba-be1e-0f01051bf2ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:14.208820 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:14.216962 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a4fc71-c9f3-4bfa-83b4-034c67529804 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:41:14.224166 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a4fc71-c9f3-4bfa-83b4-034c67529804 service swift] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:41:14.228119 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 699/1402] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 5 02:41:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 05 02:41:14.280016 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e68857-c383-45ba-be1e-0f01051bf2ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:41:14.281610 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e68857-c383-45ba-be1e-0f01051bf2ac service nova] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:41:14.299560 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 704/1403] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:41:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:41:16.494654 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1f9d8-b3a4-462b-a87c-89f58436f79f None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:16.495313 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1f9d8-b3a4-462b-a87c-89f58436f79f None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:16.495422 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1f9d8-b3a4-462b-a87c-89f58436f79f None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:16.497057 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 700/1404] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:41:16.502118 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fed9d8-a9ed-45d5-b2b4-da75129cff26 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:16.502589 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fed9d8-a9ed-45d5-b2b4-da75129cff26 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:16.502701 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fed9d8-a9ed-45d5-b2b4-da75129cff26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:16.575713 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-73fed9d8-a9ed-45d5-b2b4-da75129cff26 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:41:16.577065 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-73fed9d8-a9ed-45d5-b2b4-da75129cff26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:16.703193 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:16.716444 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 705/1405] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:41:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:41:16.759123 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1f9d8-b3a4-462b-a87c-89f58436f79f None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:41:16.760652 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-62e1f9d8-b3a4-462b-a87c-89f58436f79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:16.933987 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:16.936568 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1f9d8-b3a4-462b-a87c-89f58436f79f None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:41:17.068710 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630494dd-2949-48df-a382-0c6ed7a652f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:41:17.069698 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630494dd-2949-48df-a382-0c6ed7a652f9 service nova] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:17.070146 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630494dd-2949-48df-a382-0c6ed7a652f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:17.070414 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630494dd-2949-48df-a382-0c6ed7a652f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:17.072091 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-630494dd-2949-48df-a382-0c6ed7a652f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:17.171714 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630494dd-2949-48df-a382-0c6ed7a652f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:41:17.173233 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630494dd-2949-48df-a382-0c6ed7a652f9 service nova] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:41:17.192129 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 701/1406] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:41:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:41:19.363311 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76922b-546f-48eb-a327-b8462dabf37d None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:19.363763 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76922b-546f-48eb-a327-b8462dabf37d None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:19.363860 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76922b-546f-48eb-a327-b8462dabf37d None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:19.366995 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 706/1407] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:41:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:41:19.372530 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dac802-5101-4ad0-bd48-a8e9614f58b2 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:19.372530 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dac802-5101-4ad0-bd48-a8e9614f58b2 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:19.372530 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dac802-5101-4ad0-bd48-a8e9614f58b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:19.376261 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:19.440913 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-a8dac802-5101-4ad0-bd48-a8e9614f58b2 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:41:19.442237 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-a8dac802-5101-4ad0-bd48-a8e9614f58b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:19.563092 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 702/1408] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:41:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:41:19.608760 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76922b-546f-48eb-a327-b8462dabf37d None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:41:19.610307 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-6c76922b-546f-48eb-a327-b8462dabf37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:19.777511 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76922b-546f-48eb-a327-b8462dabf37d None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:41:19.853739 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:19.903408 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923641c-9cc0-4ba9-bbc1-cc93a67147ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:41:19.904036 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923641c-9cc0-4ba9-bbc1-cc93a67147ee service nova] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:19.904321 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923641c-9cc0-4ba9-bbc1-cc93a67147ee service nova] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:19.904597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923641c-9cc0-4ba9-bbc1-cc93a67147ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:19.906235 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-e923641c-9cc0-4ba9-bbc1-cc93a67147ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:20.009847 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e923641c-9cc0-4ba9-bbc1-cc93a67147ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:41:20.011530 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e923641c-9cc0-4ba9-bbc1-cc93a67147ee service nova] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:41:20.030733 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 707/1409] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:41:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:41:29.561091 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=64 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:30.028392 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=64 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:37.810318 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a3215-9067-4b3f-bf4a-0ec69d984920 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:37.810869 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a3215-9067-4b3f-bf4a-0ec69d984920 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:37.810869 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a3215-9067-4b3f-bf4a-0ec69d984920 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:37.812281 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 703/1410] 10.222.0.42 () {54 vars in 918 bytes} [Fri Aug 5 02:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:41:37.817253 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e8d96-ff55-491b-a02c-f355cffda212 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:37.817660 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e8d96-ff55-491b-a02c-f355cffda212 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:37.817798 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e8d96-ff55-491b-a02c-f355cffda212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:37.895798 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-ac7e8d96-ff55-491b-a02c-f355cffda212 None None] MFA Rules not processed for user `8b647f2cb18a41d6a9e124e886faa994`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:41:37.897036 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-ac7e8d96-ff55-491b-a02c-f355cffda212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:37.999967 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 708/1411] 10.222.0.42 () {58 vars in 1015 bytes} [Fri Aug 5 02:41:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:41:38.015140 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7947a4-5356-43e4-9e2c-0b7f786dc3ff None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:38.015427 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7947a4-5356-43e4-9e2c-0b7f786dc3ff None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:38.015702 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7947a4-5356-43e4-9e2c-0b7f786dc3ff None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:38.017035 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 704/1412] 10.222.0.42 () {54 vars in 918 bytes} [Fri Aug 5 02:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:41:38.021597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09d91c-bc72-4d40-8d96-cd69056dfd83 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:38.021885 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09d91c-bc72-4d40-8d96-cd69056dfd83 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:38.022163 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09d91c-bc72-4d40-8d96-cd69056dfd83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:38.091942 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:38.094818 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-5d09d91c-bc72-4d40-8d96-cd69056dfd83 None None] MFA Rules not processed for user `55374d3bccd541c9a8f82da9b21c2fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:41:38.096052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-5d09d91c-bc72-4d40-8d96-cd69056dfd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:38.210162 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 709/1413] 10.222.0.42 () {58 vars in 1015 bytes} [Fri Aug 5 02:41:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:41:40.676236 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b3874-6c1e-4827-a3ee-a4bf7a0e0918 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:40.676771 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b3874-6c1e-4827-a3ee-a4bf7a0e0918 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:40.676771 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b3874-6c1e-4827-a3ee-a4bf7a0e0918 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:40.678068 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 705/1414] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 02:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:41:40.683306 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac38a8-ccb2-4531-8f57-50c4ed7d8330 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:40.683751 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac38a8-ccb2-4531-8f57-50c4ed7d8330 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:40.683854 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac38a8-ccb2-4531-8f57-50c4ed7d8330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:40.747575 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-4eac38a8-ccb2-4531-8f57-50c4ed7d8330 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:41:40.748765 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-4eac38a8-ccb2-4531-8f57-50c4ed7d8330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:40.801818 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:40.843536 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 710/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 02:41:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:41:40.886887 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b3874-6c1e-4827-a3ee-a4bf7a0e0918 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:41:40.888467 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-028b3874-6c1e-4827-a3ee-a4bf7a0e0918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:41.030872 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b3874-6c1e-4827-a3ee-a4bf7a0e0918 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:41:41.101723 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:41.142495 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef232749-7f52-4ad5-9559-e00642d82a86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:41:41.143217 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef232749-7f52-4ad5-9559-e00642d82a86 service nova] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:41.143501 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef232749-7f52-4ad5-9559-e00642d82a86 service nova] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:41.143776 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef232749-7f52-4ad5-9559-e00642d82a86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:41.145393 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-ef232749-7f52-4ad5-9559-e00642d82a86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:41.233761 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef232749-7f52-4ad5-9559-e00642d82a86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:41:41.235402 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef232749-7f52-4ad5-9559-e00642d82a86 service nova] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:41:41.253529 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 706/1416] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:41:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:41:42.151402 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45558a8-4714-4b00-a7fb-18174ba50937 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:42.151951 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45558a8-4714-4b00-a7fb-18174ba50937 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:42.152081 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45558a8-4714-4b00-a7fb-18174ba50937 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:42.153362 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 711/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 02:41:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:41:42.158107 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5f7a3-1af8-4a97-bb97-cc2b610e4a08 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:42.158499 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5f7a3-1af8-4a97-bb97-cc2b610e4a08 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:42.158658 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5f7a3-1af8-4a97-bb97-cc2b610e4a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:42.233510 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-14f5f7a3-1af8-4a97-bb97-cc2b610e4a08 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:41:42.234719 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-14f5f7a3-1af8-4a97-bb97-cc2b610e4a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:42.261085 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:42.330045 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 707/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 02:41:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:41:42.479984 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45558a8-4714-4b00-a7fb-18174ba50937 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:41:42.481516 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-d45558a8-4714-4b00-a7fb-18174ba50937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:42.626306 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45558a8-4714-4b00-a7fb-18174ba50937 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:41:42.666471 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:42.736840 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34edc36b-dbce-4e96-b1a5-b24c77aff812 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:41:42.737392 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edc36b-dbce-4e96-b1a5-b24c77aff812 service nova] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:42.737671 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edc36b-dbce-4e96-b1a5-b24c77aff812 service nova] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:42.737946 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edc36b-dbce-4e96-b1a5-b24c77aff812 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:42.739617 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-34edc36b-dbce-4e96-b1a5-b24c77aff812 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:42.826381 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34edc36b-dbce-4e96-b1a5-b24c77aff812 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:41:42.827999 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34edc36b-dbce-4e96-b1a5-b24c77aff812 service nova] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:41:42.846056 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 712/1419] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:41:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:41:43.742236 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8402df-82f9-45e6-b386-12943c6c150c None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:43.742813 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8402df-82f9-45e6-b386-12943c6c150c None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:43.742813 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8402df-82f9-45e6-b386-12943c6c150c None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:43.744181 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 708/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 02:41:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:41:43.749337 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f211c4a-ddd6-4b32-b5d4-9ce678c6dc4f None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:43.762449 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f211c4a-ddd6-4b32-b5d4-9ce678c6dc4f None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:43.762449 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f211c4a-ddd6-4b32-b5d4-9ce678c6dc4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:43.804186 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:43.825346 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-6f211c4a-ddd6-4b32-b5d4-9ce678c6dc4f None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:41:43.826559 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-6f211c4a-ddd6-4b32-b5d4-9ce678c6dc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:43.931627 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 713/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 02:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:41:44.086386 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8402df-82f9-45e6-b386-12943c6c150c None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:41:44.087897 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-4c8402df-82f9-45e6-b386-12943c6c150c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:44.234657 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8402df-82f9-45e6-b386-12943c6c150c None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:41:44.246677 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:44.346901 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df448bac-76e6-4009-a105-008538b8be0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:41:44.347515 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df448bac-76e6-4009-a105-008538b8be0c service nova] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:44.347801 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df448bac-76e6-4009-a105-008538b8be0c service nova] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:44.348073 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df448bac-76e6-4009-a105-008538b8be0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:44.349705 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-df448bac-76e6-4009-a105-008538b8be0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:44.437046 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df448bac-76e6-4009-a105-008538b8be0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:41:44.438636 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df448bac-76e6-4009-a105-008538b8be0c service nova] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:41:44.456607 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 709/1422] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:41:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:41:45.330628 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40679ca6-0c2a-4b5e-9f8a-aa842d5d2e71 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:45.331145 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40679ca6-0c2a-4b5e-9f8a-aa842d5d2e71 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:45.331259 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40679ca6-0c2a-4b5e-9f8a-aa842d5d2e71 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:45.332558 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 714/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 02:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:41:45.338074 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f59a9c-3221-4af6-a357-ae3d9b02dcfb None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:45.338486 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f59a9c-3221-4af6-a357-ae3d9b02dcfb None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:45.338620 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f59a9c-3221-4af6-a357-ae3d9b02dcfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:45.358091 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:45.412870 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-23f59a9c-3221-4af6-a357-ae3d9b02dcfb None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:41:45.414068 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-23f59a9c-3221-4af6-a357-ae3d9b02dcfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:45.509294 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 710/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 02:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:41:45.659684 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40679ca6-0c2a-4b5e-9f8a-aa842d5d2e71 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:41:45.661125 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-40679ca6-0c2a-4b5e-9f8a-aa842d5d2e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:45.902283 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:45.939574 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40679ca6-0c2a-4b5e-9f8a-aa842d5d2e71 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:41:46.054913 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4a96d-433e-438a-9a6f-b7f66ef9713a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:41:46.055565 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4a96d-433e-438a-9a6f-b7f66ef9713a service nova] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:46.055841 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4a96d-433e-438a-9a6f-b7f66ef9713a service nova] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:46.056111 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4a96d-433e-438a-9a6f-b7f66ef9713a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:46.057745 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-79b4a96d-433e-438a-9a6f-b7f66ef9713a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:46.138030 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:46.153743 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b4a96d-433e-438a-9a6f-b7f66ef9713a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:41:46.155386 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b4a96d-433e-438a-9a6f-b7f66ef9713a service nova] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:41:46.177679 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 715/1425] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:41:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:41:47.105506 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559705e-5f42-4cdc-a7c3-9c192d1d1f3b None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:47.106058 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559705e-5f42-4cdc-a7c3-9c192d1d1f3b None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:47.106058 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559705e-5f42-4cdc-a7c3-9c192d1d1f3b None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:47.107425 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 711/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 02:41:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:41:47.112366 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0da73-fd3b-419a-b130-0b3e34a908f1 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:47.112828 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0da73-fd3b-419a-b130-0b3e34a908f1 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:47.112935 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0da73-fd3b-419a-b130-0b3e34a908f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:47.187330 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-faf0da73-fd3b-419a-b130-0b3e34a908f1 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:41:47.188478 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-faf0da73-fd3b-419a-b130-0b3e34a908f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:47.283989 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 716/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 02:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:41:47.432142 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6559705e-5f42-4cdc-a7c3-9c192d1d1f3b None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:41:47.433666 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-6559705e-5f42-4cdc-a7c3-9c192d1d1f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:47.518431 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:47.579482 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6559705e-5f42-4cdc-a7c3-9c192d1d1f3b None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:41:47.698295 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac959ab-7b80-419f-8797-38a3404ed618 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:41:47.698910 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac959ab-7b80-419f-8797-38a3404ed618 service nova] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:47.699221 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac959ab-7b80-419f-8797-38a3404ed618 service nova] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:47.699499 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac959ab-7b80-419f-8797-38a3404ed618 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:47.701130 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-aac959ab-7b80-419f-8797-38a3404ed618 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:47.749430 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:47.790651 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac959ab-7b80-419f-8797-38a3404ed618 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:41:47.792284 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac959ab-7b80-419f-8797-38a3404ed618 service nova] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:41:47.810543 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 712/1428] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:41:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:41:48.698062 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92d900-4972-45e9-8037-806c4b0c8d37 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:48.698490 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92d900-4972-45e9-8037-806c4b0c8d37 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:48.699110 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92d900-4972-45e9-8037-806c4b0c8d37 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:48.700572 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 717/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 02:41:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:41:48.705710 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451c1bf-7a26-4279-a901-5368f65e7eb5 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:48.706153 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451c1bf-7a26-4279-a901-5368f65e7eb5 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:48.706262 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451c1bf-7a26-4279-a901-5368f65e7eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:48.782127 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-0451c1bf-7a26-4279-a901-5368f65e7eb5 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:41:48.783369 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-0451c1bf-7a26-4279-a901-5368f65e7eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:48.886056 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 713/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 02:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:41:49.034380 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92d900-4972-45e9-8037-806c4b0c8d37 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:41:49.035943 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-db92d900-4972-45e9-8037-806c4b0c8d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:49.084233 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:49.178602 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92d900-4972-45e9-8037-806c4b0c8d37 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:41:49.287882 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99626220-c681-4358-a920-c5a5bb231100 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:41:49.288507 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99626220-c681-4358-a920-c5a5bb231100 service nova] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:49.288787 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99626220-c681-4358-a920-c5a5bb231100 service nova] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:49.289063 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99626220-c681-4358-a920-c5a5bb231100 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:49.290683 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-99626220-c681-4358-a920-c5a5bb231100 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:49.297544 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:49.378816 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99626220-c681-4358-a920-c5a5bb231100 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:41:49.381102 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99626220-c681-4358-a920-c5a5bb231100 service nova] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:41:49.398662 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 718/1431] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:41:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:41:50.296062 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e6b33-c9d4-433d-84b6-3f83f94c2518 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:50.296578 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e6b33-c9d4-433d-84b6-3f83f94c2518 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:50.296678 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e6b33-c9d4-433d-84b6-3f83f94c2518 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:50.298002 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 714/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 02:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:41:50.302840 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042c0df-82cf-49f5-968d-c06f547fb6e1 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:50.303272 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042c0df-82cf-49f5-968d-c06f547fb6e1 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:50.303431 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042c0df-82cf-49f5-968d-c06f547fb6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:50.377757 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-5042c0df-82cf-49f5-968d-c06f547fb6e1 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:41:50.378971 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-5042c0df-82cf-49f5-968d-c06f547fb6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:50.445380 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:50.473866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 719/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 02:41:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:41:50.625342 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e6b33-c9d4-433d-84b6-3f83f94c2518 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:41:50.626851 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-0f8e6b33-c9d4-433d-84b6-3f83f94c2518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:50.644867 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:50.771407 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e6b33-c9d4-433d-84b6-3f83f94c2518 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:41:50.858039 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:50.884211 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf52596-3ebe-47e8-9c3f-35db0ee0d7b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:41:50.885130 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf52596-3ebe-47e8-9c3f-35db0ee0d7b2 service nova] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:50.885638 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf52596-3ebe-47e8-9c3f-35db0ee0d7b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:50.886191 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf52596-3ebe-47e8-9c3f-35db0ee0d7b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:50.887908 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-daf52596-3ebe-47e8-9c3f-35db0ee0d7b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:51.104266 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf52596-3ebe-47e8-9c3f-35db0ee0d7b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:41:51.105879 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf52596-3ebe-47e8-9c3f-35db0ee0d7b2 service nova] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:41:51.124288 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 715/1434] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:41:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:41:52.040923 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f698a-3c5b-4217-aaf7-aa0d660bc512 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:52.041488 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f698a-3c5b-4217-aaf7-aa0d660bc512 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:52.041488 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f698a-3c5b-4217-aaf7-aa0d660bc512 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:52.042831 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 720/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 02:41:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:41:52.047710 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0932c-38c8-4660-9719-41a02155c519 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:52.048165 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0932c-38c8-4660-9719-41a02155c519 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:52.048273 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0932c-38c8-4660-9719-41a02155c519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:52.122127 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-aea0932c-38c8-4660-9719-41a02155c519 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:41:52.123355 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-aea0932c-38c8-4660-9719-41a02155c519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:52.162970 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:52.219821 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 716/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 02:41:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:41:52.371337 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f698a-3c5b-4217-aaf7-aa0d660bc512 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:41:52.372868 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-d91f698a-3c5b-4217-aaf7-aa0d660bc512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:52.513410 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f698a-3c5b-4217-aaf7-aa0d660bc512 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:41:52.587916 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:52.652995 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0e638-2a81-4c96-be36-10921b9a6cee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:41:52.653613 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0e638-2a81-4c96-be36-10921b9a6cee service nova] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:52.653893 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0e638-2a81-4c96-be36-10921b9a6cee service nova] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:52.654165 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0e638-2a81-4c96-be36-10921b9a6cee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:52.655817 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-17c0e638-2a81-4c96-be36-10921b9a6cee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:52.742580 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c0e638-2a81-4c96-be36-10921b9a6cee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:41:52.744233 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c0e638-2a81-4c96-be36-10921b9a6cee service nova] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:41:52.761862 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 721/1437] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:41:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:41:53.632637 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e236ff3-1a7d-4dfe-98f2-c4f2646b402a None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:53.633227 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e236ff3-1a7d-4dfe-98f2-c4f2646b402a None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:53.633227 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e236ff3-1a7d-4dfe-98f2-c4f2646b402a None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:53.634541 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 717/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 02:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:41:53.639475 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3c659-68a0-450c-b913-d4a60d3f24e3 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:53.643353 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3c659-68a0-450c-b913-d4a60d3f24e3 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:53.643353 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3c659-68a0-450c-b913-d4a60d3f24e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:53.725032 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-b7b3c659-68a0-450c-b913-d4a60d3f24e3 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:41:53.726270 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-b7b3c659-68a0-450c-b913-d4a60d3f24e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:53.728564 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:53.824316 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 722/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 02:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:41:53.976321 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e236ff3-1a7d-4dfe-98f2-c4f2646b402a None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:41:53.978090 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-4e236ff3-1a7d-4dfe-98f2-c4f2646b402a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:54.124709 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e236ff3-1a7d-4dfe-98f2-c4f2646b402a None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:41:54.151320 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:54.235406 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656b029-36af-449a-9c2f-811dae2c8a28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:41:54.236014 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656b029-36af-449a-9c2f-811dae2c8a28 service nova] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:54.236289 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656b029-36af-449a-9c2f-811dae2c8a28 service nova] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:54.236557 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656b029-36af-449a-9c2f-811dae2c8a28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:54.238160 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-f656b029-36af-449a-9c2f-811dae2c8a28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:54.356961 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f656b029-36af-449a-9c2f-811dae2c8a28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:41:54.356961 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f656b029-36af-449a-9c2f-811dae2c8a28 service nova] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:41:54.356961 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 718/1440] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:41:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:41:56.273218 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a92efb-8091-4e03-8bad-2d38001ab97a None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:56.273812 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a92efb-8091-4e03-8bad-2d38001ab97a None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:56.273812 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a92efb-8091-4e03-8bad-2d38001ab97a None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:56.275158 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 723/1441] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 02:41:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:41:56.280454 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9309e5-010a-447a-ad8e-466807149c3e None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:56.280915 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9309e5-010a-447a-ad8e-466807149c3e None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:56.281013 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9309e5-010a-447a-ad8e-466807149c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:56.320456 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:56.345126 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-bd9309e5-010a-447a-ad8e-466807149c3e None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:41:56.346306 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-bd9309e5-010a-447a-ad8e-466807149c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:56.441134 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 719/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 02:41:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:41:56.480913 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a92efb-8091-4e03-8bad-2d38001ab97a None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:41:56.482421 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-d1a92efb-8091-4e03-8bad-2d38001ab97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:56.582491 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a92efb-8091-4e03-8bad-2d38001ab97a None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:41:56.614000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:56.653973 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cffbeb5-d324-4d2f-8f51-de9e9addc282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:41:56.654589 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cffbeb5-d324-4d2f-8f51-de9e9addc282 service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:56.654870 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cffbeb5-d324-4d2f-8f51-de9e9addc282 service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:56.655172 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cffbeb5-d324-4d2f-8f51-de9e9addc282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:56.657643 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-2cffbeb5-d324-4d2f-8f51-de9e9addc282 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:56.761705 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cffbeb5-d324-4d2f-8f51-de9e9addc282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:41:56.763143 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cffbeb5-d324-4d2f-8f51-de9e9addc282 service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:41:56.780798 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 724/1443] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:41:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:41:58.939712 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc551ebd-d742-47fa-8506-c42d2a5c118c None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:58.940310 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc551ebd-d742-47fa-8506-c42d2a5c118c None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:58.940310 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc551ebd-d742-47fa-8506-c42d2a5c118c None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:58.941666 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 720/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 02:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:41:58.947536 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d06479-7529-4c91-ab19-0ef0ed910329 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:58.948127 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d06479-7529-4c91-ab19-0ef0ed910329 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:58.948127 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d06479-7529-4c91-ab19-0ef0ed910329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:59.017407 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-e7d06479-7529-4c91-ab19-0ef0ed910329 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:41:59.018623 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-e7d06479-7529-4c91-ab19-0ef0ed910329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:59.031602 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:59.114171 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 725/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 02:41:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:41:59.152159 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc551ebd-d742-47fa-8506-c42d2a5c118c None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:41:59.153705 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-fc551ebd-d742-47fa-8506-c42d2a5c118c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:59.255504 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc551ebd-d742-47fa-8506-c42d2a5c118c None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:41:59.269853 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:59.333934 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea832e-55c9-42fb-947c-be8915ff9150 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:41:59.334553 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea832e-55c9-42fb-947c-be8915ff9150 service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:41:59.334830 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea832e-55c9-42fb-947c-be8915ff9150 service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:41:59.335139 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea832e-55c9-42fb-947c-be8915ff9150 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:41:59.336763 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-6cea832e-55c9-42fb-947c-be8915ff9150 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:41:59.444475 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea832e-55c9-42fb-947c-be8915ff9150 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:41:59.445908 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea832e-55c9-42fb-947c-be8915ff9150 service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:41:59.464125 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 721/1446] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:41:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:42:01.849885 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f061316-7f26-43bc-a5ae-10126c5fce8f None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:42:01.850443 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f061316-7f26-43bc-a5ae-10126c5fce8f None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:42:01.850443 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f061316-7f26-43bc-a5ae-10126c5fce8f None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:42:01.851827 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 726/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 02:42:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:42:01.857356 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67375f-e3f3-4106-9bd4-1b8c892beb9d None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:42:01.857762 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67375f-e3f3-4106-9bd4-1b8c892beb9d None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:42:01.857902 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67375f-e3f3-4106-9bd4-1b8c892beb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:42:01.904663 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:42:01.922626 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-eb67375f-e3f3-4106-9bd4-1b8c892beb9d None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:42:01.933276 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-eb67375f-e3f3-4106-9bd4-1b8c892beb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:42:02.021678 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 722/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 02:42:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:42:02.060285 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f061316-7f26-43bc-a5ae-10126c5fce8f None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:42:02.061816 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-6f061316-7f26-43bc-a5ae-10126c5fce8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:42:02.162577 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f061316-7f26-43bc-a5ae-10126c5fce8f None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:42:02.200522 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:42:02.234553 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854b8bd-daca-46c9-95e0-92af1c8f3fab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:42:02.235189 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854b8bd-daca-46c9-95e0-92af1c8f3fab service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:42:02.235465 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854b8bd-daca-46c9-95e0-92af1c8f3fab service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:42:02.235733 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854b8bd-daca-46c9-95e0-92af1c8f3fab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:42:02.237329 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-9854b8bd-daca-46c9-95e0-92af1c8f3fab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:42:02.343184 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9854b8bd-daca-46c9-95e0-92af1c8f3fab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:42:02.344666 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9854b8bd-daca-46c9-95e0-92af1c8f3fab service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:42:02.362614 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 727/1449] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:42:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:42:04.474238 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85163a5f-c726-40db-9c30-7d8098256313 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:42:04.474804 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85163a5f-c726-40db-9c30-7d8098256313 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:42:04.474804 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85163a5f-c726-40db-9c30-7d8098256313 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:42:04.476177 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 723/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 02:42:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:42:04.481671 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8697e-bf2c-4459-8fca-6cbc8fd1f839 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:42:04.482075 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8697e-bf2c-4459-8fca-6cbc8fd1f839 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:42:04.482219 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8697e-bf2c-4459-8fca-6cbc8fd1f839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:42:04.548687 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-f1a8697e-bf2c-4459-8fca-6cbc8fd1f839 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:42:04.549836 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-f1a8697e-bf2c-4459-8fca-6cbc8fd1f839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:42:04.570600 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:42:04.644896 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 728/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 02:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:42:04.684248 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85163a5f-c726-40db-9c30-7d8098256313 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:42:04.685811 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-85163a5f-c726-40db-9c30-7d8098256313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:42:04.786112 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85163a5f-c726-40db-9c30-7d8098256313 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:42:04.806326 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:42:04.859670 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3f795-1465-466a-bd64-7c00ec1d7673 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:42:04.860282 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3f795-1465-466a-bd64-7c00ec1d7673 service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:42:04.860562 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3f795-1465-466a-bd64-7c00ec1d7673 service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:42:04.860835 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3f795-1465-466a-bd64-7c00ec1d7673 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:42:04.862443 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-5ea3f795-1465-466a-bd64-7c00ec1d7673 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:42:04.968459 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea3f795-1465-466a-bd64-7c00ec1d7673 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:42:04.969916 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea3f795-1465-466a-bd64-7c00ec1d7673 service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:42:04.988290 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 724/1452] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:42:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:42:07.064148 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445415c-991c-49a9-bdb4-cf37a003775b None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:42:07.064691 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445415c-991c-49a9-bdb4-cf37a003775b None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:42:07.064691 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445415c-991c-49a9-bdb4-cf37a003775b None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:42:07.066056 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 729/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 02:42:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:42:07.071463 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce9a8f-e372-4552-a976-38abe89406ca None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:42:07.071868 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce9a8f-e372-4552-a976-38abe89406ca None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:42:07.072061 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce9a8f-e372-4552-a976-38abe89406ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:42:07.135951 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:42:07.138508 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-e2ce9a8f-e372-4552-a976-38abe89406ca None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:42:07.139746 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-e2ce9a8f-e372-4552-a976-38abe89406ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:42:07.236036 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 725/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 02:42:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:42:07.277741 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c445415c-991c-49a9-bdb4-cf37a003775b None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:42:07.277741 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-c445415c-991c-49a9-bdb4-cf37a003775b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:42:07.389279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c445415c-991c-49a9-bdb4-cf37a003775b None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:42:07.437245 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:42:07.461670 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16665e7b-d74b-440d-9814-11bf6c71bb5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:42:07.462289 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16665e7b-d74b-440d-9814-11bf6c71bb5b service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:42:07.462568 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16665e7b-d74b-440d-9814-11bf6c71bb5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:42:07.462839 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16665e7b-d74b-440d-9814-11bf6c71bb5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:42:07.464486 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-16665e7b-d74b-440d-9814-11bf6c71bb5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:42:07.570441 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16665e7b-d74b-440d-9814-11bf6c71bb5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:42:07.571884 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16665e7b-d74b-440d-9814-11bf6c71bb5b service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:42:07.590978 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 730/1455] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:42:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:42:09.686745 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce0c03-d28d-4b9f-b14e-be48a8f29b6d None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:42:09.687440 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce0c03-d28d-4b9f-b14e-be48a8f29b6d None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:42:09.687440 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce0c03-d28d-4b9f-b14e-be48a8f29b6d None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:42:09.688591 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 726/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 02:42:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:42:09.694410 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9bf262-9041-40c1-9ca9-a4b23c8e2207 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:42:09.694856 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9bf262-9041-40c1-9ca9-a4b23c8e2207 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:42:09.694986 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9bf262-9041-40c1-9ca9-a4b23c8e2207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:42:09.764786 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-1c9bf262-9041-40c1-9ca9-a4b23c8e2207 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:42:09.766004 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-1c9bf262-9041-40c1-9ca9-a4b23c8e2207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:42:09.794788 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:42:09.861135 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 731/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 02:42:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:42:09.899345 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce0c03-d28d-4b9f-b14e-be48a8f29b6d None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:42:09.900881 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-ddce0c03-d28d-4b9f-b14e-be48a8f29b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:42:10.007918 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce0c03-d28d-4b9f-b14e-be48a8f29b6d None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:42:10.036315 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:42:10.081017 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e3ee7-e88d-4958-bb13-98b58211d549 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:42:10.081653 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e3ee7-e88d-4958-bb13-98b58211d549 service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:42:10.081957 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e3ee7-e88d-4958-bb13-98b58211d549 service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:42:10.082729 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e3ee7-e88d-4958-bb13-98b58211d549 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:42:10.084369 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-5c7e3ee7-e88d-4958-bb13-98b58211d549 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:42:10.189337 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e3ee7-e88d-4958-bb13-98b58211d549 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:42:10.190773 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e3ee7-e88d-4958-bb13-98b58211d549 service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:42:10.209147 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 727/1458] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:42:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:42:12.272754 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366852e0-6be5-4d84-8956-b82bb2ca3f9a None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:42:12.273306 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366852e0-6be5-4d84-8956-b82bb2ca3f9a None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:42:12.273306 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366852e0-6be5-4d84-8956-b82bb2ca3f9a None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:42:12.274685 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 732/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 02:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:42:12.280199 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16aad4e-d2f8-430d-bdc8-81cb0af0b8fc None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:42:12.280642 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16aad4e-d2f8-430d-bdc8-81cb0af0b8fc None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:42:12.280757 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16aad4e-d2f8-430d-bdc8-81cb0af0b8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:42:12.345815 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-e16aad4e-d2f8-430d-bdc8-81cb0af0b8fc None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:42:12.347045 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-e16aad4e-d2f8-430d-bdc8-81cb0af0b8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:42:12.355949 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:42:12.443473 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 728/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 02:42:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:42:12.482443 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366852e0-6be5-4d84-8956-b82bb2ca3f9a None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:42:12.484059 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-366852e0-6be5-4d84-8956-b82bb2ca3f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:42:12.585255 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366852e0-6be5-4d84-8956-b82bb2ca3f9a None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:42:12.638534 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:42:12.656713 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a12ca-a20b-4858-a49a-f1531da4d5f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:42:12.660972 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a12ca-a20b-4858-a49a-f1531da4d5f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:42:12.660972 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a12ca-a20b-4858-a49a-f1531da4d5f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:42:12.660972 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a12ca-a20b-4858-a49a-f1531da4d5f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:42:12.660972 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-0f4a12ca-a20b-4858-a49a-f1531da4d5f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:42:12.765689 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a12ca-a20b-4858-a49a-f1531da4d5f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:42:12.767155 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a12ca-a20b-4858-a49a-f1531da4d5f8 service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:42:12.785346 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 733/1461] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:42:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:42:14.832782 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106fc65-9e59-4f71-bf71-8d4067a912c2 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:42:14.833346 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106fc65-9e59-4f71-bf71-8d4067a912c2 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:42:14.833346 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106fc65-9e59-4f71-bf71-8d4067a912c2 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:42:14.834647 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 729/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 02:42:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:42:14.839793 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982ab04-238a-4c53-abd6-b1a71ba0fc15 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:42:14.840177 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982ab04-238a-4c53-abd6-b1a71ba0fc15 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:42:14.840346 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982ab04-238a-4c53-abd6-b1a71ba0fc15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:42:14.905194 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-1982ab04-238a-4c53-abd6-b1a71ba0fc15 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:42:14.906418 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-1982ab04-238a-4c53-abd6-b1a71ba0fc15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:42:14.944518 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:42:15.006228 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 734/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 02:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:42:15.043974 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7106fc65-9e59-4f71-bf71-8d4067a912c2 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:42:15.045548 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-7106fc65-9e59-4f71-bf71-8d4067a912c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:42:15.146650 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7106fc65-9e59-4f71-bf71-8d4067a912c2 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:42:15.183751 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:42:15.218323 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5077434-097b-4067-ba86-67c11e8492cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:42:15.218933 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5077434-097b-4067-ba86-67c11e8492cd service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:42:15.219242 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5077434-097b-4067-ba86-67c11e8492cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:42:15.219515 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5077434-097b-4067-ba86-67c11e8492cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:42:15.221112 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-d5077434-097b-4067-ba86-67c11e8492cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:42:15.330151 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5077434-097b-4067-ba86-67c11e8492cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:42:15.331631 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5077434-097b-4067-ba86-67c11e8492cd service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:42:15.350998 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 730/1464] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:42:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:42:17.371301 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98e767-0f48-414f-9a37-733f1ce763c7 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:42:17.371855 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98e767-0f48-414f-9a37-733f1ce763c7 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:42:17.371855 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98e767-0f48-414f-9a37-733f1ce763c7 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:42:17.373208 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 735/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 02:42:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:42:17.378406 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38096d34-4d37-48eb-bce5-22aa41b8c909 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:42:17.379371 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38096d34-4d37-48eb-bce5-22aa41b8c909 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:42:17.379562 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38096d34-4d37-48eb-bce5-22aa41b8c909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:42:17.444470 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-38096d34-4d37-48eb-bce5-22aa41b8c909 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:42:17.445683 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-38096d34-4d37-48eb-bce5-22aa41b8c909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:42:17.464128 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:42:17.542032 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 731/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 02:42:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:42:17.578741 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98e767-0f48-414f-9a37-733f1ce763c7 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:42:17.580344 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-9f98e767-0f48-414f-9a37-733f1ce763c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:42:17.682060 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98e767-0f48-414f-9a37-733f1ce763c7 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:42:17.751109 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:42:17.758417 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52b5bf-f758-4524-876e-5ec1c49dcd9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:42:17.759080 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52b5bf-f758-4524-876e-5ec1c49dcd9a service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:42:17.759366 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52b5bf-f758-4524-876e-5ec1c49dcd9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:42:17.759638 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52b5bf-f758-4524-876e-5ec1c49dcd9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:42:17.761260 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-8e52b5bf-f758-4524-876e-5ec1c49dcd9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:42:17.872050 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e52b5bf-f758-4524-876e-5ec1c49dcd9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:42:17.873419 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e52b5bf-f758-4524-876e-5ec1c49dcd9a service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:42:17.891542 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 736/1467] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:42:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:42:19.916763 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6ecac-b4a0-4aa5-9e4f-7851957dcc98 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:42:19.917351 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6ecac-b4a0-4aa5-9e4f-7851957dcc98 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:42:19.917446 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6ecac-b4a0-4aa5-9e4f-7851957dcc98 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:42:19.918862 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 732/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 02:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:42:19.924020 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f89a3-f8e9-4e1e-a342-26737aea1a26 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:42:19.924466 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f89a3-f8e9-4e1e-a342-26737aea1a26 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:42:19.924638 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f89a3-f8e9-4e1e-a342-26737aea1a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:42:19.990579 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-c91f89a3-f8e9-4e1e-a342-26737aea1a26 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:42:19.991824 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-c91f89a3-f8e9-4e1e-a342-26737aea1a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:42:20.040685 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:42:20.088486 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 737/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 02:42:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:42:20.125810 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f6ecac-b4a0-4aa5-9e4f-7851957dcc98 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:42:20.127377 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-11f6ecac-b4a0-4aa5-9e4f-7851957dcc98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:42:20.229128 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f6ecac-b4a0-4aa5-9e4f-7851957dcc98 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:42:20.277145 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:42:20.302611 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ca259-1f30-403e-99cd-e325493d2c75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:42:20.303339 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ca259-1f30-403e-99cd-e325493d2c75 service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:42:20.303547 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ca259-1f30-403e-99cd-e325493d2c75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:42:20.303820 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ca259-1f30-403e-99cd-e325493d2c75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:42:20.305420 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-992ca259-1f30-403e-99cd-e325493d2c75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:42:20.411612 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ca259-1f30-403e-99cd-e325493d2c75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:42:20.413049 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ca259-1f30-403e-99cd-e325493d2c75 service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:42:20.430907 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 733/1470] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:42:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:42:30.086704 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=22 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:42:30.428784 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=66 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:42:40.942266 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186d1b4-f145-4614-9650-8ecb3560daad None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:42:40.942864 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186d1b4-f145-4614-9650-8ecb3560daad None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:42:40.942864 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186d1b4-f145-4614-9650-8ecb3560daad None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:42:40.944216 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 738/1471] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:42:40.949319 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354b3f6-541b-430a-bde3-720152ac1d8b None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:42:40.949758 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354b3f6-541b-430a-bde3-720152ac1d8b None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:42:40.949900 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354b3f6-541b-430a-bde3-720152ac1d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:42:41.018098 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-3354b3f6-541b-430a-bde3-720152ac1d8b None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:42:41.019848 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-3354b3f6-541b-430a-bde3-720152ac1d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:42:41.115181 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 734/1472] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:42:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:42:41.197025 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd62e41-7a10-4c12-b01c-e2deb528be68 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:42:41.197246 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd62e41-7a10-4c12-b01c-e2deb528be68 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:42:41.197520 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd62e41-7a10-4c12-b01c-e2deb528be68 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:42:41.198851 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 739/1473] 10.222.0.42 () {54 vars in 966 bytes} [Fri Aug 5 02:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:42:41.203731 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a573fc-cf5f-4328-8d38-f231f9d6346c None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:42:41.204020 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a573fc-cf5f-4328-8d38-f231f9d6346c None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:42:41.204298 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a573fc-cf5f-4328-8d38-f231f9d6346c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:42:41.279876 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-e3a573fc-cf5f-4328-8d38-f231f9d6346c None None] MFA Rules not processed for user `116f66d7dd7b42878f71bd29dc55729c`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:42:41.281079 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-e3a573fc-cf5f-4328-8d38-f231f9d6346c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:42:41.301016 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:42:41.356331 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 735/1474] 10.222.0.42 () {58 vars in 1063 bytes} [Fri Aug 5 02:42:41 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:42:41.363761 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd62e41-7a10-4c12-b01c-e2deb528be68 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:42:41.365264 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-fbd62e41-7a10-4c12-b01c-e2deb528be68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:42:41.465022 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd62e41-7a10-4c12-b01c-e2deb528be68 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:42:41.535752 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1ae69-c027-46ac-9c67-35f1a03720fe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '116f66d7dd7b42878f71bd29dc55729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:42:41.536364 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1ae69-c027-46ac-9c67-35f1a03720fe service glance] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:42:41.536640 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1ae69-c027-46ac-9c67-35f1a03720fe service glance] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:42:41.536910 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1ae69-c027-46ac-9c67-35f1a03720fe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:42:41.538494 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-07c1ae69-c027-46ac-9c67-35f1a03720fe service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:42:41.591168 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:42:41.645211 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c1ae69-c027-46ac-9c67-35f1a03720fe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:42:41.646638 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c1ae69-c027-46ac-9c67-35f1a03720fe service glance] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:42:41.665039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 740/1475] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:42:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:42:43.731798 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc39ac-ac5f-4c6f-bea2-1d57f73ce8f6 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:42:43.732359 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc39ac-ac5f-4c6f-bea2-1d57f73ce8f6 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:42:43.732359 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc39ac-ac5f-4c6f-bea2-1d57f73ce8f6 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:42:43.733694 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 736/1476] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:42:43.739398 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519edbe2-acf9-438f-ad89-3e1880ab05aa None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:42:43.739854 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519edbe2-acf9-438f-ad89-3e1880ab05aa None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:42:43.739995 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519edbe2-acf9-438f-ad89-3e1880ab05aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:42:43.804874 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-519edbe2-acf9-438f-ad89-3e1880ab05aa None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:42:43.806088 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-519edbe2-acf9-438f-ad89-3e1880ab05aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:42:43.901795 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 741/1477] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:42:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:42:43.925409 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc39ac-ac5f-4c6f-bea2-1d57f73ce8f6 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:42:43.926937 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-fabc39ac-ac5f-4c6f-bea2-1d57f73ce8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:42:44.050409 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc39ac-ac5f-4c6f-bea2-1d57f73ce8f6 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:42:44.098689 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:42:44.145280 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd4fe33-e98e-4153-9532-0579a8e5e6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:42:44.145908 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4fe33-e98e-4153-9532-0579a8e5e6a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:42:44.146190 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4fe33-e98e-4153-9532-0579a8e5e6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:42:44.146464 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4fe33-e98e-4153-9532-0579a8e5e6a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:42:44.147185 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd4fe33-e98e-4153-9532-0579a8e5e6a2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:42:44.148935 dv-cinder-815582-13-smb devstack@keystone.service[80823]: WARNING py.warnings [None req-3fd4fe33-e98e-4153-9532-0579a8e5e6a2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 02:42:44.148935 dv-cinder-815582-13-smb devstack@keystone.service[80823]: warnings.warn(msg) Aug 05 02:42:44.148935 dv-cinder-815582-13-smb devstack@keystone.service[80823]: Aug 05 02:42:44.150075 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd4fe33-e98e-4153-9532-0579a8e5e6a2 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:42:44.169014 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 737/1478] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 5 02:42:43 2022] GET /identity/v3/projects => generated 2553 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:42:46.231969 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a866c4-5a47-44e6-9e3e-f059cc25cb6c None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:42:46.232546 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a866c4-5a47-44e6-9e3e-f059cc25cb6c None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:42:46.232546 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a866c4-5a47-44e6-9e3e-f059cc25cb6c None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:42:46.233884 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 742/1479] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:42:46.239692 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303d109-469a-413e-a649-3e0e578182de None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:42:46.240170 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303d109-469a-413e-a649-3e0e578182de None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:42:46.240276 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303d109-469a-413e-a649-3e0e578182de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:42:46.305347 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-4303d109-469a-413e-a649-3e0e578182de None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:42:46.306565 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-4303d109-469a-413e-a649-3e0e578182de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:42:46.408989 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 738/1480] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:42:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:42:46.452026 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a866c4-5a47-44e6-9e3e-f059cc25cb6c None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:42:46.453570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-76a866c4-5a47-44e6-9e3e-f059cc25cb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:42:46.463385 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:42:46.595565 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a866c4-5a47-44e6-9e3e-f059cc25cb6c None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:42:46.673094 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:42:46.705544 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1537fa1c-5a5e-4baa-8c41-cee79ac9f4a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:42:46.706167 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537fa1c-5a5e-4baa-8c41-cee79ac9f4a2 service nova] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:42:46.706452 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537fa1c-5a5e-4baa-8c41-cee79ac9f4a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:42:46.706728 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537fa1c-5a5e-4baa-8c41-cee79ac9f4a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:42:46.708418 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-1537fa1c-5a5e-4baa-8c41-cee79ac9f4a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:42:46.796172 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1537fa1c-5a5e-4baa-8c41-cee79ac9f4a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:42:46.797792 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1537fa1c-5a5e-4baa-8c41-cee79ac9f4a2 service nova] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:42:46.816239 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 743/1481] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:42:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:42:49.053219 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d34071-4177-43a9-9d17-81d261cddfd3 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:42:49.053847 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d34071-4177-43a9-9d17-81d261cddfd3 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:42:49.053847 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d34071-4177-43a9-9d17-81d261cddfd3 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:42:49.055117 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 739/1482] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:42:49.060269 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b87e4d-0f10-47b9-80aa-1d087f6fac08 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:42:49.060714 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b87e4d-0f10-47b9-80aa-1d087f6fac08 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:42:49.060820 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b87e4d-0f10-47b9-80aa-1d087f6fac08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:42:49.125103 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-e7b87e4d-0f10-47b9-80aa-1d087f6fac08 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:42:49.126305 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-e7b87e4d-0f10-47b9-80aa-1d087f6fac08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:42:49.170334 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:42:49.219311 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 744/1483] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:42:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:42:49.256348 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d34071-4177-43a9-9d17-81d261cddfd3 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:42:49.257883 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-e2d34071-4177-43a9-9d17-81d261cddfd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:42:49.280994 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:42:49.361091 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d34071-4177-43a9-9d17-81d261cddfd3 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:42:49.435047 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f65118-7f9e-4a8c-8a5f-78791bcae2c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:42:49.435582 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f65118-7f9e-4a8c-8a5f-78791bcae2c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:42:49.435861 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f65118-7f9e-4a8c-8a5f-78791bcae2c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:42:49.436127 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f65118-7f9e-4a8c-8a5f-78791bcae2c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:42:49.437735 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-e7f65118-7f9e-4a8c-8a5f-78791bcae2c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:42:49.513284 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:42:49.547560 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f65118-7f9e-4a8c-8a5f-78791bcae2c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:42:49.549096 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f65118-7f9e-4a8c-8a5f-78791bcae2c2 service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:42:49.567456 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 740/1484] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:42:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:42:51.614033 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57954370-8e0a-461b-9a50-71a7a61ba09b None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:42:51.614566 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57954370-8e0a-461b-9a50-71a7a61ba09b None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:42:51.614566 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57954370-8e0a-461b-9a50-71a7a61ba09b None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:42:51.615907 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 745/1485] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:42:51.621057 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b41976-5138-451f-9369-515222f1075a None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:42:51.621484 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b41976-5138-451f-9369-515222f1075a None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:42:51.621596 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b41976-5138-451f-9369-515222f1075a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:42:51.685921 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-31b41976-5138-451f-9369-515222f1075a None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:42:51.687137 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-31b41976-5138-451f-9369-515222f1075a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:42:51.781584 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 741/1486] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:42:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:42:51.819657 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57954370-8e0a-461b-9a50-71a7a61ba09b None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:42:51.821190 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-57954370-8e0a-461b-9a50-71a7a61ba09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:42:51.921883 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57954370-8e0a-461b-9a50-71a7a61ba09b None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:42:51.994812 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:42:51.996575 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50507011-b492-4f45-a764-3197c8b3e845 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:42:52.006652 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50507011-b492-4f45-a764-3197c8b3e845 service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:42:52.006652 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50507011-b492-4f45-a764-3197c8b3e845 service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:42:52.006652 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50507011-b492-4f45-a764-3197c8b3e845 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:42:52.006652 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-50507011-b492-4f45-a764-3197c8b3e845 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:42:52.105670 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50507011-b492-4f45-a764-3197c8b3e845 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:42:52.107123 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50507011-b492-4f45-a764-3197c8b3e845 service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:42:52.124812 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 746/1487] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:42:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:42:54.196074 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9160eb-cbf7-445a-a639-d238b9fdc2e8 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:42:54.196629 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9160eb-cbf7-445a-a639-d238b9fdc2e8 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:42:54.196629 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9160eb-cbf7-445a-a639-d238b9fdc2e8 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:42:54.197891 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 742/1488] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:42:54.203007 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c68d7-921f-4d6f-b3c2-f2f71d35f7f1 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:42:54.203408 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c68d7-921f-4d6f-b3c2-f2f71d35f7f1 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:42:54.203565 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c68d7-921f-4d6f-b3c2-f2f71d35f7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:42:54.269119 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-c21c68d7-921f-4d6f-b3c2-f2f71d35f7f1 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:42:54.270311 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-c21c68d7-921f-4d6f-b3c2-f2f71d35f7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:42:54.321831 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:42:54.365689 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 747/1489] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:42:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:42:54.405321 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9160eb-cbf7-445a-a639-d238b9fdc2e8 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:42:54.406859 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-fd9160eb-cbf7-445a-a639-d238b9fdc2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:42:54.444603 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:42:54.527337 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9160eb-cbf7-445a-a639-d238b9fdc2e8 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:42:54.602662 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d4201-558d-46e7-a92d-dd2212c4d8dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:42:54.603305 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d4201-558d-46e7-a92d-dd2212c4d8dd service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:42:54.603589 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d4201-558d-46e7-a92d-dd2212c4d8dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:42:54.603861 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d4201-558d-46e7-a92d-dd2212c4d8dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:42:54.605475 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-d11d4201-558d-46e7-a92d-dd2212c4d8dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:42:54.682735 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:42:54.710666 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d4201-558d-46e7-a92d-dd2212c4d8dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:42:54.712130 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d4201-558d-46e7-a92d-dd2212c4d8dd service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:42:54.730535 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 743/1490] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:42:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:42:57.096004 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca265d42-b47f-4971-ba31-e14d5c0deed6 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:42:57.096592 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca265d42-b47f-4971-ba31-e14d5c0deed6 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:42:57.096592 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca265d42-b47f-4971-ba31-e14d5c0deed6 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:42:57.097920 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 748/1491] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 5 02:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:42:57.103316 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51496757-cf8d-45c0-a718-509474fb0a4b None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:42:57.103764 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51496757-cf8d-45c0-a718-509474fb0a4b None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:42:57.103871 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51496757-cf8d-45c0-a718-509474fb0a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:42:57.168835 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-51496757-cf8d-45c0-a718-509474fb0a4b None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:42:57.170062 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-51496757-cf8d-45c0-a718-509474fb0a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:42:57.264533 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 744/1492] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 5 02:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:42:57.303698 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca265d42-b47f-4971-ba31-e14d5c0deed6 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:42:57.307294 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-ca265d42-b47f-4971-ba31-e14d5c0deed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:42:57.405794 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca265d42-b47f-4971-ba31-e14d5c0deed6 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:42:57.475420 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff70d0-26b2-4b97-ba04-a805ba9c4f0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:42:57.476042 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff70d0-26b2-4b97-ba04-a805ba9c4f0d service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:42:57.476325 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff70d0-26b2-4b97-ba04-a805ba9c4f0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:42:57.476858 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff70d0-26b2-4b97-ba04-a805ba9c4f0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:42:57.478494 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-d5ff70d0-26b2-4b97-ba04-a805ba9c4f0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:42:57.488006 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:42:57.585886 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ff70d0-26b2-4b97-ba04-a805ba9c4f0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:42:57.587357 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ff70d0-26b2-4b97-ba04-a805ba9c4f0d service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:42:57.605012 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 749/1493] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:42:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:43:07.262773 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=82 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:43:07.602752 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=50 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:44:16.257588 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9c708-fdd6-40b4-aee3-701cfd99666c None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:44:16.258189 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9c708-fdd6-40b4-aee3-701cfd99666c None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:44:16.258189 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9c708-fdd6-40b4-aee3-701cfd99666c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:44:16.333987 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-7ef9c708-fdd6-40b4-aee3-701cfd99666c None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:44:16.335232 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-7ef9c708-fdd6-40b4-aee3-701cfd99666c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:44:16.430157 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 745/1494] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:44:16.438878 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a712c-98e7-4ab0-82c5-fb1fc544753b None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:44:16.439401 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a712c-98e7-4ab0-82c5-fb1fc544753b None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:44:16.439519 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a712c-98e7-4ab0-82c5-fb1fc544753b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:44:16.514263 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-0d5a712c-98e7-4ab0-82c5-fb1fc544753b None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:44:16.515401 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-0d5a712c-98e7-4ab0-82c5-fb1fc544753b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:44:16.613797 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 750/1495] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:44:16.618485 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9c708-fdd6-40b4-aee3-701cfd99666c None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:44:16.619723 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-7ef9c708-fdd6-40b4-aee3-701cfd99666c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:44:16.631059 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9c708-fdd6-40b4-aee3-701cfd99666c None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:44:16.690580 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:44:16.723359 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeeb77f-2497-4fec-a225-b6c404608f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:44:16.723973 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeeb77f-2497-4fec-a225-b6c404608f35 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:44:16.724253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeeb77f-2497-4fec-a225-b6c404608f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:44:16.724575 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeeb77f-2497-4fec-a225-b6c404608f35 admin admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:44:16.725515 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeeb77f-2497-4fec-a225-b6c404608f35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:44:16.725818 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeeb77f-2497-4fec-a225-b6c404608f35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:44:16.726826 dv-cinder-815582-13-smb devstack@keystone.service[80823]: WARNING py.warnings [None req-bdeeb77f-2497-4fec-a225-b6c404608f35 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 02:44:16.726826 dv-cinder-815582-13-smb devstack@keystone.service[80823]: warnings.warn(msg) Aug 05 02:44:16.726826 dv-cinder-815582-13-smb devstack@keystone.service[80823]: Aug 05 02:44:16.727807 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeeb77f-2497-4fec-a225-b6c404608f35 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:44:16.739770 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 746/1496] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:44:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:44:16.748075 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a712c-98e7-4ab0-82c5-fb1fc544753b None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:44:16.757261 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a712c-98e7-4ab0-82c5-fb1fc544753b None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:44:16.817185 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:44:16.851434 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7d932-20b4-46e7-bb3f-96120c5d82bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:44:16.852051 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7d932-20b4-46e7-bb3f-96120c5d82bb admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:44:16.852331 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7d932-20b4-46e7-bb3f-96120c5d82bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:44:16.852605 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7d932-20b4-46e7-bb3f-96120c5d82bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:44:16.853271 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c7d932-20b4-46e7-bb3f-96120c5d82bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:44:16.855027 dv-cinder-815582-13-smb devstack@keystone.service[80822]: WARNING py.warnings [None req-34c7d932-20b4-46e7-bb3f-96120c5d82bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 02:44:16.855027 dv-cinder-815582-13-smb devstack@keystone.service[80822]: warnings.warn(msg) Aug 05 02:44:16.855027 dv-cinder-815582-13-smb devstack@keystone.service[80822]: Aug 05 02:44:16.856231 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c7d932-20b4-46e7-bb3f-96120c5d82bb admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:44:16.982654 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 751/1497] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:44:16 2022] POST /identity/v3/projects => generated 377 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:44:16.987044 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeeb77f-2497-4fec-a225-b6c404608f35 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:44:16.988604 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-bdeeb77f-2497-4fec-a225-b6c404608f35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:44:17.021230 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeeb77f-2497-4fec-a225-b6c404608f35 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:44:17.113919 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d450ad-a85d-49aa-ab37-aaee86e02009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:44:17.114462 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d450ad-a85d-49aa-ab37-aaee86e02009 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:44:17.114743 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d450ad-a85d-49aa-ab37-aaee86e02009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:44:17.115051 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d450ad-a85d-49aa-ab37-aaee86e02009 admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:44:17.115741 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d450ad-a85d-49aa-ab37-aaee86e02009 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:44:17.116764 dv-cinder-815582-13-smb devstack@keystone.service[80823]: WARNING py.warnings [None req-39d450ad-a85d-49aa-ab37-aaee86e02009 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 02:44:17.116764 dv-cinder-815582-13-smb devstack@keystone.service[80823]: warnings.warn(msg) Aug 05 02:44:17.116764 dv-cinder-815582-13-smb devstack@keystone.service[80823]: Aug 05 02:44:17.117988 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d450ad-a85d-49aa-ab37-aaee86e02009 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:44:17.208654 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 747/1498] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:44:16 2022] POST /identity/v3/users => generated 289 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:44:17.212883 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7d932-20b4-46e7-bb3f-96120c5d82bb admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:44:17.214471 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-34c7d932-20b4-46e7-bb3f-96120c5d82bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:44:17.294921 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7d932-20b4-46e7-bb3f-96120c5d82bb admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:44:17.390480 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:44:17.400449 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4d391-e261-4230-9815-fee79fe43c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:44:17.401081 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4d391-e261-4230-9815-fee79fe43c09 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:44:17.401358 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4d391-e261-4230-9815-fee79fe43c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:44:17.401633 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4d391-e261-4230-9815-fee79fe43c09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:44:17.402332 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd4d391-e261-4230-9815-fee79fe43c09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:44:17.403374 dv-cinder-815582-13-smb devstack@keystone.service[80822]: WARNING py.warnings [None req-5cd4d391-e261-4230-9815-fee79fe43c09 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 02:44:17.403374 dv-cinder-815582-13-smb devstack@keystone.service[80822]: warnings.warn(msg) Aug 05 02:44:17.403374 dv-cinder-815582-13-smb devstack@keystone.service[80822]: Aug 05 02:44:17.413039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd4d391-e261-4230-9815-fee79fe43c09 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:44:17.416413 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 752/1499] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:44:17.420817 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d450ad-a85d-49aa-ab37-aaee86e02009 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:44:17.422364 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-39d450ad-a85d-49aa-ab37-aaee86e02009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:44:17.433933 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d450ad-a85d-49aa-ab37-aaee86e02009 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:44:17.459238 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:44:17.527891 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfeb7dd-68da-4150-9bf6-599a86646f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:44:17.528506 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfeb7dd-68da-4150-9bf6-599a86646f85 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:44:17.528784 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfeb7dd-68da-4150-9bf6-599a86646f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:44:17.529055 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfeb7dd-68da-4150-9bf6-599a86646f85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:44:17.529773 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfeb7dd-68da-4150-9bf6-599a86646f85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:44:17.530800 dv-cinder-815582-13-smb devstack@keystone.service[80823]: WARNING py.warnings [None req-adfeb7dd-68da-4150-9bf6-599a86646f85 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 02:44:17.530800 dv-cinder-815582-13-smb devstack@keystone.service[80823]: warnings.warn(msg) Aug 05 02:44:17.530800 dv-cinder-815582-13-smb devstack@keystone.service[80823]: Aug 05 02:44:17.531718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfeb7dd-68da-4150-9bf6-599a86646f85 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:44:17.544342 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 748/1500] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:44:17.548565 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4d391-e261-4230-9815-fee79fe43c09 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:44:17.550076 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-5cd4d391-e261-4230-9815-fee79fe43c09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:44:17.584327 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4d391-e261-4230-9815-fee79fe43c09 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:44:17.693757 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c6691-407e-42c1-bfba-4a34dc051ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:44:17.694339 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c6691-407e-42c1-bfba-4a34dc051ea4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:44:17.694616 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c6691-407e-42c1-bfba-4a34dc051ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:44:17.694889 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c6691-407e-42c1-bfba-4a34dc051ea4 admin admin] PATH_INFO: `/v3/projects/4a1115a0f55a465ebc0a39535d6c1804/users/f4f0a910331e4f3491fce1059453710f/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:44:17.715993 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c6691-407e-42c1-bfba-4a34dc051ea4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a1115a0f55a465ebc0a39535d6c1804, user_id=f4f0a910331e4f3491fce1059453710f, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:44:17.717054 dv-cinder-815582-13-smb devstack@keystone.service[80822]: WARNING py.warnings [None req-900c6691-407e-42c1-bfba-4a34dc051ea4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 02:44:17.717054 dv-cinder-815582-13-smb devstack@keystone.service[80822]: warnings.warn(msg) Aug 05 02:44:17.717054 dv-cinder-815582-13-smb devstack@keystone.service[80822]: Aug 05 02:44:17.719002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c6691-407e-42c1-bfba-4a34dc051ea4 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:44:17.797559 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 753/1501] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:44:17 2022] PUT /identity/v3/projects/4a1115a0f55a465ebc0a39535d6c1804/users/f4f0a910331e4f3491fce1059453710f/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:44:17.809847 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86129e-96fb-4d9e-869c-72627f08fc44 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:44:17.814469 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86129e-96fb-4d9e-869c-72627f08fc44 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:44:17.814469 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86129e-96fb-4d9e-869c-72627f08fc44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:44:17.867094 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-8f86129e-96fb-4d9e-869c-72627f08fc44 None None] MFA Rules not processed for user `f4f0a910331e4f3491fce1059453710f`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:44:17.868293 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-8f86129e-96fb-4d9e-869c-72627f08fc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:44:17.945028 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 749/1502] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:44:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:44:17.959871 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835152e5-e6a5-44e1-995d-e36f7675249a None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:44:17.960163 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835152e5-e6a5-44e1-995d-e36f7675249a None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:44:17.960443 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835152e5-e6a5-44e1-995d-e36f7675249a None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:44:17.961842 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 754/1503] 10.222.0.42 () {54 vars in 964 bytes} [Fri Aug 5 02:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:44:17.967413 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f9ba3-9bb2-4463-8631-1fddb4390e69 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:44:17.967713 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f9ba3-9bb2-4463-8631-1fddb4390e69 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:44:17.967994 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f9ba3-9bb2-4463-8631-1fddb4390e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:44:17.999296 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:44:18.042920 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-151f9ba3-9bb2-4463-8631-1fddb4390e69 None None] MFA Rules not processed for user `e60a3568771842e294858e5868068f84`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:44:18.044177 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-151f9ba3-9bb2-4463-8631-1fddb4390e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:44:18.119150 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 750/1504] 10.222.0.42 () {58 vars in 1061 bytes} [Fri Aug 5 02:44:17 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:44:18.127245 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835152e5-e6a5-44e1-995d-e36f7675249a None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:44:18.128751 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-835152e5-e6a5-44e1-995d-e36f7675249a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:44:18.177744 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:44:18.230814 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835152e5-e6a5-44e1-995d-e36f7675249a None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:44:18.329143 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c308ea7-f370-425a-912a-218d821366e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:44:18.329768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c308ea7-f370-425a-912a-218d821366e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:44:18.330054 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c308ea7-f370-425a-912a-218d821366e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:44:18.330332 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c308ea7-f370-425a-912a-218d821366e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:44:18.332014 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-5c308ea7-f370-425a-912a-218d821366e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:44:18.431853 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c308ea7-f370-425a-912a-218d821366e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:44:18.433293 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c308ea7-f370-425a-912a-218d821366e3 service cinder] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:44:18.437388 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:44:18.451280 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 755/1505] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:44:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:44:18.496187 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5fe87-4a09-4a70-afa0-9c84a0b45ba3 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:44:18.496593 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5fe87-4a09-4a70-afa0-9c84a0b45ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:44:18.496749 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5fe87-4a09-4a70-afa0-9c84a0b45ba3 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:44:18.498638 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 751/1506] 10.222.0.42 () {52 vars in 830 bytes} [Fri Aug 5 02:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:44:18.502270 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c308ea7-f370-425a-912a-218d821366e3 service cinder] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:44:18.503509 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-5c308ea7-f370-425a-912a-218d821366e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:44:18.607589 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c308ea7-f370-425a-912a-218d821366e3 service cinder] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:44:18.701114 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67740a6e-fa7b-4207-b771-44cfcf373724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:44:18.701759 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67740a6e-fa7b-4207-b771-44cfcf373724 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:44:18.702044 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67740a6e-fa7b-4207-b771-44cfcf373724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:44:18.702320 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67740a6e-fa7b-4207-b771-44cfcf373724 admin admin] PATH_INFO: `/v3/users/f4f0a910331e4f3491fce1059453710f` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:44:18.714676 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67740a6e-fa7b-4207-b771-44cfcf373724 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4f0a910331e4f3491fce1059453710f)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:44:18.715740 dv-cinder-815582-13-smb devstack@keystone.service[80822]: WARNING py.warnings [None req-67740a6e-fa7b-4207-b771-44cfcf373724 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 02:44:18.715740 dv-cinder-815582-13-smb devstack@keystone.service[80822]: warnings.warn(msg) Aug 05 02:44:18.715740 dv-cinder-815582-13-smb devstack@keystone.service[80822]: Aug 05 02:44:18.716993 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67740a6e-fa7b-4207-b771-44cfcf373724 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:44:18.727276 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:44:18.937023 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-67740a6e-fa7b-4207-b771-44cfcf373724 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4f0a910331e4f3491fce1059453710f'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:44:19.022498 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-67740a6e-fa7b-4207-b771-44cfcf373724 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4f0a910331e4f3491fce1059453710f'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:44:19.036862 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-67740a6e-fa7b-4207-b771-44cfcf373724 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4f0a910331e4f3491fce1059453710f'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:44:19.059376 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-67740a6e-fa7b-4207-b771-44cfcf373724 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4f0a910331e4f3491fce1059453710f'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:44:19.059914 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-67740a6e-fa7b-4207-b771-44cfcf373724 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4f0a910331e4f3491fce1059453710f'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:44:19.065391 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 756/1507] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:44:18 2022] DELETE /identity/v3/users/f4f0a910331e4f3491fce1059453710f => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:44:19.069769 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf5327-bdc8-4b3f-a7f7-25b8d789126c None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:44:19.070061 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf5327-bdc8-4b3f-a7f7-25b8d789126c None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:44:19.070339 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf5327-bdc8-4b3f-a7f7-25b8d789126c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:44:19.126794 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-cdbf5327-bdc8-4b3f-a7f7-25b8d789126c None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:44:19.128093 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-cdbf5327-bdc8-4b3f-a7f7-25b8d789126c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:44:19.202101 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:44:19.214381 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 752/1508] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:44:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:44:19.224590 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67740a6e-fa7b-4207-b771-44cfcf373724 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:44:19.226085 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-67740a6e-fa7b-4207-b771-44cfcf373724 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:44:19.381484 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67740a6e-fa7b-4207-b771-44cfcf373724 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:44:19.436022 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:44:19.455435 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a233d-67bb-493c-86be-93fe46fdf376 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:44:19.455996 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a233d-67bb-493c-86be-93fe46fdf376 service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:44:19.456278 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a233d-67bb-493c-86be-93fe46fdf376 service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:44:19.456548 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a233d-67bb-493c-86be-93fe46fdf376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:44:19.458147 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-729a233d-67bb-493c-86be-93fe46fdf376 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:44:19.565260 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a233d-67bb-493c-86be-93fe46fdf376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:44:19.566744 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a233d-67bb-493c-86be-93fe46fdf376 service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:44:19.585132 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 757/1509] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:44:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:44:20.022041 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf5327-bdc8-4b3f-a7f7-25b8d789126c None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:44:20.023327 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-cdbf5327-bdc8-4b3f-a7f7-25b8d789126c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:44:20.034888 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf5327-bdc8-4b3f-a7f7-25b8d789126c None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:44:20.130729 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dce789-b751-4d34-8afd-e9401b39c73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:44:20.131401 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dce789-b751-4d34-8afd-e9401b39c73b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:44:20.131681 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dce789-b751-4d34-8afd-e9401b39c73b admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:44:20.131951 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dce789-b751-4d34-8afd-e9401b39c73b admin admin] PATH_INFO: `/v3/projects/4a1115a0f55a465ebc0a39535d6c1804` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:44:20.141624 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dce789-b751-4d34-8afd-e9401b39c73b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a1115a0f55a465ebc0a39535d6c1804)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:44:20.142684 dv-cinder-815582-13-smb devstack@keystone.service[80823]: WARNING py.warnings [None req-50dce789-b751-4d34-8afd-e9401b39c73b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 02:44:20.142684 dv-cinder-815582-13-smb devstack@keystone.service[80823]: warnings.warn(msg) Aug 05 02:44:20.142684 dv-cinder-815582-13-smb devstack@keystone.service[80823]: Aug 05 02:44:20.143909 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dce789-b751-4d34-8afd-e9401b39c73b admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:44:20.257827 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-50dce789-b751-4d34-8afd-e9401b39c73b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a1115a0f55a465ebc0a39535d6c1804', 'request_id': 'req-50dce789-b751-4d34-8afd-e9401b39c73b'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:44:20.360602 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-50dce789-b751-4d34-8afd-e9401b39c73b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a1115a0f55a465ebc0a39535d6c1804', 'request_id': 'req-50dce789-b751-4d34-8afd-e9401b39c73b'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:44:20.367355 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-50dce789-b751-4d34-8afd-e9401b39c73b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a1115a0f55a465ebc0a39535d6c1804', 'request_id': 'req-50dce789-b751-4d34-8afd-e9401b39c73b'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:44:20.396472 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-50dce789-b751-4d34-8afd-e9401b39c73b admin admin] The token cache is being invalidate because project 4a1115a0f55a465ebc0a39535d6c1804 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:44:20.396758 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-50dce789-b751-4d34-8afd-e9401b39c73b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:44:20.397277 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-50dce789-b751-4d34-8afd-e9401b39c73b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:44:20.398640 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 753/1510] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:44:20 2022] DELETE /identity/v3/projects/4a1115a0f55a465ebc0a39535d6c1804 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:44:29.582845 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=62 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:44:30.394549 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:45:52.775785 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2ad6c-ff75-4977-9536-21699f1c4773 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:45:52.776380 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2ad6c-ff75-4977-9536-21699f1c4773 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:45:52.776380 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2ad6c-ff75-4977-9536-21699f1c4773 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:45:52.777853 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 758/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 02:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:45:52.782661 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986dc22-e7b2-480b-8767-787013bd7d97 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:45:52.783089 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986dc22-e7b2-480b-8767-787013bd7d97 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:45:52.783253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986dc22-e7b2-480b-8767-787013bd7d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:45:52.868001 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-5986dc22-e7b2-480b-8767-787013bd7d97 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:45:52.869218 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-5986dc22-e7b2-480b-8767-787013bd7d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:45:52.976012 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 754/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 02:45:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:45:53.131321 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2ad6c-ff75-4977-9536-21699f1c4773 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:45:53.133512 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-16a2ad6c-ff75-4977-9536-21699f1c4773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:45:53.252969 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2ad6c-ff75-4977-9536-21699f1c4773 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:45:53.258405 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f55620-300e-4555-8f6f-48bd6df4de29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:45:53.259066 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f55620-300e-4555-8f6f-48bd6df4de29 service nova] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:45:53.259353 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f55620-300e-4555-8f6f-48bd6df4de29 service nova] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:45:53.259629 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f55620-300e-4555-8f6f-48bd6df4de29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:45:53.267595 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f55620-300e-4555-8f6f-48bd6df4de29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:45:53.269189 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f55620-300e-4555-8f6f-48bd6df4de29 service nova] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:45:53.279907 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 759/1513] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:45:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:45:54.108337 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e650097-c3d6-4ca5-838d-8f4515924d08 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:45:54.108899 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e650097-c3d6-4ca5-838d-8f4515924d08 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:45:54.108899 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e650097-c3d6-4ca5-838d-8f4515924d08 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:45:54.110238 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 755/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 02:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:45:54.115203 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f9b0f-6614-4e1f-bc9e-04be6e915e9d None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:45:54.115633 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f9b0f-6614-4e1f-bc9e-04be6e915e9d None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:45:54.115769 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f9b0f-6614-4e1f-bc9e-04be6e915e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:45:54.134804 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-0b6f9b0f-6614-4e1f-bc9e-04be6e915e9d None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:45:54.136035 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-0b6f9b0f-6614-4e1f-bc9e-04be6e915e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:45:54.143870 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 760/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 02:45:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:45:54.292329 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e650097-c3d6-4ca5-838d-8f4515924d08 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:45:54.306409 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e650097-c3d6-4ca5-838d-8f4515924d08 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:45:54.311702 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f75e9e-e8e6-4813-8275-464f45abcdc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:45:54.312298 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f75e9e-e8e6-4813-8275-464f45abcdc7 service nova] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:45:54.312577 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f75e9e-e8e6-4813-8275-464f45abcdc7 service nova] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:45:54.312847 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f75e9e-e8e6-4813-8275-464f45abcdc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:45:54.320752 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f75e9e-e8e6-4813-8275-464f45abcdc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:45:54.322322 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f75e9e-e8e6-4813-8275-464f45abcdc7 service nova] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:45:54.332025 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 756/1516] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:45:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:45:54.809477 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974e00b-1cbd-41dc-a203-1d2b87896a51 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:45:54.809765 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974e00b-1cbd-41dc-a203-1d2b87896a51 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:45:54.810037 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974e00b-1cbd-41dc-a203-1d2b87896a51 None None] PATH_INFO: `/v3` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:45:54.811399 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 761/1517] 10.222.0.44 () {54 vars in 925 bytes} [Fri Aug 5 02:45:54 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:45:54.817633 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27372786-f885-4071-b02d-51e1fd67e9ac None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:45:54.817924 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27372786-f885-4071-b02d-51e1fd67e9ac None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:45:54.818203 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27372786-f885-4071-b02d-51e1fd67e9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:45:54.880100 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-27372786-f885-4071-b02d-51e1fd67e9ac None None] MFA Rules not processed for user `8b647f2cb18a41d6a9e124e886faa994`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:45:54.881320 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-27372786-f885-4071-b02d-51e1fd67e9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:45:54.898493 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:45:54.954086 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 757/1518] 10.222.0.44 () {58 vars in 1015 bytes} [Fri Aug 5 02:45:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:45:58.933847 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce84f0c-9965-49fb-bd49-60c53e12633a None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:45:58.934373 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce84f0c-9965-49fb-bd49-60c53e12633a None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:45:58.934373 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce84f0c-9965-49fb-bd49-60c53e12633a None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:45:58.935715 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 762/1519] 10.222.0.42 () {54 vars in 961 bytes} [Fri Aug 5 02:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:45:58.940646 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97fbde-8abf-4287-976a-9caad25f1d4c None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:45:58.941036 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97fbde-8abf-4287-976a-9caad25f1d4c None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:45:58.941193 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97fbde-8abf-4287-976a-9caad25f1d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:45:58.960099 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-cf97fbde-8abf-4287-976a-9caad25f1d4c None None] MFA Rules not processed for user `8b647f2cb18a41d6a9e124e886faa994`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:45:58.961355 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-cf97fbde-8abf-4287-976a-9caad25f1d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:45:58.969661 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 758/1520] 10.222.0.42 () {58 vars in 1058 bytes} [Fri Aug 5 02:45:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:45:58.977110 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce84f0c-9965-49fb-bd49-60c53e12633a None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:45:58.995098 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce84f0c-9965-49fb-bd49-60c53e12633a None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:45:59.001161 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c790132-0202-4e85-a47f-b4064f39b8f2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647f2cb18a41d6a9e124e886faa994', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:45:59.001775 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c790132-0202-4e85-a47f-b4064f39b8f2 service placement] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:45:59.002055 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c790132-0202-4e85-a47f-b4064f39b8f2 service placement] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:45:59.002327 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c790132-0202-4e85-a47f-b4064f39b8f2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:45:59.010554 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c790132-0202-4e85-a47f-b4064f39b8f2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:45:59.012156 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c790132-0202-4e85-a47f-b4064f39b8f2 service placement] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:45:59.021840 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 763/1521] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:45:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:46:05.563833 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226e221-03a9-4b35-ba09-f892a972e9b7 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:46:05.564691 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226e221-03a9-4b35-ba09-f892a972e9b7 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:46:05.564691 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226e221-03a9-4b35-ba09-f892a972e9b7 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:46:05.565776 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 759/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 02:46:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:46:05.570701 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f9fb0-11bf-4af0-a584-8e65762be978 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:46:05.571182 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f9fb0-11bf-4af0-a584-8e65762be978 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:46:05.571282 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f9fb0-11bf-4af0-a584-8e65762be978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:46:05.595501 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-0f5f9fb0-11bf-4af0-a584-8e65762be978 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:46:05.596694 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-0f5f9fb0-11bf-4af0-a584-8e65762be978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:46:05.605116 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 764/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 02:46:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:46:05.755986 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6226e221-03a9-4b35-ba09-f892a972e9b7 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:46:05.770562 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6226e221-03a9-4b35-ba09-f892a972e9b7 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:46:05.776447 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c03412f-4b80-4652-bcce-6aa290ed51b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:46:05.777038 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03412f-4b80-4652-bcce-6aa290ed51b7 service nova] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:46:05.777314 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03412f-4b80-4652-bcce-6aa290ed51b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:46:05.777590 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03412f-4b80-4652-bcce-6aa290ed51b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:46:05.785458 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c03412f-4b80-4652-bcce-6aa290ed51b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:46:05.787064 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c03412f-4b80-4652-bcce-6aa290ed51b7 service nova] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:46:05.796275 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 760/1524] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:46:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:46:06.606732 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b23293-6dc9-41d4-906d-968ec67d006f None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:46:06.607282 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b23293-6dc9-41d4-906d-968ec67d006f None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:46:06.607282 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b23293-6dc9-41d4-906d-968ec67d006f None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:46:06.608623 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 765/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 02:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:46:06.613297 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa4198-f7d3-48db-8e44-69b06b6e6509 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:46:06.613716 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa4198-f7d3-48db-8e44-69b06b6e6509 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:46:06.613857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa4198-f7d3-48db-8e44-69b06b6e6509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:46:06.633066 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-f6aa4198-f7d3-48db-8e44-69b06b6e6509 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:46:06.634238 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-f6aa4198-f7d3-48db-8e44-69b06b6e6509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:46:06.641903 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 761/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 02:46:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:46:06.790758 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b23293-6dc9-41d4-906d-968ec67d006f None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:46:06.805498 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b23293-6dc9-41d4-906d-968ec67d006f None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:46:06.810935 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816d23e-6715-4fbe-a35b-dfb8ce5e200a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:46:06.811567 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816d23e-6715-4fbe-a35b-dfb8ce5e200a service nova] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:46:06.811852 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816d23e-6715-4fbe-a35b-dfb8ce5e200a service nova] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:46:06.812129 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816d23e-6715-4fbe-a35b-dfb8ce5e200a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:46:06.820116 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816d23e-6715-4fbe-a35b-dfb8ce5e200a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:46:06.821698 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816d23e-6715-4fbe-a35b-dfb8ce5e200a service nova] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:46:06.830932 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 766/1527] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:46:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:46:10.761684 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba34516-14df-43e9-b472-841aab413030 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:46:10.762238 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba34516-14df-43e9-b472-841aab413030 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:46:10.762238 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba34516-14df-43e9-b472-841aab413030 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:46:10.763616 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 762/1528] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 02:46:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:46:10.768666 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0b228-d147-4e1b-a334-1cfa90aae372 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:46:10.769099 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0b228-d147-4e1b-a334-1cfa90aae372 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:46:10.769228 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0b228-d147-4e1b-a334-1cfa90aae372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:46:10.788067 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-24c0b228-d147-4e1b-a334-1cfa90aae372 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:46:10.789262 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-24c0b228-d147-4e1b-a334-1cfa90aae372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:46:10.797536 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 767/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 02:46:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:46:10.870268 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba34516-14df-43e9-b472-841aab413030 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:46:10.871987 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-8ba34516-14df-43e9-b472-841aab413030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:46:10.949718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba34516-14df-43e9-b472-841aab413030 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:46:10.953252 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f912c6-1348-49d5-a8c7-57b896aeb49a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:46:10.953857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f912c6-1348-49d5-a8c7-57b896aeb49a service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:46:10.954136 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f912c6-1348-49d5-a8c7-57b896aeb49a service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:46:10.954420 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f912c6-1348-49d5-a8c7-57b896aeb49a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:46:10.963630 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f912c6-1348-49d5-a8c7-57b896aeb49a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:46:10.965070 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f912c6-1348-49d5-a8c7-57b896aeb49a service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:46:10.974480 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 763/1530] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:46:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:46:12.945754 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6bf2e-4335-490e-97be-4fb98aa4a9b4 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:46:12.946330 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6bf2e-4335-490e-97be-4fb98aa4a9b4 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:46:12.946330 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6bf2e-4335-490e-97be-4fb98aa4a9b4 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:46:12.948315 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 768/1531] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 02:46:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:46:12.953366 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6aadc-db55-4d2f-82d4-153ee97eb52f None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:46:12.953806 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6aadc-db55-4d2f-82d4-153ee97eb52f None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:46:12.953949 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6aadc-db55-4d2f-82d4-153ee97eb52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:46:12.973205 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-64b6aadc-db55-4d2f-82d4-153ee97eb52f None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:46:12.974395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-64b6aadc-db55-4d2f-82d4-153ee97eb52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:46:12.982167 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 764/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 02:46:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:46:13.018765 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b6bf2e-4335-490e-97be-4fb98aa4a9b4 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:46:13.029172 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b6bf2e-4335-490e-97be-4fb98aa4a9b4 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:46:13.032590 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c6711-1ef4-4385-8644-31ea26fda3be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:46:13.033189 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c6711-1ef4-4385-8644-31ea26fda3be service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:46:13.033468 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c6711-1ef4-4385-8644-31ea26fda3be service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:46:13.033744 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c6711-1ef4-4385-8644-31ea26fda3be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:46:13.042924 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c6711-1ef4-4385-8644-31ea26fda3be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:46:13.044369 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c6711-1ef4-4385-8644-31ea26fda3be service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:46:13.053455 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 769/1533] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:46:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:46:16.544627 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859550e-b167-492f-b508-240caa664d22 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:46:16.545134 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859550e-b167-492f-b508-240caa664d22 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:46:16.545134 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859550e-b167-492f-b508-240caa664d22 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:46:16.546511 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 765/1534] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 02:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:46:16.551545 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc2288-ec60-456d-95b2-776c21d635d7 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:46:16.551930 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc2288-ec60-456d-95b2-776c21d635d7 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:46:16.552098 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc2288-ec60-456d-95b2-776c21d635d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:46:16.570904 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-0bdc2288-ec60-456d-95b2-776c21d635d7 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:46:16.572181 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-0bdc2288-ec60-456d-95b2-776c21d635d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:46:16.579777 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 770/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 02:46:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:46:16.881919 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3859550e-b167-492f-b508-240caa664d22 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:46:16.883622 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-3859550e-b167-492f-b508-240caa664d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:46:16.953151 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:46:16.966589 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3859550e-b167-492f-b508-240caa664d22 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:46:16.970462 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d82ab7-51ac-4c98-bc87-16144ee3e884 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:46:16.971116 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d82ab7-51ac-4c98-bc87-16144ee3e884 service cinder] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:46:16.971400 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d82ab7-51ac-4c98-bc87-16144ee3e884 service cinder] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:46:16.971741 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d82ab7-51ac-4c98-bc87-16144ee3e884 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:46:16.980799 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d82ab7-51ac-4c98-bc87-16144ee3e884 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:46:16.982229 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d82ab7-51ac-4c98-bc87-16144ee3e884 service cinder] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:46:16.991837 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 766/1536] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:46:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:46:19.014707 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76f729-3236-49a2-a621-e07591047070 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:46:19.015297 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76f729-3236-49a2-a621-e07591047070 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:46:19.015297 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76f729-3236-49a2-a621-e07591047070 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:46:19.016652 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 771/1537] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 02:46:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:46:19.021802 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302d5df-c6c8-4af4-b5a2-393bdf9d825e None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:46:19.022199 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302d5df-c6c8-4af4-b5a2-393bdf9d825e None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:46:19.022367 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302d5df-c6c8-4af4-b5a2-393bdf9d825e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:46:19.042068 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-0302d5df-c6c8-4af4-b5a2-393bdf9d825e None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:46:19.043294 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-0302d5df-c6c8-4af4-b5a2-393bdf9d825e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:46:19.051098 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 767/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 02:46:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:46:19.355206 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc76f729-3236-49a2-a621-e07591047070 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:46:19.356856 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-cc76f729-3236-49a2-a621-e07591047070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:46:19.369614 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc76f729-3236-49a2-a621-e07591047070 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:46:19.373127 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8402c8-b512-4aed-aa56-52e35a59f64c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:46:19.373736 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8402c8-b512-4aed-aa56-52e35a59f64c service cinder] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:46:19.374019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8402c8-b512-4aed-aa56-52e35a59f64c service cinder] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:46:19.374296 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8402c8-b512-4aed-aa56-52e35a59f64c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:46:19.383234 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8402c8-b512-4aed-aa56-52e35a59f64c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:46:19.385203 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8402c8-b512-4aed-aa56-52e35a59f64c service cinder] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:46:19.394532 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 772/1539] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:46:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:46:29.037368 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=11 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:46:29.390385 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=89 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:47:44.255966 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7392b-2239-44ea-8287-9ac340aaad8e None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:44.262562 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7392b-2239-44ea-8287-9ac340aaad8e None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:44.262562 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7392b-2239-44ea-8287-9ac340aaad8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:44.292655 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-78d7392b-2239-44ea-8287-9ac340aaad8e None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:47:44.294801 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-78d7392b-2239-44ea-8287-9ac340aaad8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:44.308298 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 768/1540] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:47:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:47:44.317759 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce54a5-2bd7-4c0f-9338-977200cc30a7 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:44.318330 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce54a5-2bd7-4c0f-9338-977200cc30a7 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:44.318330 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce54a5-2bd7-4c0f-9338-977200cc30a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:44.344948 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-d1ce54a5-2bd7-4c0f-9338-977200cc30a7 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:47:44.346161 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-d1ce54a5-2bd7-4c0f-9338-977200cc30a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:44.364771 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 773/1541] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:47:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:47:44.369350 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7392b-2239-44ea-8287-9ac340aaad8e None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:44.383888 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7392b-2239-44ea-8287-9ac340aaad8e None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:44.391739 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c0782-9aab-4070-8eea-179df0d23232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:44.392740 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c0782-9aab-4070-8eea-179df0d23232 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:44.393247 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c0782-9aab-4070-8eea-179df0d23232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:44.393723 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c0782-9aab-4070-8eea-179df0d23232 admin admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:44.394669 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c0782-9aab-4070-8eea-179df0d23232 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:47:44.395217 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c0782-9aab-4070-8eea-179df0d23232 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:44.397037 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c0782-9aab-4070-8eea-179df0d23232 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:44.414275 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 769/1542] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:47:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:47:44.421977 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ce54a5-2bd7-4c0f-9338-977200cc30a7 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:44.432065 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ce54a5-2bd7-4c0f-9338-977200cc30a7 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:44.447636 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799dc0b-51ef-4781-971f-c51236f0ef1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:44.448284 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799dc0b-51ef-4781-971f-c51236f0ef1e admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:44.448574 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799dc0b-51ef-4781-971f-c51236f0ef1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:44.448856 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799dc0b-51ef-4781-971f-c51236f0ef1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:44.449547 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a799dc0b-51ef-4781-971f-c51236f0ef1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:44.451508 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a799dc0b-51ef-4781-971f-c51236f0ef1e admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:44.559493 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 774/1543] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:47:44 2022] POST /identity/v3/projects => generated 365 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:47:44.563433 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c0782-9aab-4070-8eea-179df0d23232 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:44.576433 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c0782-9aab-4070-8eea-179df0d23232 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:44.646056 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006a448-f7c8-462f-a8c5-bdcf91c9de7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:44.647148 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006a448-f7c8-462f-a8c5-bdcf91c9de7a admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:44.647655 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006a448-f7c8-462f-a8c5-bdcf91c9de7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:44.648156 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006a448-f7c8-462f-a8c5-bdcf91c9de7a admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:44.649182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0006a448-f7c8-462f-a8c5-bdcf91c9de7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:44.651357 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0006a448-f7c8-462f-a8c5-bdcf91c9de7a admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:44.759178 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 770/1544] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:47:44 2022] POST /identity/v3/users => generated 283 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:47:44.762679 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799dc0b-51ef-4781-971f-c51236f0ef1e admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:44.774160 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799dc0b-51ef-4781-971f-c51236f0ef1e admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:44.785548 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec90b29-970d-4210-966e-251de24a8e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:44.786214 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec90b29-970d-4210-966e-251de24a8e20 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:44.786498 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec90b29-970d-4210-966e-251de24a8e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:44.786782 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec90b29-970d-4210-966e-251de24a8e20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:44.787559 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec90b29-970d-4210-966e-251de24a8e20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:44.789319 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec90b29-970d-4210-966e-251de24a8e20 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:44.806286 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 775/1545] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:47:44.810492 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006a448-f7c8-462f-a8c5-bdcf91c9de7a admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:44.827109 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006a448-f7c8-462f-a8c5-bdcf91c9de7a admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:44.832878 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102fd3ae-1519-497c-a532-977954ff931b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:44.833823 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102fd3ae-1519-497c-a532-977954ff931b admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:44.834329 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102fd3ae-1519-497c-a532-977954ff931b admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:44.834821 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102fd3ae-1519-497c-a532-977954ff931b admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:44.835762 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102fd3ae-1519-497c-a532-977954ff931b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:44.839153 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102fd3ae-1519-497c-a532-977954ff931b admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:44.854872 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 771/1546] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:47:44.859321 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec90b29-970d-4210-966e-251de24a8e20 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:44.873084 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec90b29-970d-4210-966e-251de24a8e20 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:44.883210 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4236f-4e79-41b0-91f3-2e5921f80f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:44.886996 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4236f-4e79-41b0-91f3-2e5921f80f58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:44.886996 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4236f-4e79-41b0-91f3-2e5921f80f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:44.886996 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4236f-4e79-41b0-91f3-2e5921f80f58 admin admin] PATH_INFO: `/v3/projects/c4913037c23444d28083bb194194defa/users/fb3ecf9eea4c4d2b95ef47f0db1ce60f/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:44.911301 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a4236f-4e79-41b0-91f3-2e5921f80f58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4913037c23444d28083bb194194defa, user_id=fb3ecf9eea4c4d2b95ef47f0db1ce60f, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:44.915551 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a4236f-4e79-41b0-91f3-2e5921f80f58 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:44.997527 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 776/1547] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:47:44 2022] PUT /identity/v3/projects/c4913037c23444d28083bb194194defa/users/fb3ecf9eea4c4d2b95ef47f0db1ce60f/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:47:45.010622 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84ec7b-457f-418c-be7a-f0f4f609d64b None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:45.011411 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84ec7b-457f-418c-be7a-f0f4f609d64b None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:45.011982 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84ec7b-457f-418c-be7a-f0f4f609d64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:45.058113 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-9f84ec7b-457f-418c-be7a-f0f4f609d64b None None] MFA Rules not processed for user `fb3ecf9eea4c4d2b95ef47f0db1ce60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:47:45.060140 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-9f84ec7b-457f-418c-be7a-f0f4f609d64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:45.113119 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791caac7-79c0-4285-bed3-483692d75b54 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:45.113338 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791caac7-79c0-4285-bed3-483692d75b54 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:45.113588 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791caac7-79c0-4285-bed3-483692d75b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:45.153215 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-791caac7-79c0-4285-bed3-483692d75b54 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:47:45.153469 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-791caac7-79c0-4285-bed3-483692d75b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:45.169966 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 772/1548] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:47:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:47:45.171960 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ef4f3-a119-4d97-bcf3-6691f8d85e40 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:45.172495 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ef4f3-a119-4d97-bcf3-6691f8d85e40 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:45.173108 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ef4f3-a119-4d97-bcf3-6691f8d85e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:45.208278 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-360ef4f3-a119-4d97-bcf3-6691f8d85e40 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:47:45.209895 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-360ef4f3-a119-4d97-bcf3-6691f8d85e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:45.281893 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:47:45.298169 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 777/1549] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:47:45.299694 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23326bc5-af57-4ad9-a7bc-43c897604412 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:45.300057 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 773/1550] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:47:45.300317 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23326bc5-af57-4ad9-a7bc-43c897604412 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:45.300544 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23326bc5-af57-4ad9-a7bc-43c897604412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:45.301632 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ef4f3-a119-4d97-bcf3-6691f8d85e40 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:45.314236 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ef4f3-a119-4d97-bcf3-6691f8d85e40 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:45.327373 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf010e87-b05d-44bc-bc3d-882ce73e060d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:45.332427 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf010e87-b05d-44bc-bc3d-882ce73e060d admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:45.332427 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf010e87-b05d-44bc-bc3d-882ce73e060d admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:45.332427 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf010e87-b05d-44bc-bc3d-882ce73e060d admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:45.332427 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf010e87-b05d-44bc-bc3d-882ce73e060d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:45.332427 dv-cinder-815582-13-smb devstack@keystone.service[80823]: WARNING py.warnings [None req-cf010e87-b05d-44bc-bc3d-882ce73e060d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 02:47:45.332427 dv-cinder-815582-13-smb devstack@keystone.service[80823]: warnings.warn(msg) Aug 05 02:47:45.332427 dv-cinder-815582-13-smb devstack@keystone.service[80823]: Aug 05 02:47:45.333909 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf010e87-b05d-44bc-bc3d-882ce73e060d admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:45.361842 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-23326bc5-af57-4ad9-a7bc-43c897604412 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:47:45.363291 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-23326bc5-af57-4ad9-a7bc-43c897604412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:45.376377 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 778/1551] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:47:45.379176 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1f78a-103a-46ee-a20e-2e554b5a09b1 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:45.382399 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1f78a-103a-46ee-a20e-2e554b5a09b1 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:45.382399 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1f78a-103a-46ee-a20e-2e554b5a09b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:45.402467 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-b5c1f78a-103a-46ee-a20e-2e554b5a09b1 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:47:45.403766 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-b5c1f78a-103a-46ee-a20e-2e554b5a09b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:45.412172 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 779/1552] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:47:45.413382 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512e42b-2199-48ed-a6f7-ea30c62762f2 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:45.413665 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512e42b-2199-48ed-a6f7-ea30c62762f2 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:45.413938 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512e42b-2199-48ed-a6f7-ea30c62762f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:45.433386 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-7512e42b-2199-48ed-a6f7-ea30c62762f2 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:47:45.434573 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-7512e42b-2199-48ed-a6f7-ea30c62762f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:45.443054 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 780/1553] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:47:45.444208 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84dead1-8d12-4180-9492-3f34f6f31960 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:45.444496 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84dead1-8d12-4180-9492-3f34f6f31960 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:45.444776 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84dead1-8d12-4180-9492-3f34f6f31960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:45.455856 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 774/1554] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:47:45 2022] POST /identity/v3/projects => generated 365 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:47:45.457771 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373620c-5891-4867-ba97-d6a43ccd66ac None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:45.458057 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373620c-5891-4867-ba97-d6a43ccd66ac None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:45.458777 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373620c-5891-4867-ba97-d6a43ccd66ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:45.464154 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-c84dead1-8d12-4180-9492-3f34f6f31960 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:47:45.465344 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-c84dead1-8d12-4180-9492-3f34f6f31960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:45.478009 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-1373620c-5891-4867-ba97-d6a43ccd66ac None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:47:45.479209 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-1373620c-5891-4867-ba97-d6a43ccd66ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:45.527823 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 781/1555] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:47:45.529106 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a4532-c516-4276-ba67-97afde54d61a None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:45.529399 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a4532-c516-4276-ba67-97afde54d61a None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:45.529677 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a4532-c516-4276-ba67-97afde54d61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:45.550018 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 775/1556] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:47:45.551456 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1068ec2-8fa2-4994-9c1f-27986f7a8ca9 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:45.551789 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-8a2a4532-c516-4276-ba67-97afde54d61a None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:47:45.551914 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1068ec2-8fa2-4994-9c1f-27986f7a8ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:45.552180 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1068ec2-8fa2-4994-9c1f-27986f7a8ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:45.555382 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-8a2a4532-c516-4276-ba67-97afde54d61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:45.563686 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 782/1557] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:47:45.568086 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c273a42-f50e-4658-a02d-1bc799c4d1fd None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:45.568086 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c273a42-f50e-4658-a02d-1bc799c4d1fd None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:45.568086 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c273a42-f50e-4658-a02d-1bc799c4d1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:45.573375 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:47:45.574733 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-a1068ec2-8fa2-4994-9c1f-27986f7a8ca9 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:47:45.575984 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-a1068ec2-8fa2-4994-9c1f-27986f7a8ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:45.584484 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 776/1558] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:47:45.585308 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1068ec2-8fa2-4994-9c1f-27986f7a8ca9 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:45.585627 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-4c273a42-f50e-4658-a02d-1bc799c4d1fd None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:47:45.586829 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-4c273a42-f50e-4658-a02d-1bc799c4d1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:45.595505 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 783/1559] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:47:45.596282 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c273a42-f50e-4658-a02d-1bc799c4d1fd None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:45.601582 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1068ec2-8fa2-4994-9c1f-27986f7a8ca9 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:45.606555 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401fd920-9b1f-47cb-873a-a92d329d8fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:45.607327 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401fd920-9b1f-47cb-873a-a92d329d8fdc admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:45.607608 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401fd920-9b1f-47cb-873a-a92d329d8fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:45.607878 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401fd920-9b1f-47cb-873a-a92d329d8fdc admin admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:45.607986 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c273a42-f50e-4658-a02d-1bc799c4d1fd None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:45.608572 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401fd920-9b1f-47cb-873a-a92d329d8fdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:47:45.608947 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401fd920-9b1f-47cb-873a-a92d329d8fdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:45.610634 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401fd920-9b1f-47cb-873a-a92d329d8fdc admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:45.612872 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4d436d-0c77-4b5b-8c25-ee8bb8b833bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:45.617809 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d436d-0c77-4b5b-8c25-ee8bb8b833bc admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:45.617809 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d436d-0c77-4b5b-8c25-ee8bb8b833bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:45.617809 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d436d-0c77-4b5b-8c25-ee8bb8b833bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:45.617809 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4d436d-0c77-4b5b-8c25-ee8bb8b833bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:47:45.617809 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4d436d-0c77-4b5b-8c25-ee8bb8b833bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:45.618326 dv-cinder-815582-13-smb devstack@keystone.service[80822]: WARNING py.warnings [None req-7d4d436d-0c77-4b5b-8c25-ee8bb8b833bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 02:47:45.618326 dv-cinder-815582-13-smb devstack@keystone.service[80822]: warnings.warn(msg) Aug 05 02:47:45.618326 dv-cinder-815582-13-smb devstack@keystone.service[80822]: Aug 05 02:47:45.618326 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4d436d-0c77-4b5b-8c25-ee8bb8b833bc admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:45.623588 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 777/1560] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:47:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:47:45.624360 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401fd920-9b1f-47cb-873a-a92d329d8fdc admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:45.634447 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 784/1561] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:47:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:47:45.635911 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c10f0-58a4-42f1-8e94-86cd5fb1b32c None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:45.636201 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c10f0-58a4-42f1-8e94-86cd5fb1b32c None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:45.636480 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c10f0-58a4-42f1-8e94-86cd5fb1b32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:45.636608 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401fd920-9b1f-47cb-873a-a92d329d8fdc admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:45.641423 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e602cef-5f27-4682-b7b9-c1274a6f2bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:45.642007 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e602cef-5f27-4682-b7b9-c1274a6f2bef admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:45.642288 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e602cef-5f27-4682-b7b9-c1274a6f2bef admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:45.642566 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e602cef-5f27-4682-b7b9-c1274a6f2bef admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:45.643894 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e602cef-5f27-4682-b7b9-c1274a6f2bef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:45.646397 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e602cef-5f27-4682-b7b9-c1274a6f2bef admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:45.656507 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-c66c10f0-58a4-42f1-8e94-86cd5fb1b32c None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:47:45.657692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-c66c10f0-58a4-42f1-8e94-86cd5fb1b32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:45.665550 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 785/1562] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:47:45.668349 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00edaa56-4d8d-435d-a919-f9f59167c92e None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:45.668635 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00edaa56-4d8d-435d-a919-f9f59167c92e None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:45.668911 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00edaa56-4d8d-435d-a919-f9f59167c92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:45.687918 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-00edaa56-4d8d-435d-a919-f9f59167c92e None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:47:45.689097 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-00edaa56-4d8d-435d-a919-f9f59167c92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:45.698093 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 786/1563] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:47:45.698283 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00edaa56-4d8d-435d-a919-f9f59167c92e None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:45.707642 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00edaa56-4d8d-435d-a919-f9f59167c92e None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:45.712359 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de323e-8792-4483-8065-560594d52052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:45.712940 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de323e-8792-4483-8065-560594d52052 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:45.713222 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de323e-8792-4483-8065-560594d52052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:45.713498 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de323e-8792-4483-8065-560594d52052 admin admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:45.714209 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7de323e-8792-4483-8065-560594d52052 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:47:45.714581 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7de323e-8792-4483-8065-560594d52052 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:45.716209 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7de323e-8792-4483-8065-560594d52052 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:45.727843 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 787/1564] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:47:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:47:45.732080 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4abad-b5e5-45c3-a1eb-dca9e1bd6a78 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:45.732080 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4abad-b5e5-45c3-a1eb-dca9e1bd6a78 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:45.732080 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4abad-b5e5-45c3-a1eb-dca9e1bd6a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:45.748094 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-06a4abad-b5e5-45c3-a1eb-dca9e1bd6a78 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:47:45.749271 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-06a4abad-b5e5-45c3-a1eb-dca9e1bd6a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:45.757286 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 778/1565] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:47:45 2022] POST /identity/v3/users => generated 289 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:47:45.768930 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 788/1566] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:47:45.768930 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4abad-b5e5-45c3-a1eb-dca9e1bd6a78 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:45.769156 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f6d5e-cd57-4296-b6dd-847818a6b370 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:45.769156 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f6d5e-cd57-4296-b6dd-847818a6b370 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:45.769156 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f6d5e-cd57-4296-b6dd-847818a6b370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:45.769431 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4abad-b5e5-45c3-a1eb-dca9e1bd6a78 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:45.773054 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb4439f-ece9-4d70-bc92-11e61099f27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:45.773672 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4439f-ece9-4d70-bc92-11e61099f27f admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:45.773979 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4439f-ece9-4d70-bc92-11e61099f27f admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:45.774252 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4439f-ece9-4d70-bc92-11e61099f27f admin admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:45.774912 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb4439f-ece9-4d70-bc92-11e61099f27f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:45.777299 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb4439f-ece9-4d70-bc92-11e61099f27f admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:45.781881 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-ec3f6d5e-cd57-4296-b6dd-847818a6b370 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:47:45.783230 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-ec3f6d5e-cd57-4296-b6dd-847818a6b370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:45.791647 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 779/1567] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:47:45.792475 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f6d5e-cd57-4296-b6dd-847818a6b370 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:45.802695 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f6d5e-cd57-4296-b6dd-847818a6b370 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:45.807190 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2937a45-e6da-4666-bed0-be604e90d2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:45.807784 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2937a45-e6da-4666-bed0-be604e90d2eb admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:45.808059 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2937a45-e6da-4666-bed0-be604e90d2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:45.808327 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2937a45-e6da-4666-bed0-be604e90d2eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:45.808969 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2937a45-e6da-4666-bed0-be604e90d2eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:45.810877 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2937a45-e6da-4666-bed0-be604e90d2eb admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:45.866625 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 789/1568] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:47:45 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:47:45.867495 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb4439f-ece9-4d70-bc92-11e61099f27f admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:45.894705 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 780/1569] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:47:45 2022] POST /identity/v3/projects => generated 369 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:47:45.895799 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2937a45-e6da-4666-bed0-be604e90d2eb admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:45.930698 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb4439f-ece9-4d70-bc92-11e61099f27f admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:45.957167 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2937a45-e6da-4666-bed0-be604e90d2eb admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:45.962308 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423f918-7de7-4af0-a9e2-df4ba1cb31d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:45.962990 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423f918-7de7-4af0-a9e2-df4ba1cb31d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:45.963270 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423f918-7de7-4af0-a9e2-df4ba1cb31d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:45.963543 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423f918-7de7-4af0-a9e2-df4ba1cb31d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:45.964220 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c423f918-7de7-4af0-a9e2-df4ba1cb31d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:47:45.964520 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c423f918-7de7-4af0-a9e2-df4ba1cb31d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:45.966138 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c423f918-7de7-4af0-a9e2-df4ba1cb31d5 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:45.968508 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:47:45.978933 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 781/1570] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:47:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:47:45.979728 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423f918-7de7-4af0-a9e2-df4ba1cb31d5 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:45.988356 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce4d2e-1f73-4da9-aa99-54bb388f443b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:45.989022 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce4d2e-1f73-4da9-aa99-54bb388f443b admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:45.989317 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce4d2e-1f73-4da9-aa99-54bb388f443b admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:45.989585 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce4d2e-1f73-4da9-aa99-54bb388f443b admin admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:45.989883 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423f918-7de7-4af0-a9e2-df4ba1cb31d5 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:45.990279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bce4d2e-1f73-4da9-aa99-54bb388f443b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:47:45.990584 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bce4d2e-1f73-4da9-aa99-54bb388f443b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:45.992229 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bce4d2e-1f73-4da9-aa99-54bb388f443b admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:45.995445 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6e20f-2d0c-4f03-bcbf-cc889c37f642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:45.996046 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6e20f-2d0c-4f03-bcbf-cc889c37f642 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:45.996324 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6e20f-2d0c-4f03-bcbf-cc889c37f642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:45.996597 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6e20f-2d0c-4f03-bcbf-cc889c37f642 admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:45.997241 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6e20f-2d0c-4f03-bcbf-cc889c37f642 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:45.999183 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6e20f-2d0c-4f03-bcbf-cc889c37f642 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:46.011700 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 790/1571] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:47:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:47:46.011700 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce4d2e-1f73-4da9-aa99-54bb388f443b admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:46.014894 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce4d2e-1f73-4da9-aa99-54bb388f443b admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:46.019530 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059561b-a890-4552-8ac3-d89cb9f5f9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:46.020132 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059561b-a890-4552-8ac3-d89cb9f5f9fe admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:46.020412 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059561b-a890-4552-8ac3-d89cb9f5f9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:46.020685 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059561b-a890-4552-8ac3-d89cb9f5f9fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:46.021364 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1059561b-a890-4552-8ac3-d89cb9f5f9fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:46.022980 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1059561b-a890-4552-8ac3-d89cb9f5f9fe admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:46.034114 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 791/1572] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:47:46.035539 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059561b-a890-4552-8ac3-d89cb9f5f9fe admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:46.044836 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059561b-a890-4552-8ac3-d89cb9f5f9fe admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:46.049313 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce78d2-ea59-498e-81c6-f102c26287ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:46.049881 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce78d2-ea59-498e-81c6-f102c26287ed admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:46.050163 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce78d2-ea59-498e-81c6-f102c26287ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:46.051332 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce78d2-ea59-498e-81c6-f102c26287ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:46.052107 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ce78d2-ea59-498e-81c6-f102c26287ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:47:46.052410 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ce78d2-ea59-498e-81c6-f102c26287ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:46.053977 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ce78d2-ea59-498e-81c6-f102c26287ed admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:46.065255 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 792/1573] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:47:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:47:46.066035 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce78d2-ea59-498e-81c6-f102c26287ed admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:46.071999 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:47:46.075870 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce78d2-ea59-498e-81c6-f102c26287ed admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:46.080445 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e7ae1-79d6-4f0c-a001-7fd2b9efc520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:46.082290 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e7ae1-79d6-4f0c-a001-7fd2b9efc520 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:46.082290 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e7ae1-79d6-4f0c-a001-7fd2b9efc520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:46.082290 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e7ae1-79d6-4f0c-a001-7fd2b9efc520 admin admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:46.082572 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e7ae1-79d6-4f0c-a001-7fd2b9efc520 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:47:46.082732 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e7ae1-79d6-4f0c-a001-7fd2b9efc520 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:46.084333 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e7ae1-79d6-4f0c-a001-7fd2b9efc520 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:46.089267 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 782/1574] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:47:45 2022] POST /identity/v3/projects => generated 389 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:47:46.090122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6e20f-2d0c-4f03-bcbf-cc889c37f642 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:46.096915 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 793/1575] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:47:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:47:46.098293 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e7ae1-79d6-4f0c-a001-7fd2b9efc520 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:46.108270 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e7ae1-79d6-4f0c-a001-7fd2b9efc520 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:46.155513 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6e20f-2d0c-4f03-bcbf-cc889c37f642 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:46.160847 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c889b175-3ceb-4fe5-849f-070d2d843601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:46.162990 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889b175-3ceb-4fe5-849f-070d2d843601 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:46.162990 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889b175-3ceb-4fe5-849f-070d2d843601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:46.162990 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889b175-3ceb-4fe5-849f-070d2d843601 admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:46.162990 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c889b175-3ceb-4fe5-849f-070d2d843601 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:46.164713 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c889b175-3ceb-4fe5-849f-070d2d843601 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:46.169903 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3a7c6-a105-4c70-ab6a-ef934be5d63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:46.170530 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3a7c6-a105-4c70-ab6a-ef934be5d63a admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:46.170812 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3a7c6-a105-4c70-ab6a-ef934be5d63a admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:46.171124 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3a7c6-a105-4c70-ab6a-ef934be5d63a admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:46.171854 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f3a7c6-a105-4c70-ab6a-ef934be5d63a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:46.173508 dv-cinder-815582-13-smb devstack@keystone.service[80822]: WARNING py.warnings [None req-00f3a7c6-a105-4c70-ab6a-ef934be5d63a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 02:47:46.173508 dv-cinder-815582-13-smb devstack@keystone.service[80822]: warnings.warn(msg) Aug 05 02:47:46.173508 dv-cinder-815582-13-smb devstack@keystone.service[80822]: Aug 05 02:47:46.175184 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f3a7c6-a105-4c70-ab6a-ef934be5d63a admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:46.247242 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 783/1576] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:47:46 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:47:46.248151 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c889b175-3ceb-4fe5-849f-070d2d843601 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:46.257718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c889b175-3ceb-4fe5-849f-070d2d843601 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:46.262286 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5663de65-c275-43b2-a75f-f313c7968512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:46.262903 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5663de65-c275-43b2-a75f-f313c7968512 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:46.263226 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5663de65-c275-43b2-a75f-f313c7968512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:46.263503 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5663de65-c275-43b2-a75f-f313c7968512 admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:46.264177 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5663de65-c275-43b2-a75f-f313c7968512 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:46.266085 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5663de65-c275-43b2-a75f-f313c7968512 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:46.270986 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 794/1577] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:47:46 2022] POST /identity/v3/users => generated 285 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:47:46.271738 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3a7c6-a105-4c70-ab6a-ef934be5d63a admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:46.282878 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3a7c6-a105-4c70-ab6a-ef934be5d63a admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:46.288866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d763a73-f9e4-442c-9dfa-33d2d897b570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:46.289482 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d763a73-f9e4-442c-9dfa-33d2d897b570 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:46.289764 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d763a73-f9e4-442c-9dfa-33d2d897b570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:46.290038 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d763a73-f9e4-442c-9dfa-33d2d897b570 admin admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:46.290702 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d763a73-f9e4-442c-9dfa-33d2d897b570 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:46.292726 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d763a73-f9e4-442c-9dfa-33d2d897b570 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:46.345643 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 784/1578] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:47:46 2022] POST /identity/v3/projects => generated 391 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:47:46.346565 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5663de65-c275-43b2-a75f-f313c7968512 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:46.369077 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 795/1579] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:47:46 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:47:46.370274 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d763a73-f9e4-442c-9dfa-33d2d897b570 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:46.411221 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5663de65-c275-43b2-a75f-f313c7968512 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:46.438233 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d763a73-f9e4-442c-9dfa-33d2d897b570 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:46.442826 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d20bc-36b2-4a57-b6aa-cfe763c72510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:46.443475 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d20bc-36b2-4a57-b6aa-cfe763c72510 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:46.443757 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d20bc-36b2-4a57-b6aa-cfe763c72510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:46.444030 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d20bc-36b2-4a57-b6aa-cfe763c72510 admin admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:46.444684 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d20bc-36b2-4a57-b6aa-cfe763c72510 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:46.446590 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d20bc-36b2-4a57-b6aa-cfe763c72510 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:46.453955 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:47:46.466384 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb264bf-4336-4a2c-b197-0f3c0c8913b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:46.467112 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb264bf-4336-4a2c-b197-0f3c0c8913b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:46.467401 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb264bf-4336-4a2c-b197-0f3c0c8913b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:46.467677 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb264bf-4336-4a2c-b197-0f3c0c8913b1 admin admin] PATH_INFO: `/v3/projects/c8cfee795c3b4aad957e27752e6b79e6/users/5d7f9451f6f243ff87952a6edb37373f/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:46.482635 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb264bf-4336-4a2c-b197-0f3c0c8913b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8cfee795c3b4aad957e27752e6b79e6, user_id=5d7f9451f6f243ff87952a6edb37373f, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:46.483917 dv-cinder-815582-13-smb devstack@keystone.service[80823]: WARNING py.warnings [None req-8eb264bf-4336-4a2c-b197-0f3c0c8913b1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 02:47:46.483917 dv-cinder-815582-13-smb devstack@keystone.service[80823]: warnings.warn(msg) Aug 05 02:47:46.483917 dv-cinder-815582-13-smb devstack@keystone.service[80823]: Aug 05 02:47:46.485873 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb264bf-4336-4a2c-b197-0f3c0c8913b1 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:46.549418 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 796/1580] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:47:46 2022] POST /identity/v3/projects => generated 375 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:47:46.549418 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d20bc-36b2-4a57-b6aa-cfe763c72510 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:46.554053 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 785/1581] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:47:46 2022] PUT /identity/v3/projects/c8cfee795c3b4aad957e27752e6b79e6/users/5d7f9451f6f243ff87952a6edb37373f/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:47:46.554053 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb264bf-4336-4a2c-b197-0f3c0c8913b1 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:46.594286 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:47:46.611508 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d20bc-36b2-4a57-b6aa-cfe763c72510 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:46.613407 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb264bf-4336-4a2c-b197-0f3c0c8913b1 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:46.616351 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c399f-966d-47bb-a492-13667023bbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:46.617052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c399f-966d-47bb-a492-13667023bbbe admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:46.617376 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c399f-966d-47bb-a492-13667023bbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:46.617659 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c399f-966d-47bb-a492-13667023bbbe admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:46.618111 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91b558-6d98-4f52-b030-8b290e772406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:46.618321 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31c399f-966d-47bb-a492-13667023bbbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:46.618729 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91b558-6d98-4f52-b030-8b290e772406 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:46.619052 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91b558-6d98-4f52-b030-8b290e772406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:46.619346 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91b558-6d98-4f52-b030-8b290e772406 admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:46.620014 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f91b558-6d98-4f52-b030-8b290e772406 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:46.620286 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31c399f-966d-47bb-a492-13667023bbbe admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:46.621920 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f91b558-6d98-4f52-b030-8b290e772406 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:46.722853 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 797/1582] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:47:46 2022] POST /identity/v3/users => generated 295 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:47:46.723620 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c399f-966d-47bb-a492-13667023bbbe admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:46.727208 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 786/1583] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:47:46 2022] POST /identity/v3/projects => generated 379 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:47:46.727208 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91b558-6d98-4f52-b030-8b290e772406 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:46.736318 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c399f-966d-47bb-a492-13667023bbbe admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:46.787167 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91b558-6d98-4f52-b030-8b290e772406 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:46.791698 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ebecb-4c7d-4b5d-ae01-e1cbf1de1747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:46.791863 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3e373-c07e-436f-9dbb-9a037229c8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:46.792331 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ebecb-4c7d-4b5d-ae01-e1cbf1de1747 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:46.792460 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3e373-c07e-436f-9dbb-9a037229c8ce admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:46.792614 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3e373-c07e-436f-9dbb-9a037229c8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:46.792712 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ebecb-4c7d-4b5d-ae01-e1cbf1de1747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:46.792899 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ebecb-4c7d-4b5d-ae01-e1cbf1de1747 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:46.793123 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3e373-c07e-436f-9dbb-9a037229c8ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:46.793597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ebecb-4c7d-4b5d-ae01-e1cbf1de1747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:46.793815 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae3e373-c07e-436f-9dbb-9a037229c8ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:46.795254 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ebecb-4c7d-4b5d-ae01-e1cbf1de1747 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:46.795437 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae3e373-c07e-436f-9dbb-9a037229c8ce admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:46.805518 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 798/1584] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:47:46.805950 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 787/1585] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:47:46.806365 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ebecb-4c7d-4b5d-ae01-e1cbf1de1747 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:46.806778 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3e373-c07e-436f-9dbb-9a037229c8ce admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:46.816575 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ebecb-4c7d-4b5d-ae01-e1cbf1de1747 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:46.817197 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3e373-c07e-436f-9dbb-9a037229c8ce admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:46.821156 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d88c07-4d51-4d1a-b10e-02a275fd3bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:46.821723 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a7fa4-ecc7-49dd-b1a0-3e17677de6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:46.821852 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d88c07-4d51-4d1a-b10e-02a275fd3bff admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:46.822026 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d88c07-4d51-4d1a-b10e-02a275fd3bff admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:46.822303 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d88c07-4d51-4d1a-b10e-02a275fd3bff admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:46.822426 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a7fa4-ecc7-49dd-b1a0-3e17677de6b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:46.822610 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a7fa4-ecc7-49dd-b1a0-3e17677de6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:46.822883 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a7fa4-ecc7-49dd-b1a0-3e17677de6b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:46.823007 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d88c07-4d51-4d1a-b10e-02a275fd3bff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:46.823566 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3a7fa4-ecc7-49dd-b1a0-3e17677de6b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:46.824883 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d88c07-4d51-4d1a-b10e-02a275fd3bff admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:46.825462 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3a7fa4-ecc7-49dd-b1a0-3e17677de6b0 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:46.939362 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 788/1586] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:47:46 2022] POST /identity/v3/users => generated 287 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:47:46.940219 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a7fa4-ecc7-49dd-b1a0-3e17677de6b0 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:46.950702 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a7fa4-ecc7-49dd-b1a0-3e17677de6b0 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:46.955361 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765321a9-2c04-48f1-8779-d8d8575a619d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:46.955953 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765321a9-2c04-48f1-8779-d8d8575a619d admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:46.956296 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765321a9-2c04-48f1-8779-d8d8575a619d admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:46.957188 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765321a9-2c04-48f1-8779-d8d8575a619d admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:46.957845 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765321a9-2c04-48f1-8779-d8d8575a619d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:46.959818 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765321a9-2c04-48f1-8779-d8d8575a619d admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:46.965618 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 799/1587] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:47:46 2022] POST /identity/v3/users => generated 296 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:47:46.965618 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d88c07-4d51-4d1a-b10e-02a275fd3bff admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:46.975427 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d88c07-4d51-4d1a-b10e-02a275fd3bff admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:46.980417 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60493977-4a97-4df3-8426-8e9b78e102c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:46.981049 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60493977-4a97-4df3-8426-8e9b78e102c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:46.981333 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60493977-4a97-4df3-8426-8e9b78e102c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:46.981610 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60493977-4a97-4df3-8426-8e9b78e102c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:46.982300 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60493977-4a97-4df3-8426-8e9b78e102c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:46.983992 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60493977-4a97-4df3-8426-8e9b78e102c6 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:46.994551 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 800/1588] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:47:46.995534 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60493977-4a97-4df3-8426-8e9b78e102c6 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:47.005436 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60493977-4a97-4df3-8426-8e9b78e102c6 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:47.009998 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306ab66-61ae-4dc4-b8da-755365a7025b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:47.010597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306ab66-61ae-4dc4-b8da-755365a7025b admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:47.010881 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306ab66-61ae-4dc4-b8da-755365a7025b admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:47.011186 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306ab66-61ae-4dc4-b8da-755365a7025b admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:47.011922 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306ab66-61ae-4dc4-b8da-755365a7025b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:47.013415 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306ab66-61ae-4dc4-b8da-755365a7025b admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:47.023560 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 801/1589] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:47:47.024291 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306ab66-61ae-4dc4-b8da-755365a7025b admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:47.033299 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306ab66-61ae-4dc4-b8da-755365a7025b admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:47.036882 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 789/1590] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:47:46 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:47:47.037648 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765321a9-2c04-48f1-8779-d8d8575a619d admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:47.038003 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99ee37-6c5f-4a8e-914e-b9b6f5e9d7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:47.038581 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99ee37-6c5f-4a8e-914e-b9b6f5e9d7f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:47.038864 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99ee37-6c5f-4a8e-914e-b9b6f5e9d7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:47.039171 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99ee37-6c5f-4a8e-914e-b9b6f5e9d7f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:47.043622 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99ee37-6c5f-4a8e-914e-b9b6f5e9d7f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:47.043622 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99ee37-6c5f-4a8e-914e-b9b6f5e9d7f1 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:47.049160 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765321a9-2c04-48f1-8779-d8d8575a619d admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:47.054065 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7708677d-d7c4-41f3-81d0-bb649931e6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:47.054674 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708677d-d7c4-41f3-81d0-bb649931e6f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:47.054976 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708677d-d7c4-41f3-81d0-bb649931e6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:47.055244 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708677d-d7c4-41f3-81d0-bb649931e6f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:47.055935 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7708677d-d7c4-41f3-81d0-bb649931e6f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:47.057523 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7708677d-d7c4-41f3-81d0-bb649931e6f0 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:47.068051 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 790/1591] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:47:47.069014 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7708677d-d7c4-41f3-81d0-bb649931e6f0 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:47.078607 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7708677d-d7c4-41f3-81d0-bb649931e6f0 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:47.083861 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c055f-f0b9-471c-831c-ac59374171f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:47.084425 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c055f-f0b9-471c-831c-ac59374171f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:47.084706 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c055f-f0b9-471c-831c-ac59374171f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:47.084982 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c055f-f0b9-471c-831c-ac59374171f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:47.085645 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c055f-f0b9-471c-831c-ac59374171f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:47.087284 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c055f-f0b9-471c-831c-ac59374171f0 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:47.088568 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:47:47.097901 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 791/1592] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:47:47.099214 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c055f-f0b9-471c-831c-ac59374171f0 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:47.107919 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c055f-f0b9-471c-831c-ac59374171f0 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:47.112927 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6436a0e5-1339-48f4-86e5-74b5df5a48fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:47.116637 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436a0e5-1339-48f4-86e5-74b5df5a48fd admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:47.116637 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436a0e5-1339-48f4-86e5-74b5df5a48fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:47.116637 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436a0e5-1339-48f4-86e5-74b5df5a48fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:47.116637 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6436a0e5-1339-48f4-86e5-74b5df5a48fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:47.117157 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 802/1593] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:47:47 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:47:47.117271 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6436a0e5-1339-48f4-86e5-74b5df5a48fd admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:47.117833 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99ee37-6c5f-4a8e-914e-b9b6f5e9d7f1 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:47.127668 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99ee37-6c5f-4a8e-914e-b9b6f5e9d7f1 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:47.128977 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 792/1594] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:47:47.129899 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6436a0e5-1339-48f4-86e5-74b5df5a48fd admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:47.134042 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb809cd-e857-4f4f-9572-0c39ec46ff9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:47.134665 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb809cd-e857-4f4f-9572-0c39ec46ff9c admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:47.134973 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb809cd-e857-4f4f-9572-0c39ec46ff9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:47.135315 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb809cd-e857-4f4f-9572-0c39ec46ff9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:47.135989 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb809cd-e857-4f4f-9572-0c39ec46ff9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:47.137630 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb809cd-e857-4f4f-9572-0c39ec46ff9c admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:47.141008 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6436a0e5-1339-48f4-86e5-74b5df5a48fd admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:47.146395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699cab89-f168-47a6-9b64-c1cc5b547a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:47.147073 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699cab89-f168-47a6-9b64-c1cc5b547a1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:47.147384 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699cab89-f168-47a6-9b64-c1cc5b547a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:47.147662 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699cab89-f168-47a6-9b64-c1cc5b547a1b admin admin] PATH_INFO: `/v3/projects/c8cfee795c3b4aad957e27752e6b79e6/users/5d7f9451f6f243ff87952a6edb37373f/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:47.149144 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 803/1595] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:47:47.150041 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb809cd-e857-4f4f-9572-0c39ec46ff9c admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:47.150165 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699cab89-f168-47a6-9b64-c1cc5b547a1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8cfee795c3b4aad957e27752e6b79e6, user_id=5d7f9451f6f243ff87952a6edb37373f, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:47.153772 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699cab89-f168-47a6-9b64-c1cc5b547a1b admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:47.163636 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb809cd-e857-4f4f-9572-0c39ec46ff9c admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:47.169465 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 793/1596] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:47:47 2022] PUT /identity/v3/projects/c8cfee795c3b4aad957e27752e6b79e6/users/5d7f9451f6f243ff87952a6edb37373f/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:47:47.170431 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699cab89-f168-47a6-9b64-c1cc5b547a1b admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:47.222338 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda62757-822f-4b99-bd69-5acbe831eeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:47.222976 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda62757-822f-4b99-bd69-5acbe831eeba admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:47.223354 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda62757-822f-4b99-bd69-5acbe831eeba admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:47.223625 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda62757-822f-4b99-bd69-5acbe831eeba admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:47.224321 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda62757-822f-4b99-bd69-5acbe831eeba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:47.225985 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda62757-822f-4b99-bd69-5acbe831eeba admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:47.228205 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:47:47.236266 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 804/1597] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:47:47.236963 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699cab89-f168-47a6-9b64-c1cc5b547a1b admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:47.237158 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda62757-822f-4b99-bd69-5acbe831eeba admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:47.242116 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a9ef6-4504-4182-aca0-bdb58699e943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:47.242730 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a9ef6-4504-4182-aca0-bdb58699e943 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:47.243038 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a9ef6-4504-4182-aca0-bdb58699e943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:47.243311 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a9ef6-4504-4182-aca0-bdb58699e943 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:47.244023 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a9ef6-4504-4182-aca0-bdb58699e943 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:47.245657 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a9ef6-4504-4182-aca0-bdb58699e943 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:47.247821 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda62757-822f-4b99-bd69-5acbe831eeba admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:47.254110 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fdad40-3df6-4af6-a58b-7f7195e98eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:47.254772 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fdad40-3df6-4af6-a58b-7f7195e98eb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:47.255098 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fdad40-3df6-4af6-a58b-7f7195e98eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:47.264051 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fdad40-3df6-4af6-a58b-7f7195e98eb6 admin admin] PATH_INFO: `/v3/projects/34dbbdccba1b4f89824b22726aceeae2/users/a00fb99fe42045278bd415683b36a0d6/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:47.264178 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 794/1598] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:47:47.264178 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a9ef6-4504-4182-aca0-bdb58699e943 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:47.269833 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a9ef6-4504-4182-aca0-bdb58699e943 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:47.270588 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fdad40-3df6-4af6-a58b-7f7195e98eb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34dbbdccba1b4f89824b22726aceeae2, user_id=a00fb99fe42045278bd415683b36a0d6, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:47.274648 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fdad40-3df6-4af6-a58b-7f7195e98eb6 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:47.277268 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5075f0-ea51-4115-8741-dbb65d1cf656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:47.278205 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5075f0-ea51-4115-8741-dbb65d1cf656 admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:47.278494 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5075f0-ea51-4115-8741-dbb65d1cf656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:47.278861 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5075f0-ea51-4115-8741-dbb65d1cf656 admin admin] PATH_INFO: `/v3/projects/16788fd11e7f4259ae2219d0fa1bc01e/users/4033953c81e5494ea03a7031df9ddcc1/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:47.294445 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5075f0-ea51-4115-8741-dbb65d1cf656 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16788fd11e7f4259ae2219d0fa1bc01e, user_id=4033953c81e5494ea03a7031df9ddcc1, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:47.297223 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5075f0-ea51-4115-8741-dbb65d1cf656 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:47.362106 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 805/1599] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:47:47 2022] PUT /identity/v3/projects/34dbbdccba1b4f89824b22726aceeae2/users/a00fb99fe42045278bd415683b36a0d6/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:47:47.363568 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fdad40-3df6-4af6-a58b-7f7195e98eb6 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:47.386783 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 795/1600] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:47:47 2022] PUT /identity/v3/projects/16788fd11e7f4259ae2219d0fa1bc01e/users/4033953c81e5494ea03a7031df9ddcc1/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:47:47.388364 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5075f0-ea51-4115-8741-dbb65d1cf656 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:47.424768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fdad40-3df6-4af6-a58b-7f7195e98eb6 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:47.457111 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5075f0-ea51-4115-8741-dbb65d1cf656 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:47.462214 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d3535-7df4-4eb2-8fc0-b8fa74aea40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:47.462836 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d3535-7df4-4eb2-8fc0-b8fa74aea40b admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:47.463145 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d3535-7df4-4eb2-8fc0-b8fa74aea40b admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:47.463419 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d3535-7df4-4eb2-8fc0-b8fa74aea40b admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:47.464152 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d3535-7df4-4eb2-8fc0-b8fa74aea40b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:47.465787 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d3535-7df4-4eb2-8fc0-b8fa74aea40b admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:47.475862 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 796/1601] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:47:47.476716 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d3535-7df4-4eb2-8fc0-b8fa74aea40b admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:47.486570 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d3535-7df4-4eb2-8fc0-b8fa74aea40b admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:47.488776 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c2e01-0541-436f-b5e8-3a4403491328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:47.489405 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c2e01-0541-436f-b5e8-3a4403491328 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:47.489685 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c2e01-0541-436f-b5e8-3a4403491328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:47.489960 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c2e01-0541-436f-b5e8-3a4403491328 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:47.490655 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c2e01-0541-436f-b5e8-3a4403491328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:47.492093 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fbe0bd-6673-4e60-8c4a-9710ff479b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:47.492306 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c2e01-0541-436f-b5e8-3a4403491328 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:47.492672 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fbe0bd-6673-4e60-8c4a-9710ff479b0e admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:47.492956 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fbe0bd-6673-4e60-8c4a-9710ff479b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:47.493230 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fbe0bd-6673-4e60-8c4a-9710ff479b0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:47.493898 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fbe0bd-6673-4e60-8c4a-9710ff479b0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:47.495489 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fbe0bd-6673-4e60-8c4a-9710ff479b0e admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:47.502167 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 806/1602] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:47:47.503991 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98d71d-013b-44a0-a71d-873aa0769b9c None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:47.504281 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98d71d-013b-44a0-a71d-873aa0769b9c None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:47.504586 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98d71d-013b-44a0-a71d-873aa0769b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:47.509207 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 797/1603] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:47:47.509855 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fbe0bd-6673-4e60-8c4a-9710ff479b0e admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:47.519277 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fbe0bd-6673-4e60-8c4a-9710ff479b0e admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:47.524501 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ecc28-95a5-458f-86d6-1fd2b23a0814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:47.525149 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ecc28-95a5-458f-86d6-1fd2b23a0814 admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:47.525430 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ecc28-95a5-458f-86d6-1fd2b23a0814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:47.525727 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ecc28-95a5-458f-86d6-1fd2b23a0814 admin admin] PATH_INFO: `/v3/projects/f2f7c0825ea64f44a5be7e3190b752b0/users/16970234a29e41cf8639b6ffc1aeadaf/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:47.531907 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-2b98d71d-013b-44a0-a71d-873aa0769b9c None None] MFA Rules not processed for user `5d7f9451f6f243ff87952a6edb37373f`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:47:47.533303 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-2b98d71d-013b-44a0-a71d-873aa0769b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:47.548412 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512ecc28-95a5-458f-86d6-1fd2b23a0814 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2f7c0825ea64f44a5be7e3190b752b0, user_id=16970234a29e41cf8639b6ffc1aeadaf, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:47.551665 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512ecc28-95a5-458f-86d6-1fd2b23a0814 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:47.600046 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 807/1604] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:47:47 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:47:47.600884 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98d71d-013b-44a0-a71d-873aa0769b9c None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:47.605440 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:47:47.611090 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98d71d-013b-44a0-a71d-873aa0769b9c None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:47.616235 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b668dc-81dc-4ba5-b861-b23768a400fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:47.616840 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b668dc-81dc-4ba5-b861-b23768a400fd admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:47.617123 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b668dc-81dc-4ba5-b861-b23768a400fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:47.617412 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b668dc-81dc-4ba5-b861-b23768a400fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:47.618100 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b668dc-81dc-4ba5-b861-b23768a400fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:47.619729 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b668dc-81dc-4ba5-b861-b23768a400fd admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:47.632574 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 808/1605] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:47:47.632763 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 798/1606] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:47:47 2022] PUT /identity/v3/projects/f2f7c0825ea64f44a5be7e3190b752b0/users/16970234a29e41cf8639b6ffc1aeadaf/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:47:47.632884 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92429088-b2c6-4251-a7b3-b98f4069c643 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:47.632884 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92429088-b2c6-4251-a7b3-b98f4069c643 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:47.632884 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92429088-b2c6-4251-a7b3-b98f4069c643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:47.633161 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e05aa3-f69b-49b2-9654-47d50b634e00 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:47.633161 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e05aa3-f69b-49b2-9654-47d50b634e00 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:47.633161 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e05aa3-f69b-49b2-9654-47d50b634e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:47.642029 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:47:47.652572 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-93e05aa3-f69b-49b2-9654-47d50b634e00 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:47:47.653778 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-93e05aa3-f69b-49b2-9654-47d50b634e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:47.658712 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-92429088-b2c6-4251-a7b3-b98f4069c643 None None] MFA Rules not processed for user `a00fb99fe42045278bd415683b36a0d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:47:47.660465 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-92429088-b2c6-4251-a7b3-b98f4069c643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:47.712811 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 799/1607] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:47:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:47:47.713710 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e05aa3-f69b-49b2-9654-47d50b634e00 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:47.724786 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e05aa3-f69b-49b2-9654-47d50b634e00 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:47.727135 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 809/1608] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:47:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:47:47.728006 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92429088-b2c6-4251-a7b3-b98f4069c643 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:47.734063 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f98766-0236-4349-9fce-0f58974d24f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:47.734734 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f98766-0236-4349-9fce-0f58974d24f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:47.735042 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f98766-0236-4349-9fce-0f58974d24f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:47.735320 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f98766-0236-4349-9fce-0f58974d24f2 admin admin] PATH_INFO: `/v3/projects/38744d806048464a9c712088bfa1b13c/users/3fca12b3bb624151acc654e7e604b19a/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:47.740681 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92429088-b2c6-4251-a7b3-b98f4069c643 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:47.745164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2164ef-8616-4dbe-b32a-fe7f9cf65da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:47.745764 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2164ef-8616-4dbe-b32a-fe7f9cf65da1 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:47.746046 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2164ef-8616-4dbe-b32a-fe7f9cf65da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:47.746342 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2164ef-8616-4dbe-b32a-fe7f9cf65da1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:47.747061 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2164ef-8616-4dbe-b32a-fe7f9cf65da1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:47.748689 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2164ef-8616-4dbe-b32a-fe7f9cf65da1 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:47.751159 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f98766-0236-4349-9fce-0f58974d24f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38744d806048464a9c712088bfa1b13c, user_id=3fca12b3bb624151acc654e7e604b19a, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:47.753843 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f98766-0236-4349-9fce-0f58974d24f2 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:47.758421 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 810/1609] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:47:47.759267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2164ef-8616-4dbe-b32a-fe7f9cf65da1 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:47.768469 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2164ef-8616-4dbe-b32a-fe7f9cf65da1 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:47.773013 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96eb473-bd2d-48fb-9e30-16156f8930f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:47.773628 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96eb473-bd2d-48fb-9e30-16156f8930f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:47.773903 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96eb473-bd2d-48fb-9e30-16156f8930f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:47.774178 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96eb473-bd2d-48fb-9e30-16156f8930f8 admin admin] PATH_INFO: `/v3/projects/2c2ae546c66548f38f5cbeff1c53b341/users/8f8ed7d12ca44a058ed8b888ca723b57/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:47.788863 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96eb473-bd2d-48fb-9e30-16156f8930f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c2ae546c66548f38f5cbeff1c53b341, user_id=8f8ed7d12ca44a058ed8b888ca723b57, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:47.791764 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96eb473-bd2d-48fb-9e30-16156f8930f8 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:47.818733 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 800/1610] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:47:47 2022] PUT /identity/v3/projects/38744d806048464a9c712088bfa1b13c/users/3fca12b3bb624151acc654e7e604b19a/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:47:47.819596 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f98766-0236-4349-9fce-0f58974d24f2 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:47.837007 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 811/1611] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:47:47 2022] PUT /identity/v3/projects/2c2ae546c66548f38f5cbeff1c53b341/users/8f8ed7d12ca44a058ed8b888ca723b57/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:47:47.837963 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96eb473-bd2d-48fb-9e30-16156f8930f8 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:47.877473 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f98766-0236-4349-9fce-0f58974d24f2 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:47.899059 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96eb473-bd2d-48fb-9e30-16156f8930f8 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:47.903748 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d2db6-9f13-4a2a-94ae-07ea4ea6eff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:47.904417 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d2db6-9f13-4a2a-94ae-07ea4ea6eff5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:47.904714 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d2db6-9f13-4a2a-94ae-07ea4ea6eff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:47.905003 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d2db6-9f13-4a2a-94ae-07ea4ea6eff5 admin admin] PATH_INFO: `/v3/projects/ff2eb7aa621e45c79fafe9e61516ff08/users/526cd8eb496f4389a52dd557306dd314/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:47.919578 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476d2db6-9f13-4a2a-94ae-07ea4ea6eff5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff2eb7aa621e45c79fafe9e61516ff08, user_id=526cd8eb496f4389a52dd557306dd314, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:47.922258 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476d2db6-9f13-4a2a-94ae-07ea4ea6eff5 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:47.926210 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83cfdc-39f9-4244-8f93-2345f7d34317 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:47.926825 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83cfdc-39f9-4244-8f93-2345f7d34317 service cinder] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:47.927145 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83cfdc-39f9-4244-8f93-2345f7d34317 service cinder] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:47.927420 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83cfdc-39f9-4244-8f93-2345f7d34317 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:47.973826 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:47:47.980307 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 812/1612] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:47:47 2022] PUT /identity/v3/projects/ff2eb7aa621e45c79fafe9e61516ff08/users/526cd8eb496f4389a52dd557306dd314/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:47:47.981752 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20f8b0-caa3-4672-9a45-c11e233cb224 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:47.983195 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20f8b0-caa3-4672-9a45-c11e233cb224 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:47.983195 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20f8b0-caa3-4672-9a45-c11e233cb224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:47.988538 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd83cfdc-39f9-4244-8f93-2345f7d34317 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:47.990073 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd83cfdc-39f9-4244-8f93-2345f7d34317 service cinder] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:47.999787 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 801/1613] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:47:47 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:47:48.000409 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83cfdc-39f9-4244-8f93-2345f7d34317 service cinder] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:48.001193 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-2a20f8b0-caa3-4672-9a45-c11e233cb224 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:47:48.002387 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-2a20f8b0-caa3-4672-9a45-c11e233cb224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:48.028544 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:47:48.058684 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83cfdc-39f9-4244-8f93-2345f7d34317 service cinder] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:48.064740 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 813/1614] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:47:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:47:48.065395 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20f8b0-caa3-4672-9a45-c11e233cb224 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:48.075162 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20f8b0-caa3-4672-9a45-c11e233cb224 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:48.079916 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9290c-7270-487a-88d4-e82a125517af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:48.080536 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9290c-7270-487a-88d4-e82a125517af admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:48.080818 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9290c-7270-487a-88d4-e82a125517af admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:48.081092 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9290c-7270-487a-88d4-e82a125517af admin admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:48.082298 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d9290c-7270-487a-88d4-e82a125517af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:48.084241 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d9290c-7270-487a-88d4-e82a125517af admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:48.111622 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1672d0e-6950-4de1-b884-8446dcf1d284 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:48.112270 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1672d0e-6950-4de1-b884-8446dcf1d284 service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:48.112551 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1672d0e-6950-4de1-b884-8446dcf1d284 service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:48.112920 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1672d0e-6950-4de1-b884-8446dcf1d284 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:48.122854 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1672d0e-6950-4de1-b884-8446dcf1d284 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:48.124438 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1672d0e-6950-4de1-b884-8446dcf1d284 service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:48.134413 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 802/1615] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:47:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:47:48.135119 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1672d0e-6950-4de1-b884-8446dcf1d284 service neutron] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:48.145201 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1672d0e-6950-4de1-b884-8446dcf1d284 service neutron] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:48.151794 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258d8f5-4203-46d2-bef0-e85b90cd0fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:48.151794 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258d8f5-4203-46d2-bef0-e85b90cd0fd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:48.151794 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258d8f5-4203-46d2-bef0-e85b90cd0fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:48.151794 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258d8f5-4203-46d2-bef0-e85b90cd0fd0 admin admin] PATH_INFO: `/v3/projects/f4f05d437a8c41b98fdb006367bb74a3/users/ae630508f5284c8296ba67519c59d8b7/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:48.164876 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 814/1616] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:47:48 2022] POST /identity/v3/projects => generated 367 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:47:48.166609 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587972af-40d6-475c-9925-3d6b91606082 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:48.166910 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587972af-40d6-475c-9925-3d6b91606082 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:48.167213 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587972af-40d6-475c-9925-3d6b91606082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:48.173210 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258d8f5-4203-46d2-bef0-e85b90cd0fd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4f05d437a8c41b98fdb006367bb74a3, user_id=ae630508f5284c8296ba67519c59d8b7, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:48.176191 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258d8f5-4203-46d2-bef0-e85b90cd0fd0 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:48.195638 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-587972af-40d6-475c-9925-3d6b91606082 None None] MFA Rules not processed for user `3fca12b3bb624151acc654e7e604b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:47:48.196841 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-587972af-40d6-475c-9925-3d6b91606082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:48.260095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 815/1617] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:47:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:47:48.263091 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145b6fb-25d4-4409-9267-935066e113e9 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:48.263091 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145b6fb-25d4-4409-9267-935066e113e9 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:48.263091 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145b6fb-25d4-4409-9267-935066e113e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:48.292610 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-b145b6fb-25d4-4409-9267-935066e113e9 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:47:48.294235 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-b145b6fb-25d4-4409-9267-935066e113e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:48.299937 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 803/1618] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:47:48 2022] PUT /identity/v3/projects/f4f05d437a8c41b98fdb006367bb74a3/users/ae630508f5284c8296ba67519c59d8b7/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:47:48.301786 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125ebad-0ce7-4312-b6f6-458f77e6c723 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:48.303570 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125ebad-0ce7-4312-b6f6-458f77e6c723 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:48.307292 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125ebad-0ce7-4312-b6f6-458f77e6c723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:48.355014 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-0125ebad-0ce7-4312-b6f6-458f77e6c723 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:47:48.359865 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-0125ebad-0ce7-4312-b6f6-458f77e6c723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:48.391864 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 816/1619] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:47:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:47:48.392884 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145b6fb-25d4-4409-9267-935066e113e9 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:48.443571 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:47:48.458862 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 804/1620] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:47:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:47:48.459694 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145b6fb-25d4-4409-9267-935066e113e9 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:48.460972 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125ebad-0ce7-4312-b6f6-458f77e6c723 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:48.471691 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba01a587-0e69-43c1-b665-7085ce633899 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:48.471917 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125ebad-0ce7-4312-b6f6-458f77e6c723 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:48.472371 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01a587-0e69-43c1-b665-7085ce633899 service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:48.472655 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01a587-0e69-43c1-b665-7085ce633899 service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:48.473023 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01a587-0e69-43c1-b665-7085ce633899 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:48.478760 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528306b0-b45b-46a2-bfd4-105b345e797f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:48.482392 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528306b0-b45b-46a2-bfd4-105b345e797f admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:48.482392 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528306b0-b45b-46a2-bfd4-105b345e797f admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:48.482392 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528306b0-b45b-46a2-bfd4-105b345e797f admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:48.482392 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528306b0-b45b-46a2-bfd4-105b345e797f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:48.487110 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba01a587-0e69-43c1-b665-7085ce633899 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:48.487110 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba01a587-0e69-43c1-b665-7085ce633899 service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:48.488732 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528306b0-b45b-46a2-bfd4-105b345e797f admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:48.503157 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 817/1621] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:47:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:47:48.505619 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29eb421-944f-4926-9353-b4a83845bc10 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:48.506436 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29eb421-944f-4926-9353-b4a83845bc10 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:48.506832 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29eb421-944f-4926-9353-b4a83845bc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:48.541430 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-c29eb421-944f-4926-9353-b4a83845bc10 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:47:48.543109 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-c29eb421-944f-4926-9353-b4a83845bc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:48.555068 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 818/1622] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:47:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:47:48.560515 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6710fe6-10e3-4e73-9f7e-35c5d576eef6 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:48.560790 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6710fe6-10e3-4e73-9f7e-35c5d576eef6 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:48.561068 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6710fe6-10e3-4e73-9f7e-35c5d576eef6 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:48.562411 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 819/1623] 10.222.0.42 () {54 vars in 962 bytes} [Fri Aug 5 02:47:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:47:48.563529 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6710fe6-10e3-4e73-9f7e-35c5d576eef6 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:48.565242 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-f6710fe6-10e3-4e73-9f7e-35c5d576eef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:48.574598 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 805/1624] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:47:48 2022] POST /identity/v3/users => generated 290 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:47:48.575961 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528306b0-b45b-46a2-bfd4-105b345e797f admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:48.584743 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:47:48.588461 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528306b0-b45b-46a2-bfd4-105b345e797f admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:48.595349 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e70649-5ccf-46a2-9592-f72d139d94f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:48.596622 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e70649-5ccf-46a2-9592-f72d139d94f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:48.597345 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6710fe6-10e3-4e73-9f7e-35c5d576eef6 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:48.597697 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e70649-5ccf-46a2-9592-f72d139d94f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:48.598036 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e70649-5ccf-46a2-9592-f72d139d94f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:48.605246 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ade475-6f32-4263-bbb5-e0ef22e170b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:48.606003 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ade475-6f32-4263-bbb5-e0ef22e170b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:48.606538 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ade475-6f32-4263-bbb5-e0ef22e170b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:48.606918 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ade475-6f32-4263-bbb5-e0ef22e170b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:48.620079 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e70649-5ccf-46a2-9592-f72d139d94f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:48.620079 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e70649-5ccf-46a2-9592-f72d139d94f1 service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:48.623215 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ade475-6f32-4263-bbb5-e0ef22e170b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:48.624826 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ade475-6f32-4263-bbb5-e0ef22e170b1 service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:48.664992 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 806/1625] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:47:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:47:48.667944 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 820/1626] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:47:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:47:48.671614 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1a3e4-e6d7-4378-a978-6f7737272cd9 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:48.671614 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1a3e4-e6d7-4378-a978-6f7737272cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:48.671614 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1a3e4-e6d7-4378-a978-6f7737272cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:48.676141 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e70649-5ccf-46a2-9592-f72d139d94f1 service neutron] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:48.702165 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e70649-5ccf-46a2-9592-f72d139d94f1 service neutron] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:48.712610 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee464b91-542d-435a-b3d3-9117e75ecd83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:48.713315 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee464b91-542d-435a-b3d3-9117e75ecd83 service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:48.713589 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee464b91-542d-435a-b3d3-9117e75ecd83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:48.714105 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee464b91-542d-435a-b3d3-9117e75ecd83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:48.735539 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee464b91-542d-435a-b3d3-9117e75ecd83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:48.741066 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee464b91-542d-435a-b3d3-9117e75ecd83 service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:48.741307 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-10d1a3e4-e6d7-4378-a978-6f7737272cd9 None None] MFA Rules not processed for user `55374d3bccd541c9a8f82da9b21c2fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:47:48.760260 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-10d1a3e4-e6d7-4378-a978-6f7737272cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:48.780513 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 807/1627] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:47:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:47:48.784078 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee464b91-542d-435a-b3d3-9117e75ecd83 service neutron] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:48.810994 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee464b91-542d-435a-b3d3-9117e75ecd83 service neutron] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:48.828520 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd3da8-fce4-4456-89ef-ab96977deb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:48.829325 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd3da8-fce4-4456-89ef-ab96977deb31 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:48.829609 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd3da8-fce4-4456-89ef-ab96977deb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:48.829941 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd3da8-fce4-4456-89ef-ab96977deb31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:48.830642 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd3da8-fce4-4456-89ef-ab96977deb31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:48.835272 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd3da8-fce4-4456-89ef-ab96977deb31 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:48.859437 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 808/1628] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:47:48.860457 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd3da8-fce4-4456-89ef-ab96977deb31 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:48.899688 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd3da8-fce4-4456-89ef-ab96977deb31 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:48.918197 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160b104-3138-468b-bcfb-993c6a191f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:48.918197 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160b104-3138-468b-bcfb-993c6a191f75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:48.918197 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160b104-3138-468b-bcfb-993c6a191f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:48.918197 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160b104-3138-468b-bcfb-993c6a191f75 admin admin] PATH_INFO: `/v3/projects/494ee2ebe2674048bfe9c89387d67287/users/412f8294d4fe4d7d80b5d9f117d4a1b5/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:48.935492 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 821/1629] 10.222.0.42 () {58 vars in 1059 bytes} [Fri Aug 5 02:47:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:47:48.947296 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1a3e4-e6d7-4378-a978-6f7737272cd9 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:48.956897 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2160b104-3138-468b-bcfb-993c6a191f75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=494ee2ebe2674048bfe9c89387d67287, user_id=412f8294d4fe4d7d80b5d9f117d4a1b5, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:48.959048 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1a3e4-e6d7-4378-a978-6f7737272cd9 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:48.959610 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2160b104-3138-468b-bcfb-993c6a191f75 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:48.969318 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39379ce2-1341-47d6-817b-d033be871ad9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:48.969318 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39379ce2-1341-47d6-817b-d033be871ad9 service nova] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:48.969318 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39379ce2-1341-47d6-817b-d033be871ad9 service nova] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:48.969318 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39379ce2-1341-47d6-817b-d033be871ad9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:49.038023 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 809/1630] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:47:48 2022] PUT /identity/v3/projects/494ee2ebe2674048bfe9c89387d67287/users/412f8294d4fe4d7d80b5d9f117d4a1b5/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:47:49.042752 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160b104-3138-468b-bcfb-993c6a191f75 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:49.064949 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39379ce2-1341-47d6-817b-d033be871ad9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:49.066658 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39379ce2-1341-47d6-817b-d033be871ad9 service nova] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:49.101104 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 822/1631] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:47:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:47:49.146389 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160b104-3138-468b-bcfb-993c6a191f75 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:49.154010 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63007d2a-b1e8-4d74-81b5-b24ac0aace77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:49.158402 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63007d2a-b1e8-4d74-81b5-b24ac0aace77 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:49.158402 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63007d2a-b1e8-4d74-81b5-b24ac0aace77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:49.158402 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63007d2a-b1e8-4d74-81b5-b24ac0aace77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:49.158402 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63007d2a-b1e8-4d74-81b5-b24ac0aace77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:49.160220 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63007d2a-b1e8-4d74-81b5-b24ac0aace77 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:49.179454 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39379ce2-1341-47d6-817b-d033be871ad9 service nova] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:49.180465 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 810/1632] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:47:49.181759 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63007d2a-b1e8-4d74-81b5-b24ac0aace77 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:49.192873 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39379ce2-1341-47d6-817b-d033be871ad9 service nova] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:49.193102 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63007d2a-b1e8-4d74-81b5-b24ac0aace77 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:49.197964 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf2d2f-2d83-4318-9722-1205c74e6198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:49.198907 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf2d2f-2d83-4318-9722-1205c74e6198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:49.199232 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf2d2f-2d83-4318-9722-1205c74e6198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:49.199629 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf2d2f-2d83-4318-9722-1205c74e6198 admin admin] PATH_INFO: `/v3/users/fb3ecf9eea4c4d2b95ef47f0db1ce60f` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:49.200792 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf2d2f-2d83-4318-9722-1205c74e6198 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb3ecf9eea4c4d2b95ef47f0db1ce60f)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:49.201379 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908868bc-f437-4089-922d-c5f55d7f05e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:49.202924 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf2d2f-2d83-4318-9722-1205c74e6198 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:49.205034 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908868bc-f437-4089-922d-c5f55d7f05e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:49.205894 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908868bc-f437-4089-922d-c5f55d7f05e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:49.206331 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908868bc-f437-4089-922d-c5f55d7f05e1 admin admin] PATH_INFO: `/v3/projects/494ee2ebe2674048bfe9c89387d67287/users/412f8294d4fe4d7d80b5d9f117d4a1b5/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:49.208790 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908868bc-f437-4089-922d-c5f55d7f05e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=494ee2ebe2674048bfe9c89387d67287, user_id=412f8294d4fe4d7d80b5d9f117d4a1b5, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:49.211975 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908868bc-f437-4089-922d-c5f55d7f05e1 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:49.227018 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 811/1633] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:47:49 2022] PUT /identity/v3/projects/494ee2ebe2674048bfe9c89387d67287/users/412f8294d4fe4d7d80b5d9f117d4a1b5/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:47:49.241649 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f55aa-2a17-424f-bd61-30f9ef8d8f52 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:49.242171 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f55aa-2a17-424f-bd61-30f9ef8d8f52 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:49.243356 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f55aa-2a17-424f-bd61-30f9ef8d8f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:49.292887 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-4a9f55aa-2a17-424f-bd61-30f9ef8d8f52 None None] MFA Rules not processed for user `412f8294d4fe4d7d80b5d9f117d4a1b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:47:49.294261 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-4a9f55aa-2a17-424f-bd61-30f9ef8d8f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:49.363637 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:47:49.389940 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-c1cf2d2f-2d83-4318-9722-1205c74e6198 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb3ecf9eea4c4d2b95ef47f0db1ce60f'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:47:49.427555 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 812/1634] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:47:49 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:47:49.432870 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f55aa-2a17-424f-bd61-30f9ef8d8f52 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:49.441999 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-c1cf2d2f-2d83-4318-9722-1205c74e6198 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb3ecf9eea4c4d2b95ef47f0db1ce60f'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:47:49.452202 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:47:49.457396 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-c1cf2d2f-2d83-4318-9722-1205c74e6198 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb3ecf9eea4c4d2b95ef47f0db1ce60f'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:47:49.486017 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-c1cf2d2f-2d83-4318-9722-1205c74e6198 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb3ecf9eea4c4d2b95ef47f0db1ce60f'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:47:49.489885 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-c1cf2d2f-2d83-4318-9722-1205c74e6198 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb3ecf9eea4c4d2b95ef47f0db1ce60f'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:47:49.502468 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 823/1635] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:47:49 2022] DELETE /identity/v3/users/fb3ecf9eea4c4d2b95ef47f0db1ce60f => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:47:49.508834 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e61cf4-38af-41e2-b79a-e1f62343ec3b None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:49.512872 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e61cf4-38af-41e2-b79a-e1f62343ec3b None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:49.512872 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e61cf4-38af-41e2-b79a-e1f62343ec3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:49.513378 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f55aa-2a17-424f-bd61-30f9ef8d8f52 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:49.570329 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-83e61cf4-38af-41e2-b79a-e1f62343ec3b None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:47:49.577210 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-83e61cf4-38af-41e2-b79a-e1f62343ec3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:49.577759 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252fa1d4-4425-4aba-a5ba-0702b84804c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:49.578819 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fa1d4-4425-4aba-a5ba-0702b84804c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:49.579264 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fa1d4-4425-4aba-a5ba-0702b84804c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:49.579604 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fa1d4-4425-4aba-a5ba-0702b84804c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:49.582742 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-252fa1d4-4425-4aba-a5ba-0702b84804c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:49.669238 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 824/1636] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:47:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:47:49.677022 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e61cf4-38af-41e2-b79a-e1f62343ec3b None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:49.677412 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252fa1d4-4425-4aba-a5ba-0702b84804c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:49.678523 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-83e61cf4-38af-41e2-b79a-e1f62343ec3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:49.684449 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252fa1d4-4425-4aba-a5ba-0702b84804c9 service cinder] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:49.700223 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 813/1637] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:47:49 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:47:49.769628 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e61cf4-38af-41e2-b79a-e1f62343ec3b None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:49.783338 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eec48a-3b31-450f-8aee-573ade507871 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:49.792321 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eec48a-3b31-450f-8aee-573ade507871 service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:49.792914 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eec48a-3b31-450f-8aee-573ade507871 service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:49.794812 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eec48a-3b31-450f-8aee-573ade507871 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:49.800253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a05c1b-aac5-4b42-97d3-4f880fe8e3da None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:49.800871 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a05c1b-aac5-4b42-97d3-4f880fe8e3da None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:49.801334 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a05c1b-aac5-4b42-97d3-4f880fe8e3da None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:49.803017 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 814/1638] 10.222.0.42 () {54 vars in 962 bytes} [Fri Aug 5 02:47:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:47:49.812624 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174a172-35d7-4d08-9933-e629b8179448 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:49.813276 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174a172-35d7-4d08-9933-e629b8179448 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:49.814048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174a172-35d7-4d08-9933-e629b8179448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:49.814729 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eec48a-3b31-450f-8aee-573ade507871 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:49.817339 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eec48a-3b31-450f-8aee-573ade507871 service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:49.832866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 825/1639] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:47:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:47:49.840124 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-0174a172-35d7-4d08-9933-e629b8179448 None None] MFA Rules not processed for user `55374d3bccd541c9a8f82da9b21c2fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:47:49.841381 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-0174a172-35d7-4d08-9933-e629b8179448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:49.923677 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 815/1640] 10.222.0.42 () {58 vars in 1059 bytes} [Fri Aug 5 02:47:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:47:49.930783 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098932b-d126-4461-ac85-d8006ad992f2 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:49.931575 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098932b-d126-4461-ac85-d8006ad992f2 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:49.931575 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098932b-d126-4461-ac85-d8006ad992f2 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:49.934549 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 826/1641] 10.222.0.42 () {54 vars in 912 bytes} [Fri Aug 5 02:47:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:47:49.940556 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cc824-4a1b-4da5-bcf9-dce5ecd240aa None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:49.941551 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cc824-4a1b-4da5-bcf9-dce5ecd240aa None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:49.941837 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cc824-4a1b-4da5-bcf9-dce5ecd240aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:49.967635 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-662cc824-4a1b-4da5-bcf9-dce5ecd240aa None None] MFA Rules not processed for user `55374d3bccd541c9a8f82da9b21c2fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:47:49.968959 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-662cc824-4a1b-4da5-bcf9-dce5ecd240aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:49.990136 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 816/1642] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Aug 5 02:47:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:47:50.007387 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098932b-d126-4461-ac85-d8006ad992f2 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:50.009893 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-d098932b-d126-4461-ac85-d8006ad992f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:50.056230 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098932b-d126-4461-ac85-d8006ad992f2 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:50.060185 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8d058-5e65-4f0a-8310-8805f2f19d9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:50.060900 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8d058-5e65-4f0a-8310-8805f2f19d9a service cinder] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:50.061250 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8d058-5e65-4f0a-8310-8805f2f19d9a service cinder] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:50.061589 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8d058-5e65-4f0a-8310-8805f2f19d9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:50.086295 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d8d058-5e65-4f0a-8310-8805f2f19d9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:50.088614 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d8d058-5e65-4f0a-8310-8805f2f19d9a service cinder] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:50.152706 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 827/1643] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:47:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:47:50.338464 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa7488-b5d8-447d-8139-8b4530047f53 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:50.338757 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa7488-b5d8-447d-8139-8b4530047f53 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:50.339091 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa7488-b5d8-447d-8139-8b4530047f53 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:50.340516 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 817/1644] 10.222.0.42 () {54 vars in 912 bytes} [Fri Aug 5 02:47:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:47:50.347281 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e374cf0-90e5-4ad1-9813-ab816fbb1d01 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:50.347643 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e374cf0-90e5-4ad1-9813-ab816fbb1d01 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:50.347991 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e374cf0-90e5-4ad1-9813-ab816fbb1d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:50.375479 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-6e374cf0-90e5-4ad1-9813-ab816fbb1d01 None None] MFA Rules not processed for user `55374d3bccd541c9a8f82da9b21c2fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:47:50.380975 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-6e374cf0-90e5-4ad1-9813-ab816fbb1d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:50.397048 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 828/1645] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Aug 5 02:47:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:47:50.602206 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa7488-b5d8-447d-8139-8b4530047f53 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:50.602206 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-79fa7488-b5d8-447d-8139-8b4530047f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:50.602206 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:47:50.602206 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa7488-b5d8-447d-8139-8b4530047f53 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:50.604516 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8566fba-ae56-4a28-8035-40ea01b44f8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:50.604516 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8566fba-ae56-4a28-8035-40ea01b44f8a service cinder] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:50.604516 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8566fba-ae56-4a28-8035-40ea01b44f8a service cinder] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:50.604516 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8566fba-ae56-4a28-8035-40ea01b44f8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:50.607322 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8566fba-ae56-4a28-8035-40ea01b44f8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:50.607322 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8566fba-ae56-4a28-8035-40ea01b44f8a service cinder] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:50.607322 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 818/1646] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:47:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:47:50.719012 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e374cf0-90e5-4ad1-9813-ab816fbb1d01 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:50.720792 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-6e374cf0-90e5-4ad1-9813-ab816fbb1d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:50.746639 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e374cf0-90e5-4ad1-9813-ab816fbb1d01 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:50.756464 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf69d0-5db3-460d-a686-4aa4b34bfe22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:50.757450 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf69d0-5db3-460d-a686-4aa4b34bfe22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:50.757952 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf69d0-5db3-460d-a686-4aa4b34bfe22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:50.758395 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf69d0-5db3-460d-a686-4aa4b34bfe22 admin admin] PATH_INFO: `/v3/users/3fca12b3bb624151acc654e7e604b19a` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:50.759844 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf69d0-5db3-460d-a686-4aa4b34bfe22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fca12b3bb624151acc654e7e604b19a)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:50.761951 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf69d0-5db3-460d-a686-4aa4b34bfe22 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:50.805739 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8566fba-ae56-4a28-8035-40ea01b44f8a service cinder] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:50.807682 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-f8566fba-ae56-4a28-8035-40ea01b44f8a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:50.830037 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8566fba-ae56-4a28-8035-40ea01b44f8a service cinder] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:50.835017 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d060090-3366-4b8e-99fd-a352ee329e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:50.836076 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d060090-3366-4b8e-99fd-a352ee329e23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:50.836501 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d060090-3366-4b8e-99fd-a352ee329e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:50.836951 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d060090-3366-4b8e-99fd-a352ee329e23 admin admin] PATH_INFO: `/v3/projects/c4913037c23444d28083bb194194defa` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:50.838408 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d060090-3366-4b8e-99fd-a352ee329e23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4913037c23444d28083bb194194defa)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:50.841147 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d060090-3366-4b8e-99fd-a352ee329e23 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:50.912920 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:47:51.003954 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-7d060090-3366-4b8e-99fd-a352ee329e23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4913037c23444d28083bb194194defa', 'request_id': 'req-7d060090-3366-4b8e-99fd-a352ee329e23'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:47:51.030298 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-5eaf69d0-5db3-460d-a686-4aa4b34bfe22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fca12b3bb624151acc654e7e604b19a'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:47:51.100220 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-7d060090-3366-4b8e-99fd-a352ee329e23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4913037c23444d28083bb194194defa', 'request_id': 'req-7d060090-3366-4b8e-99fd-a352ee329e23'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:47:51.111803 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-7d060090-3366-4b8e-99fd-a352ee329e23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4913037c23444d28083bb194194defa', 'request_id': 'req-7d060090-3366-4b8e-99fd-a352ee329e23'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:47:51.130241 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-7d060090-3366-4b8e-99fd-a352ee329e23 admin admin] The token cache is being invalidate because project c4913037c23444d28083bb194194defa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:47:51.131199 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-7d060090-3366-4b8e-99fd-a352ee329e23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:47:51.131417 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-7d060090-3366-4b8e-99fd-a352ee329e23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:47:51.137248 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 819/1647] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:47:50 2022] DELETE /identity/v3/projects/c4913037c23444d28083bb194194defa => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:47:51.138391 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d060090-3366-4b8e-99fd-a352ee329e23 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:51.140791 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-7d060090-3366-4b8e-99fd-a352ee329e23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:51.173444 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-5eaf69d0-5db3-460d-a686-4aa4b34bfe22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fca12b3bb624151acc654e7e604b19a'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:47:51.184082 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-5eaf69d0-5db3-460d-a686-4aa4b34bfe22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fca12b3bb624151acc654e7e604b19a'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:47:51.213328 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-5eaf69d0-5db3-460d-a686-4aa4b34bfe22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fca12b3bb624151acc654e7e604b19a'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:47:51.215315 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-5eaf69d0-5db3-460d-a686-4aa4b34bfe22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fca12b3bb624151acc654e7e604b19a'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:47:51.233780 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 829/1648] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:47:50 2022] DELETE /identity/v3/users/3fca12b3bb624151acc654e7e604b19a => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:47:51.239631 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4521a3-7332-4333-a1f6-72b8dae1d23f None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:51.239936 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4521a3-7332-4333-a1f6-72b8dae1d23f None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:51.240216 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4521a3-7332-4333-a1f6-72b8dae1d23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:51.267381 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d060090-3366-4b8e-99fd-a352ee329e23 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:51.287975 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-4a4521a3-7332-4333-a1f6-72b8dae1d23f None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:47:51.289219 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-4a4521a3-7332-4333-a1f6-72b8dae1d23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:51.393615 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a96cfb-8367-4b7f-820b-676d501965be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:51.395526 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a96cfb-8367-4b7f-820b-676d501965be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:51.395897 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a96cfb-8367-4b7f-820b-676d501965be admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:51.396481 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a96cfb-8367-4b7f-820b-676d501965be admin admin] PATH_INFO: `/v3/users/5d7f9451f6f243ff87952a6edb37373f` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:51.398290 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a96cfb-8367-4b7f-820b-676d501965be admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d7f9451f6f243ff87952a6edb37373f)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:51.401033 dv-cinder-815582-13-smb devstack@keystone.service[80823]: WARNING py.warnings [None req-55a96cfb-8367-4b7f-820b-676d501965be admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 02:47:51.401033 dv-cinder-815582-13-smb devstack@keystone.service[80823]: warnings.warn(msg) Aug 05 02:47:51.401033 dv-cinder-815582-13-smb devstack@keystone.service[80823]: Aug 05 02:47:51.406592 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a96cfb-8367-4b7f-820b-676d501965be admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:51.437746 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 830/1649] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:47:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:47:51.484763 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4521a3-7332-4333-a1f6-72b8dae1d23f None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:51.486603 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-4a4521a3-7332-4333-a1f6-72b8dae1d23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:51.503874 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:47:51.561881 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4521a3-7332-4333-a1f6-72b8dae1d23f None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:51.567156 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4bd1ec-2832-4c09-8c97-2991ba2469b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:51.569389 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bd1ec-2832-4c09-8c97-2991ba2469b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:51.570631 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bd1ec-2832-4c09-8c97-2991ba2469b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:51.576391 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bd1ec-2832-4c09-8c97-2991ba2469b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:51.593986 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4bd1ec-2832-4c09-8c97-2991ba2469b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:51.600660 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4bd1ec-2832-4c09-8c97-2991ba2469b8 service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:51.640421 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 831/1650] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:47:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:47:51.714264 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-55a96cfb-8367-4b7f-820b-676d501965be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d7f9451f6f243ff87952a6edb37373f'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:47:51.836117 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-55a96cfb-8367-4b7f-820b-676d501965be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d7f9451f6f243ff87952a6edb37373f'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:47:51.849709 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-55a96cfb-8367-4b7f-820b-676d501965be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d7f9451f6f243ff87952a6edb37373f'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:47:51.850471 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-55a96cfb-8367-4b7f-820b-676d501965be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d7f9451f6f243ff87952a6edb37373f'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:47:51.870853 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-55a96cfb-8367-4b7f-820b-676d501965be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d7f9451f6f243ff87952a6edb37373f'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:47:51.877318 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 820/1651] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:47:51 2022] DELETE /identity/v3/users/5d7f9451f6f243ff87952a6edb37373f => generated 0 bytes in 739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:47:53.411595 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4bd1ec-2832-4c09-8c97-2991ba2469b8 service neutron] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:53.415352 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-6c4bd1ec-2832-4c09-8c97-2991ba2469b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:53.459686 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4bd1ec-2832-4c09-8c97-2991ba2469b8 service neutron] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:53.553701 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:47:53.597699 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb897c3-896f-4ab6-b4a4-8aca844af2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:53.597699 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb897c3-896f-4ab6-b4a4-8aca844af2a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:53.597699 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb897c3-896f-4ab6-b4a4-8aca844af2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:53.597699 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb897c3-896f-4ab6-b4a4-8aca844af2a3 admin admin] PATH_INFO: `/v3/projects/38744d806048464a9c712088bfa1b13c` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:53.598303 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb897c3-896f-4ab6-b4a4-8aca844af2a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38744d806048464a9c712088bfa1b13c)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:53.601049 dv-cinder-815582-13-smb devstack@keystone.service[80822]: WARNING py.warnings [None req-ddb897c3-896f-4ab6-b4a4-8aca844af2a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 02:47:53.601049 dv-cinder-815582-13-smb devstack@keystone.service[80822]: warnings.warn(msg) Aug 05 02:47:53.601049 dv-cinder-815582-13-smb devstack@keystone.service[80822]: Aug 05 02:47:53.602609 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb897c3-896f-4ab6-b4a4-8aca844af2a3 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:53.728684 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a96cfb-8367-4b7f-820b-676d501965be admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:53.731319 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-55a96cfb-8367-4b7f-820b-676d501965be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:53.769702 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a96cfb-8367-4b7f-820b-676d501965be admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:53.778291 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ef0dc-a645-4174-a8c8-9deb717a39f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:53.782157 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ef0dc-a645-4174-a8c8-9deb717a39f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:53.782157 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ef0dc-a645-4174-a8c8-9deb717a39f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:53.782157 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ef0dc-a645-4174-a8c8-9deb717a39f1 admin admin] PATH_INFO: `/v3/projects/c8cfee795c3b4aad957e27752e6b79e6` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:53.786862 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ef0dc-a645-4174-a8c8-9deb717a39f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8cfee795c3b4aad957e27752e6b79e6)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:53.791184 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ef0dc-a645-4174-a8c8-9deb717a39f1 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:53.899192 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-ddb897c3-896f-4ab6-b4a4-8aca844af2a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38744d806048464a9c712088bfa1b13c', 'request_id': 'req-ddb897c3-896f-4ab6-b4a4-8aca844af2a3'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:47:53.977769 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-904ef0dc-a645-4174-a8c8-9deb717a39f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8cfee795c3b4aad957e27752e6b79e6', 'request_id': 'req-904ef0dc-a645-4174-a8c8-9deb717a39f1'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:47:54.150617 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-ddb897c3-896f-4ab6-b4a4-8aca844af2a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38744d806048464a9c712088bfa1b13c', 'request_id': 'req-ddb897c3-896f-4ab6-b4a4-8aca844af2a3'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:47:54.157197 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-ddb897c3-896f-4ab6-b4a4-8aca844af2a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38744d806048464a9c712088bfa1b13c', 'request_id': 'req-ddb897c3-896f-4ab6-b4a4-8aca844af2a3'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:47:54.184076 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-ddb897c3-896f-4ab6-b4a4-8aca844af2a3 admin admin] The token cache is being invalidate because project 38744d806048464a9c712088bfa1b13c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:47:54.187137 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-ddb897c3-896f-4ab6-b4a4-8aca844af2a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:47:54.187137 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-ddb897c3-896f-4ab6-b4a4-8aca844af2a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:47:54.188966 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 832/1652] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:47:53 2022] DELETE /identity/v3/projects/38744d806048464a9c712088bfa1b13c => generated 0 bytes in 779 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:47:54.191503 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb897c3-896f-4ab6-b4a4-8aca844af2a3 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:54.193230 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-ddb897c3-896f-4ab6-b4a4-8aca844af2a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:54.270465 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-904ef0dc-a645-4174-a8c8-9deb717a39f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8cfee795c3b4aad957e27752e6b79e6', 'request_id': 'req-904ef0dc-a645-4174-a8c8-9deb717a39f1'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:47:54.286743 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-904ef0dc-a645-4174-a8c8-9deb717a39f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8cfee795c3b4aad957e27752e6b79e6', 'request_id': 'req-904ef0dc-a645-4174-a8c8-9deb717a39f1'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:47:54.312945 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-904ef0dc-a645-4174-a8c8-9deb717a39f1 admin admin] The token cache is being invalidate because project c8cfee795c3b4aad957e27752e6b79e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:47:54.313240 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-904ef0dc-a645-4174-a8c8-9deb717a39f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:47:54.314542 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-904ef0dc-a645-4174-a8c8-9deb717a39f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:47:54.323253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 821/1653] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:47:53 2022] DELETE /identity/v3/projects/c8cfee795c3b4aad957e27752e6b79e6 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:47:54.323253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4e9e2-06a4-463b-89b9-adb6c9bced4a None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:54.323253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4e9e2-06a4-463b-89b9-adb6c9bced4a None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:54.325325 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4e9e2-06a4-463b-89b9-adb6c9bced4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:54.338364 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb897c3-896f-4ab6-b4a4-8aca844af2a3 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:54.357377 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-66f4e9e2-06a4-463b-89b9-adb6c9bced4a None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:47:54.358569 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-66f4e9e2-06a4-463b-89b9-adb6c9bced4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:54.442619 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 822/1654] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:47:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:47:54.448813 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c6cbf-31fc-4f1e-81c7-ad8cb0b53efd None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:54.449177 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c6cbf-31fc-4f1e-81c7-ad8cb0b53efd None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:54.449577 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c6cbf-31fc-4f1e-81c7-ad8cb0b53efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:54.456139 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e2a1e-7b5a-4b7b-91e6-3d719ef88b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:54.457508 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e2a1e-7b5a-4b7b-91e6-3d719ef88b46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:54.457947 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e2a1e-7b5a-4b7b-91e6-3d719ef88b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:54.458381 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e2a1e-7b5a-4b7b-91e6-3d719ef88b46 admin admin] PATH_INFO: `/v3/users/a00fb99fe42045278bd415683b36a0d6` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:54.460317 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e2a1e-7b5a-4b7b-91e6-3d719ef88b46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a00fb99fe42045278bd415683b36a0d6)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:54.464564 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e2a1e-7b5a-4b7b-91e6-3d719ef88b46 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:54.486594 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-4f8c6cbf-31fc-4f1e-81c7-ad8cb0b53efd None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:47:54.488883 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-4f8c6cbf-31fc-4f1e-81c7-ad8cb0b53efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:54.512056 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 823/1655] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:47:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:47:54.513824 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18061439-3fc1-40dc-8d16-d9c1e1146be5 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:54.513953 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18061439-3fc1-40dc-8d16-d9c1e1146be5 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:54.515190 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18061439-3fc1-40dc-8d16-d9c1e1146be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:54.547178 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-18061439-3fc1-40dc-8d16-d9c1e1146be5 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:47:54.548502 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-18061439-3fc1-40dc-8d16-d9c1e1146be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:54.558234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 824/1656] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:47:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:47:54.562145 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfb739-0a54-4d95-a5de-975e0c9e6869 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:54.570819 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfb739-0a54-4d95-a5de-975e0c9e6869 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:54.570819 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfb739-0a54-4d95-a5de-975e0c9e6869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:54.639743 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-fbdfb739-0a54-4d95-a5de-975e0c9e6869 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:47:54.641898 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-fbdfb739-0a54-4d95-a5de-975e0c9e6869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:54.666508 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 825/1657] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:47:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:47:54.670135 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdfb739-0a54-4d95-a5de-975e0c9e6869 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:54.676676 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:47:54.702981 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdfb739-0a54-4d95-a5de-975e0c9e6869 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:54.744846 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b322b-82f4-4c74-b1e2-9b490db3b023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:54.748161 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b322b-82f4-4c74-b1e2-9b490db3b023 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:54.749461 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b322b-82f4-4c74-b1e2-9b490db3b023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:54.749906 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b322b-82f4-4c74-b1e2-9b490db3b023 admin admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:54.751547 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b322b-82f4-4c74-b1e2-9b490db3b023 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:47:54.756705 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b322b-82f4-4c74-b1e2-9b490db3b023 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:54.758448 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b322b-82f4-4c74-b1e2-9b490db3b023 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:54.763824 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-2f0e2a1e-7b5a-4b7b-91e6-3d719ef88b46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a00fb99fe42045278bd415683b36a0d6'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:47:54.785244 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 826/1658] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:47:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:47:54.786433 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b322b-82f4-4c74-b1e2-9b490db3b023 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:54.802319 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b322b-82f4-4c74-b1e2-9b490db3b023 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:54.812600 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49863efa-d1e4-426a-a88e-91c21e816d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:54.813634 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49863efa-d1e4-426a-a88e-91c21e816d27 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:54.815005 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49863efa-d1e4-426a-a88e-91c21e816d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:54.817704 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49863efa-d1e4-426a-a88e-91c21e816d27 admin admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:54.818824 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49863efa-d1e4-426a-a88e-91c21e816d27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:47:54.819370 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49863efa-d1e4-426a-a88e-91c21e816d27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:54.822840 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49863efa-d1e4-426a-a88e-91c21e816d27 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:54.853122 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-2f0e2a1e-7b5a-4b7b-91e6-3d719ef88b46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a00fb99fe42045278bd415683b36a0d6'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:47:54.864070 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 827/1659] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:47:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:47:54.866921 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-2f0e2a1e-7b5a-4b7b-91e6-3d719ef88b46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a00fb99fe42045278bd415683b36a0d6'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:47:54.875766 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49863efa-d1e4-426a-a88e-91c21e816d27 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:54.905983 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49863efa-d1e4-426a-a88e-91c21e816d27 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:54.910664 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-2f0e2a1e-7b5a-4b7b-91e6-3d719ef88b46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a00fb99fe42045278bd415683b36a0d6'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:47:54.912352 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-2f0e2a1e-7b5a-4b7b-91e6-3d719ef88b46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a00fb99fe42045278bd415683b36a0d6'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:47:54.912880 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d9c4e-d0c5-450a-8bfe-a474a6bb348e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:54.913866 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d9c4e-d0c5-450a-8bfe-a474a6bb348e admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:54.914520 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d9c4e-d0c5-450a-8bfe-a474a6bb348e admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:54.914942 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d9c4e-d0c5-450a-8bfe-a474a6bb348e admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:54.915665 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4d9c4e-d0c5-450a-8bfe-a474a6bb348e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:54.917676 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4d9c4e-d0c5-450a-8bfe-a474a6bb348e admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:54.932976 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 833/1660] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:47:54 2022] DELETE /identity/v3/users/a00fb99fe42045278bd415683b36a0d6 => generated 0 bytes in 741 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:47:54.932976 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e2a1e-7b5a-4b7b-91e6-3d719ef88b46 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:54.932976 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-2f0e2a1e-7b5a-4b7b-91e6-3d719ef88b46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:55.076056 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 828/1661] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:47:54 2022] POST /identity/v3/projects => generated 381 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:47:55.076056 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac1e4f-6850-44f1-9475-77fb37c09014 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:55.076056 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac1e4f-6850-44f1-9475-77fb37c09014 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:55.076056 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac1e4f-6850-44f1-9475-77fb37c09014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:55.088826 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e2a1e-7b5a-4b7b-91e6-3d719ef88b46 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:55.116850 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:47:55.141458 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-6fac1e4f-6850-44f1-9475-77fb37c09014 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:47:55.148375 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-6fac1e4f-6850-44f1-9475-77fb37c09014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:55.342647 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86670fd0-bce2-428e-88e5-0bfc8144f7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:55.342647 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86670fd0-bce2-428e-88e5-0bfc8144f7bc admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:55.342647 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86670fd0-bce2-428e-88e5-0bfc8144f7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:55.342647 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86670fd0-bce2-428e-88e5-0bfc8144f7bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:55.343025 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86670fd0-bce2-428e-88e5-0bfc8144f7bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:55.343025 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86670fd0-bce2-428e-88e5-0bfc8144f7bc admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:55.423797 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 829/1662] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:47:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:47:55.423797 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fac1e4f-6850-44f1-9475-77fb37c09014 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:55.423797 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-6fac1e4f-6850-44f1-9475-77fb37c09014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:55.449278 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fac1e4f-6850-44f1-9475-77fb37c09014 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:55.459495 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0250b-6c96-4e50-825c-2b8df667fe8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:55.461077 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0250b-6c96-4e50-825c-2b8df667fe8e admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:55.461077 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0250b-6c96-4e50-825c-2b8df667fe8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:55.461077 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0250b-6c96-4e50-825c-2b8df667fe8e admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:55.461743 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0250b-6c96-4e50-825c-2b8df667fe8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:55.463990 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0250b-6c96-4e50-825c-2b8df667fe8e admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:55.505863 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 834/1663] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:47:54 2022] POST /identity/v3/projects => generated 387 bytes in 574 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:47:55.517856 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86670fd0-bce2-428e-88e5-0bfc8144f7bc admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:55.592942 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 830/1664] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:47:55 2022] POST /identity/v3/users => generated 291 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:47:55.599983 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0250b-6c96-4e50-825c-2b8df667fe8e admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:55.606870 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-b2e0250b-6c96-4e50-825c-2b8df667fe8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:55.767049 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86670fd0-bce2-428e-88e5-0bfc8144f7bc admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:55.779901 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c18a7-0339-408a-a58e-38593c0693a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:55.780204 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c18a7-0339-408a-a58e-38593c0693a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:55.780280 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c18a7-0339-408a-a58e-38593c0693a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:55.780507 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c18a7-0339-408a-a58e-38593c0693a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:55.781185 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20c18a7-0339-408a-a58e-38593c0693a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:55.783176 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20c18a7-0339-408a-a58e-38593c0693a5 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:55.833934 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0250b-6c96-4e50-825c-2b8df667fe8e admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:55.906270 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 835/1665] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:47:55 2022] POST /identity/v3/users => generated 294 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:47:55.907203 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c18a7-0339-408a-a58e-38593c0693a5 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:55.928638 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c18a7-0339-408a-a58e-38593c0693a5 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:55.943225 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc97c6-9859-45a9-ab1b-e27ebca3eb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:55.943995 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc97c6-9859-45a9-ab1b-e27ebca3eb20 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:55.944398 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc97c6-9859-45a9-ab1b-e27ebca3eb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:55.944760 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc97c6-9859-45a9-ab1b-e27ebca3eb20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:55.945555 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc97c6-9859-45a9-ab1b-e27ebca3eb20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:55.948630 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc97c6-9859-45a9-ab1b-e27ebca3eb20 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:55.990919 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:47:56.005824 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 836/1666] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:47:56.006894 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc97c6-9859-45a9-ab1b-e27ebca3eb20 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:56.022209 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc97c6-9859-45a9-ab1b-e27ebca3eb20 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:56.033020 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3447d1-cb45-4af0-852b-e30d7b4fe9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:56.033846 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3447d1-cb45-4af0-852b-e30d7b4fe9fd admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:56.034797 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3447d1-cb45-4af0-852b-e30d7b4fe9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:56.035219 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3447d1-cb45-4af0-852b-e30d7b4fe9fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:56.036487 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3447d1-cb45-4af0-852b-e30d7b4fe9fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:56.039057 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3447d1-cb45-4af0-852b-e30d7b4fe9fd admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:56.073446 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 837/1667] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:47:56.076142 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3447d1-cb45-4af0-852b-e30d7b4fe9fd admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:56.100878 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3447d1-cb45-4af0-852b-e30d7b4fe9fd admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:56.115855 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd887e69-0772-43b2-a413-eae57d92455d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:56.118593 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd887e69-0772-43b2-a413-eae57d92455d admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:56.119138 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd887e69-0772-43b2-a413-eae57d92455d admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:56.120988 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd887e69-0772-43b2-a413-eae57d92455d admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:56.123814 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd887e69-0772-43b2-a413-eae57d92455d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:56.130155 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd887e69-0772-43b2-a413-eae57d92455d admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:56.136635 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846277f-6b97-48c0-96dd-e3d27da0add5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:56.137296 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846277f-6b97-48c0-96dd-e3d27da0add5 service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:56.137584 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846277f-6b97-48c0-96dd-e3d27da0add5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:56.137878 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846277f-6b97-48c0-96dd-e3d27da0add5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:56.151928 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 838/1668] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:47:56.153274 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd887e69-0772-43b2-a413-eae57d92455d admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:56.168980 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:47:56.170520 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd887e69-0772-43b2-a413-eae57d92455d admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:56.174506 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1846277f-6b97-48c0-96dd-e3d27da0add5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:56.177060 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1846277f-6b97-48c0-96dd-e3d27da0add5 service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:56.178701 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192b059-9bd1-41bd-88f6-2fd26bbfb40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:56.179386 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192b059-9bd1-41bd-88f6-2fd26bbfb40f admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:56.179672 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192b059-9bd1-41bd-88f6-2fd26bbfb40f admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:56.180092 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192b059-9bd1-41bd-88f6-2fd26bbfb40f admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:56.180961 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e192b059-9bd1-41bd-88f6-2fd26bbfb40f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:56.184548 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e192b059-9bd1-41bd-88f6-2fd26bbfb40f admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:56.204493 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 839/1669] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:47:56.205790 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192b059-9bd1-41bd-88f6-2fd26bbfb40f admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:56.217703 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 831/1670] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:47:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:47:56.218387 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846277f-6b97-48c0-96dd-e3d27da0add5 service neutron] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:56.220869 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192b059-9bd1-41bd-88f6-2fd26bbfb40f admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:56.239764 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b167141b-3882-481a-bfad-847e1d24d72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:56.240703 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167141b-3882-481a-bfad-847e1d24d72d admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:56.245157 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167141b-3882-481a-bfad-847e1d24d72d admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:56.245157 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167141b-3882-481a-bfad-847e1d24d72d admin admin] PATH_INFO: `/v3/projects/a2d8d6762ffe45a0852d548466fe0bda/users/ccdb55fa60e741b69e02707bc71ccda9/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:56.245449 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846277f-6b97-48c0-96dd-e3d27da0add5 service neutron] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:56.266463 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b167141b-3882-481a-bfad-847e1d24d72d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2d8d6762ffe45a0852d548466fe0bda, user_id=ccdb55fa60e741b69e02707bc71ccda9, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:56.268219 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f44fe-45b0-4df1-8bf2-141c3c101729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:56.274390 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f44fe-45b0-4df1-8bf2-141c3c101729 admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:56.274390 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f44fe-45b0-4df1-8bf2-141c3c101729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:56.274390 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f44fe-45b0-4df1-8bf2-141c3c101729 admin admin] PATH_INFO: `/v3/projects/7a809b8808894b57986419ea7ed5864f/users/c668306b2a94444084fbbd41f09e1135/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:56.287109 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b167141b-3882-481a-bfad-847e1d24d72d admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:56.299264 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f44fe-45b0-4df1-8bf2-141c3c101729 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a809b8808894b57986419ea7ed5864f, user_id=c668306b2a94444084fbbd41f09e1135, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:56.303814 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f44fe-45b0-4df1-8bf2-141c3c101729 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:56.386122 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 840/1671] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:47:56 2022] PUT /identity/v3/projects/a2d8d6762ffe45a0852d548466fe0bda/users/ccdb55fa60e741b69e02707bc71ccda9/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:47:56.397331 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264db638-5c46-4730-9a2c-c5b4a830857e None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:56.397331 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264db638-5c46-4730-9a2c-c5b4a830857e None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:56.397331 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264db638-5c46-4730-9a2c-c5b4a830857e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:56.403729 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 832/1672] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:47:56 2022] PUT /identity/v3/projects/7a809b8808894b57986419ea7ed5864f/users/c668306b2a94444084fbbd41f09e1135/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:47:56.416436 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb9628-c1cb-4690-8cde-f6f4f4636720 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:56.416725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb9628-c1cb-4690-8cde-f6f4f4636720 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:56.417000 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb9628-c1cb-4690-8cde-f6f4f4636720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:56.439042 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-264db638-5c46-4730-9a2c-c5b4a830857e None None] MFA Rules not processed for user `ccdb55fa60e741b69e02707bc71ccda9`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:47:56.441142 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-264db638-5c46-4730-9a2c-c5b4a830857e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:56.471392 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-c2eb9628-c1cb-4690-8cde-f6f4f4636720 None None] MFA Rules not processed for user `c668306b2a94444084fbbd41f09e1135`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:47:56.472673 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-c2eb9628-c1cb-4690-8cde-f6f4f4636720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:56.558007 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 841/1673] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:47:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:47:56.558896 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264db638-5c46-4730-9a2c-c5b4a830857e None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:56.641352 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 833/1674] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:47:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:47:56.642616 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb9628-c1cb-4690-8cde-f6f4f4636720 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:56.749949 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264db638-5c46-4730-9a2c-c5b4a830857e None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:56.766321 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c490688-5752-4674-be59-cddcae3a2afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:56.767124 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c490688-5752-4674-be59-cddcae3a2afb admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:56.780058 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c490688-5752-4674-be59-cddcae3a2afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:56.780058 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c490688-5752-4674-be59-cddcae3a2afb admin admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:56.780058 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c490688-5752-4674-be59-cddcae3a2afb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:56.780058 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c490688-5752-4674-be59-cddcae3a2afb admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:56.821719 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb9628-c1cb-4690-8cde-f6f4f4636720 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:56.836054 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51084f9-e935-414e-a1fd-27c82e14a2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:56.837886 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51084f9-e935-414e-a1fd-27c82e14a2b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:56.838797 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51084f9-e935-414e-a1fd-27c82e14a2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:56.839307 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51084f9-e935-414e-a1fd-27c82e14a2b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:56.840192 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51084f9-e935-414e-a1fd-27c82e14a2b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:56.843038 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51084f9-e935-414e-a1fd-27c82e14a2b2 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:56.907517 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 842/1675] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:47:56 2022] POST /identity/v3/projects => generated 379 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:47:56.910913 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:47:56.912185 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c490688-5752-4674-be59-cddcae3a2afb admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:56.969013 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 834/1676] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:47:56 2022] POST /identity/v3/projects => generated 383 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:47:56.974188 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51084f9-e935-414e-a1fd-27c82e14a2b2 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:57.128629 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c490688-5752-4674-be59-cddcae3a2afb admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:57.176169 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:47:57.223111 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51084f9-e935-414e-a1fd-27c82e14a2b2 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:57.239515 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c405b7-6fca-4c70-a3a3-29b43be5ad3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:57.240306 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c405b7-6fca-4c70-a3a3-29b43be5ad3e admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:57.240592 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c405b7-6fca-4c70-a3a3-29b43be5ad3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:57.240866 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c405b7-6fca-4c70-a3a3-29b43be5ad3e admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:57.241544 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c405b7-6fca-4c70-a3a3-29b43be5ad3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:57.247147 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c405b7-6fca-4c70-a3a3-29b43be5ad3e admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:57.337536 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f13f3-fe71-4b30-956d-46ec47cd4722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:57.338387 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f13f3-fe71-4b30-956d-46ec47cd4722 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:57.338816 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f13f3-fe71-4b30-956d-46ec47cd4722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:57.339432 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f13f3-fe71-4b30-956d-46ec47cd4722 admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:57.340306 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f13f3-fe71-4b30-956d-46ec47cd4722 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:57.347216 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f13f3-fe71-4b30-956d-46ec47cd4722 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:57.397800 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 835/1677] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:47:56 2022] POST /identity/v3/users => generated 292 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:47:57.398309 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c405b7-6fca-4c70-a3a3-29b43be5ad3e admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:57.457193 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c405b7-6fca-4c70-a3a3-29b43be5ad3e admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:57.477744 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 843/1678] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:47:56 2022] POST /identity/v3/users => generated 296 bytes in 566 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:47:57.478990 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50fb70-3e85-45fc-bad7-6c92ced2634e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:57.481403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50fb70-3e85-45fc-bad7-6c92ced2634e admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:57.481842 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f13f3-fe71-4b30-956d-46ec47cd4722 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:57.489017 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50fb70-3e85-45fc-bad7-6c92ced2634e admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:57.490323 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50fb70-3e85-45fc-bad7-6c92ced2634e admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:57.492126 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a50fb70-3e85-45fc-bad7-6c92ced2634e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:57.497480 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a50fb70-3e85-45fc-bad7-6c92ced2634e admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:57.510425 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f13f3-fe71-4b30-956d-46ec47cd4722 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:57.531305 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 836/1679] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:47:57.534925 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164ea5e-a2e7-45c7-b886-c16e84f7d078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:57.536111 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164ea5e-a2e7-45c7-b886-c16e84f7d078 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:57.536589 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164ea5e-a2e7-45c7-b886-c16e84f7d078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:57.537068 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164ea5e-a2e7-45c7-b886-c16e84f7d078 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:57.537828 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50fb70-3e85-45fc-bad7-6c92ced2634e admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:57.538234 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164ea5e-a2e7-45c7-b886-c16e84f7d078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:57.540133 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164ea5e-a2e7-45c7-b886-c16e84f7d078 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:57.574301 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50fb70-3e85-45fc-bad7-6c92ced2634e admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:57.587697 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 844/1680] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:47:57.592856 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164ea5e-a2e7-45c7-b886-c16e84f7d078 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:57.604734 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af045f-e421-44ee-99c8-11b77229db01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:57.606006 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af045f-e421-44ee-99c8-11b77229db01 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:57.606340 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af045f-e421-44ee-99c8-11b77229db01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:57.606623 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af045f-e421-44ee-99c8-11b77229db01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:57.622935 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af045f-e421-44ee-99c8-11b77229db01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:57.624643 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af045f-e421-44ee-99c8-11b77229db01 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:57.636808 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164ea5e-a2e7-45c7-b886-c16e84f7d078 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:57.665060 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf476f7-be89-4ec0-82bb-e685c05b485b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:57.666250 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf476f7-be89-4ec0-82bb-e685c05b485b admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:57.666250 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf476f7-be89-4ec0-82bb-e685c05b485b admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:57.666250 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf476f7-be89-4ec0-82bb-e685c05b485b admin admin] PATH_INFO: `/v3/projects/e411961868da41ff85799c83d576d23b/users/8e27fe170efc486fae3be71f453166a6/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:57.677928 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 837/1681] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:47:57.683801 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af045f-e421-44ee-99c8-11b77229db01 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:57.705243 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af045f-e421-44ee-99c8-11b77229db01 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:57.705939 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf476f7-be89-4ec0-82bb-e685c05b485b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e411961868da41ff85799c83d576d23b, user_id=8e27fe170efc486fae3be71f453166a6, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:57.709042 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf476f7-be89-4ec0-82bb-e685c05b485b admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:57.718213 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40e13c-1f30-42da-bcd3-f2b287b2fc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:57.718924 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40e13c-1f30-42da-bcd3-f2b287b2fc6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:57.719499 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40e13c-1f30-42da-bcd3-f2b287b2fc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:57.719776 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40e13c-1f30-42da-bcd3-f2b287b2fc6e admin admin] PATH_INFO: `/v3/projects/1be3da8bcc504c93a6f0079a8e3766e0/users/89e48d6223104ad6944515751fb92277/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:57.761087 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b40e13c-1f30-42da-bcd3-f2b287b2fc6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1be3da8bcc504c93a6f0079a8e3766e0, user_id=89e48d6223104ad6944515751fb92277, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:57.763833 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b40e13c-1f30-42da-bcd3-f2b287b2fc6e admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:57.804120 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 845/1682] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:47:57 2022] PUT /identity/v3/projects/e411961868da41ff85799c83d576d23b/users/8e27fe170efc486fae3be71f453166a6/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:47:57.808343 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf476f7-be89-4ec0-82bb-e685c05b485b admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:57.882991 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 838/1683] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:47:57 2022] PUT /identity/v3/projects/1be3da8bcc504c93a6f0079a8e3766e0/users/89e48d6223104ad6944515751fb92277/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:47:57.893490 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9dd8cd-da48-4f66-b2e9-ee300116c595 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:57.893764 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9dd8cd-da48-4f66-b2e9-ee300116c595 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:57.894037 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9dd8cd-da48-4f66-b2e9-ee300116c595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:57.943059 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:47:57.988122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-bd9dd8cd-da48-4f66-b2e9-ee300116c595 None None] MFA Rules not processed for user `89e48d6223104ad6944515751fb92277`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:47:57.990845 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-bd9dd8cd-da48-4f66-b2e9-ee300116c595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:58.008568 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf476f7-be89-4ec0-82bb-e685c05b485b admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:58.149477 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05159ee3-f20b-4d4a-b201-7905aabfad1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:58.150129 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05159ee3-f20b-4d4a-b201-7905aabfad1f admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:58.150415 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05159ee3-f20b-4d4a-b201-7905aabfad1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:58.151460 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05159ee3-f20b-4d4a-b201-7905aabfad1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:58.152318 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05159ee3-f20b-4d4a-b201-7905aabfad1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:58.154471 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05159ee3-f20b-4d4a-b201-7905aabfad1f admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:58.156440 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 839/1684] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:47:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:47:58.160993 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9dd8cd-da48-4f66-b2e9-ee300116c595 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:58.181262 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 846/1685] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:47:58.190689 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9dd8cd-da48-4f66-b2e9-ee300116c595 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:58.190797 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05159ee3-f20b-4d4a-b201-7905aabfad1f admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:58.200502 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dcc54f-bd52-4575-9a58-53b00875e74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:58.201147 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dcc54f-bd52-4575-9a58-53b00875e74e admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:58.201425 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dcc54f-bd52-4575-9a58-53b00875e74e admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:58.201697 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dcc54f-bd52-4575-9a58-53b00875e74e admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:58.202368 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dcc54f-bd52-4575-9a58-53b00875e74e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:58.204315 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dcc54f-bd52-4575-9a58-53b00875e74e admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:58.212604 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05159ee3-f20b-4d4a-b201-7905aabfad1f admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:58.225275 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936a41b-2431-44d2-b91c-a8d01f63f5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:58.226386 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936a41b-2431-44d2-b91c-a8d01f63f5ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:58.226676 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936a41b-2431-44d2-b91c-a8d01f63f5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:58.226999 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936a41b-2431-44d2-b91c-a8d01f63f5ba admin admin] PATH_INFO: `/v3/projects/e411961868da41ff85799c83d576d23b/users/8e27fe170efc486fae3be71f453166a6/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:58.229916 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0936a41b-2431-44d2-b91c-a8d01f63f5ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=e411961868da41ff85799c83d576d23b, user_id=8e27fe170efc486fae3be71f453166a6, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:58.232660 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0936a41b-2431-44d2-b91c-a8d01f63f5ba admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:58.271680 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 847/1686] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:47:58 2022] PUT /identity/v3/projects/e411961868da41ff85799c83d576d23b/users/8e27fe170efc486fae3be71f453166a6/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:47:58.271680 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936a41b-2431-44d2-b91c-a8d01f63f5ba admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:58.280908 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-0936a41b-2431-44d2-b91c-a8d01f63f5ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:58.322621 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 840/1687] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:47:58 2022] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:47:58.326989 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e07e9-646b-4821-b0e0-d706180e8d60 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:58.330166 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e07e9-646b-4821-b0e0-d706180e8d60 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:58.330316 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e07e9-646b-4821-b0e0-d706180e8d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:58.396218 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-5c2e07e9-646b-4821-b0e0-d706180e8d60 None None] MFA Rules not processed for user `8e27fe170efc486fae3be71f453166a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:47:58.397450 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-5c2e07e9-646b-4821-b0e0-d706180e8d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:58.454497 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936a41b-2431-44d2-b91c-a8d01f63f5ba admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:58.515973 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:47:58.589689 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 841/1688] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:47:58 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:47:58.590592 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e07e9-646b-4821-b0e0-d706180e8d60 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:58.623264 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464704e4-78b7-41d0-ac53-66684752e399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:58.624383 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464704e4-78b7-41d0-ac53-66684752e399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:58.624682 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464704e4-78b7-41d0-ac53-66684752e399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:58.624973 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464704e4-78b7-41d0-ac53-66684752e399 admin admin] PATH_INFO: `/v3/projects/34dbbdccba1b4f89824b22726aceeae2` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:58.627914 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464704e4-78b7-41d0-ac53-66684752e399 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34dbbdccba1b4f89824b22726aceeae2)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:58.630299 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464704e4-78b7-41d0-ac53-66684752e399 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:58.686794 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:47:58.730691 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e07e9-646b-4821-b0e0-d706180e8d60 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:58.739142 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0e7f34-b209-4a64-b21c-cce04dae8025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:58.739142 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e7f34-b209-4a64-b21c-cce04dae8025 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:58.739602 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e7f34-b209-4a64-b21c-cce04dae8025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:58.740828 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e7f34-b209-4a64-b21c-cce04dae8025 admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:58.741924 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0e7f34-b209-4a64-b21c-cce04dae8025 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:58.746548 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0e7f34-b209-4a64-b21c-cce04dae8025 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:58.788913 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-464704e4-78b7-41d0-ac53-66684752e399 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34dbbdccba1b4f89824b22726aceeae2', 'request_id': 'req-464704e4-78b7-41d0-ac53-66684752e399'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:47:58.852702 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 842/1689] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:47:58 2022] POST /identity/v3/users => generated 299 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:47:58.853607 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0e7f34-b209-4a64-b21c-cce04dae8025 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:58.856203 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-6f0e7f34-b209-4a64-b21c-cce04dae8025 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:58.864738 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-464704e4-78b7-41d0-ac53-66684752e399 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34dbbdccba1b4f89824b22726aceeae2', 'request_id': 'req-464704e4-78b7-41d0-ac53-66684752e399'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:47:58.873409 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-464704e4-78b7-41d0-ac53-66684752e399 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34dbbdccba1b4f89824b22726aceeae2', 'request_id': 'req-464704e4-78b7-41d0-ac53-66684752e399'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:47:58.902706 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-464704e4-78b7-41d0-ac53-66684752e399 admin admin] The token cache is being invalidate because project 34dbbdccba1b4f89824b22726aceeae2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:47:58.904945 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-464704e4-78b7-41d0-ac53-66684752e399 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:47:58.907368 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-464704e4-78b7-41d0-ac53-66684752e399 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:47:58.914159 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 848/1690] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:47:58 2022] DELETE /identity/v3/projects/34dbbdccba1b4f89824b22726aceeae2 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:47:58.916117 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464704e4-78b7-41d0-ac53-66684752e399 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:58.929998 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-464704e4-78b7-41d0-ac53-66684752e399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:58.954741 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0e7f34-b209-4a64-b21c-cce04dae8025 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:59.140496 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc1d6da-7c53-404a-9a03-519755c807a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:59.141264 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1d6da-7c53-404a-9a03-519755c807a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:59.143929 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1d6da-7c53-404a-9a03-519755c807a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:59.146036 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1d6da-7c53-404a-9a03-519755c807a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:59.157458 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-1dc1d6da-7c53-404a-9a03-519755c807a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:59.175975 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464704e4-78b7-41d0-ac53-66684752e399 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:59.187714 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f9f4c-e5a3-4a69-a99d-fa16265bb0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:59.188703 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f9f4c-e5a3-4a69-a99d-fa16265bb0fc admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:59.191258 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f9f4c-e5a3-4a69-a99d-fa16265bb0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:59.192181 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f9f4c-e5a3-4a69-a99d-fa16265bb0fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:59.194248 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f9f4c-e5a3-4a69-a99d-fa16265bb0fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:59.197851 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f9f4c-e5a3-4a69-a99d-fa16265bb0fc admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:59.236644 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 849/1691] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:47:58 2022] GET /identity/v3/roles => generated 1420 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:47:59.241884 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f9f4c-e5a3-4a69-a99d-fa16265bb0fc admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:59.246548 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-7c6f9f4c-e5a3-4a69-a99d-fa16265bb0fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:59.304133 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f9f4c-e5a3-4a69-a99d-fa16265bb0fc admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:59.306855 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:47:59.317836 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8038cc-e69d-4a0d-8296-c28eabffebfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:59.320096 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8038cc-e69d-4a0d-8296-c28eabffebfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:59.320096 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8038cc-e69d-4a0d-8296-c28eabffebfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:59.320815 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8038cc-e69d-4a0d-8296-c28eabffebfc admin admin] PATH_INFO: `/v3/users/412f8294d4fe4d7d80b5d9f117d4a1b5` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:59.323223 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8038cc-e69d-4a0d-8296-c28eabffebfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=412f8294d4fe4d7d80b5d9f117d4a1b5)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:59.333729 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8038cc-e69d-4a0d-8296-c28eabffebfc admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:59.379943 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc1d6da-7c53-404a-9a03-519755c807a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:59.386443 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc1d6da-7c53-404a-9a03-519755c807a6 service cinder] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:59.407955 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 843/1692] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:47:58 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:47:59.409019 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc1d6da-7c53-404a-9a03-519755c807a6 service cinder] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:59.431833 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc1d6da-7c53-404a-9a03-519755c807a6 service cinder] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:59.442630 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f4c1d4-66d4-4ddd-8289-9a4871906ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:59.445883 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4c1d4-66d4-4ddd-8289-9a4871906ede admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:59.446347 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4c1d4-66d4-4ddd-8289-9a4871906ede admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:59.446735 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4c1d4-66d4-4ddd-8289-9a4871906ede admin admin] PATH_INFO: `/v3/projects/b31c8b0154474d0fb2e62dcbab548bb2/users/888666d3c7e84e10b920419cad9ec379/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:59.489623 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f4c1d4-66d4-4ddd-8289-9a4871906ede admin admin] RBAC: Authorizing `identity:create_grant(project_id=b31c8b0154474d0fb2e62dcbab548bb2, user_id=888666d3c7e84e10b920419cad9ec379, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:59.496162 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f4c1d4-66d4-4ddd-8289-9a4871906ede admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:59.590202 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-8f8038cc-e69d-4a0d-8296-c28eabffebfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '412f8294d4fe4d7d80b5d9f117d4a1b5'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:47:59.632284 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 844/1693] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:47:59 2022] PUT /identity/v3/projects/b31c8b0154474d0fb2e62dcbab548bb2/users/888666d3c7e84e10b920419cad9ec379/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:47:59.635994 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f4c1d4-66d4-4ddd-8289-9a4871906ede admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:59.715087 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-8f8038cc-e69d-4a0d-8296-c28eabffebfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '412f8294d4fe4d7d80b5d9f117d4a1b5'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:47:59.727794 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-8f8038cc-e69d-4a0d-8296-c28eabffebfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '412f8294d4fe4d7d80b5d9f117d4a1b5'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:47:59.767250 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-8f8038cc-e69d-4a0d-8296-c28eabffebfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '412f8294d4fe4d7d80b5d9f117d4a1b5'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:47:59.769513 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-8f8038cc-e69d-4a0d-8296-c28eabffebfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '412f8294d4fe4d7d80b5d9f117d4a1b5'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:47:59.790466 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 850/1694] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:47:59 2022] DELETE /identity/v3/users/412f8294d4fe4d7d80b5d9f117d4a1b5 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:47:59.791786 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8038cc-e69d-4a0d-8296-c28eabffebfc admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:47:59.793372 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-8f8038cc-e69d-4a0d-8296-c28eabffebfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:59.804989 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f4c1d4-66d4-4ddd-8289-9a4871906ede admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:59.820545 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:47:59.934695 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8038cc-e69d-4a0d-8296-c28eabffebfc admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:47:59.953047 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94478f44-060c-45ae-a4de-9efe76f10a81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:59.954983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94478f44-060c-45ae-a4de-9efe76f10a81 service cinder] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:59.956486 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94478f44-060c-45ae-a4de-9efe76f10a81 service cinder] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:59.956869 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94478f44-060c-45ae-a4de-9efe76f10a81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:59.957771 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ddeab-5ee6-48bc-b1a0-e2ad2134612d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:47:59.959083 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ddeab-5ee6-48bc-b1a0-e2ad2134612d admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:47:59.961866 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ddeab-5ee6-48bc-b1a0-e2ad2134612d admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:47:59.961866 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ddeab-5ee6-48bc-b1a0-e2ad2134612d admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:47:59.961866 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ddeab-5ee6-48bc-b1a0-e2ad2134612d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:47:59.963755 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-94478f44-060c-45ae-a4de-9efe76f10a81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:47:59.968326 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ddeab-5ee6-48bc-b1a0-e2ad2134612d admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:47:59.998255 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 845/1695] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:48:00.000866 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ddeab-5ee6-48bc-b1a0-e2ad2134612d admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:00.004658 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-8a4ddeab-5ee6-48bc-b1a0-e2ad2134612d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:00.035069 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ddeab-5ee6-48bc-b1a0-e2ad2134612d admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:00.040358 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca4c09-adcf-4c5a-8c98-2de0180be330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:00.041174 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca4c09-adcf-4c5a-8c98-2de0180be330 admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:00.042099 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca4c09-adcf-4c5a-8c98-2de0180be330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:00.042446 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca4c09-adcf-4c5a-8c98-2de0180be330 admin admin] PATH_INFO: `/v3/projects/b31c8b0154474d0fb2e62dcbab548bb2/users/888666d3c7e84e10b920419cad9ec379/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:00.048308 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca4c09-adcf-4c5a-8c98-2de0180be330 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b31c8b0154474d0fb2e62dcbab548bb2, user_id=888666d3c7e84e10b920419cad9ec379, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:00.051937 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca4c09-adcf-4c5a-8c98-2de0180be330 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:00.065637 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 846/1696] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:47:59 2022] PUT /identity/v3/projects/b31c8b0154474d0fb2e62dcbab548bb2/users/888666d3c7e84e10b920419cad9ec379/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:48:00.085861 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc1aba-e0b1-4c91-9c8e-6deee10bbfde None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:00.085861 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc1aba-e0b1-4c91-9c8e-6deee10bbfde None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:00.086191 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc1aba-e0b1-4c91-9c8e-6deee10bbfde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:00.106579 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94478f44-060c-45ae-a4de-9efe76f10a81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:00.113339 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94478f44-060c-45ae-a4de-9efe76f10a81 service cinder] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:00.128877 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-c0fc1aba-e0b1-4c91-9c8e-6deee10bbfde None None] MFA Rules not processed for user `888666d3c7e84e10b920419cad9ec379`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:00.131422 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-c0fc1aba-e0b1-4c91-9c8e-6deee10bbfde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:00.138336 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 851/1697] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:47:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:48:00.201516 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:00.311103 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 847/1698] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:00 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:00.332846 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94478f44-060c-45ae-a4de-9efe76f10a81 service cinder] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:00.334438 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-94478f44-060c-45ae-a4de-9efe76f10a81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:00.353697 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94478f44-060c-45ae-a4de-9efe76f10a81 service cinder] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:00.477695 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc39e3e-006b-4a6f-a993-98b140708828 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:00.478351 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc39e3e-006b-4a6f-a993-98b140708828 service cinder] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:00.478635 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc39e3e-006b-4a6f-a993-98b140708828 service cinder] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:00.478934 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc39e3e-006b-4a6f-a993-98b140708828 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:00.506488 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc39e3e-006b-4a6f-a993-98b140708828 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:00.508190 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc39e3e-006b-4a6f-a993-98b140708828 service cinder] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:00.533556 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 852/1699] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:48:00 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:48:01.001304 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc1aba-e0b1-4c91-9c8e-6deee10bbfde None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:01.008217 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-c0fc1aba-e0b1-4c91-9c8e-6deee10bbfde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:01.226052 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc1aba-e0b1-4c91-9c8e-6deee10bbfde None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:01.233527 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceabda7-91f6-4e2d-8426-bd7900d7ed47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:01.234419 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceabda7-91f6-4e2d-8426-bd7900d7ed47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:01.234916 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceabda7-91f6-4e2d-8426-bd7900d7ed47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:01.235458 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceabda7-91f6-4e2d-8426-bd7900d7ed47 admin admin] PATH_INFO: `/v3/projects/494ee2ebe2674048bfe9c89387d67287` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:01.238636 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceabda7-91f6-4e2d-8426-bd7900d7ed47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=494ee2ebe2674048bfe9c89387d67287)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:01.243870 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceabda7-91f6-4e2d-8426-bd7900d7ed47 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:01.387923 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-bceabda7-91f6-4e2d-8426-bd7900d7ed47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '494ee2ebe2674048bfe9c89387d67287', 'request_id': 'req-bceabda7-91f6-4e2d-8426-bd7900d7ed47'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:01.487030 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-bceabda7-91f6-4e2d-8426-bd7900d7ed47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '494ee2ebe2674048bfe9c89387d67287', 'request_id': 'req-bceabda7-91f6-4e2d-8426-bd7900d7ed47'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:01.504336 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-bceabda7-91f6-4e2d-8426-bd7900d7ed47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '494ee2ebe2674048bfe9c89387d67287', 'request_id': 'req-bceabda7-91f6-4e2d-8426-bd7900d7ed47'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:01.577617 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-bceabda7-91f6-4e2d-8426-bd7900d7ed47 admin admin] The token cache is being invalidate because project 494ee2ebe2674048bfe9c89387d67287 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:48:01.577916 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-bceabda7-91f6-4e2d-8426-bd7900d7ed47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:01.583076 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-bceabda7-91f6-4e2d-8426-bd7900d7ed47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:01.588832 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 848/1700] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:48:00 2022] DELETE /identity/v3/projects/494ee2ebe2674048bfe9c89387d67287 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:48:01.607167 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f6f7d-aeb9-4cfc-b842-0f501aa8dbf3 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:01.620632 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f6f7d-aeb9-4cfc-b842-0f501aa8dbf3 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:01.620632 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f6f7d-aeb9-4cfc-b842-0f501aa8dbf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:01.662479 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-9e9f6f7d-aeb9-4cfc-b842-0f501aa8dbf3 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:01.668994 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-9e9f6f7d-aeb9-4cfc-b842-0f501aa8dbf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:01.785881 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 853/1701] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:01.797896 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5e72e-c03e-4de2-8e84-efff38bcdd63 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:01.798201 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5e72e-c03e-4de2-8e84-efff38bcdd63 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:01.798506 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5e72e-c03e-4de2-8e84-efff38bcdd63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:01.823849 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-cac5e72e-c03e-4de2-8e84-efff38bcdd63 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:01.825108 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-cac5e72e-c03e-4de2-8e84-efff38bcdd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:01.836448 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 849/1702] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:01.841261 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f6f7d-aeb9-4cfc-b842-0f501aa8dbf3 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:01.859251 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f6f7d-aeb9-4cfc-b842-0f501aa8dbf3 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:01.867635 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2378f-1809-4b3f-9048-ef9b733cef33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:01.868577 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2378f-1809-4b3f-9048-ef9b733cef33 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:01.869052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2378f-1809-4b3f-9048-ef9b733cef33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:01.869461 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2378f-1809-4b3f-9048-ef9b733cef33 admin admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:01.871410 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f2378f-1809-4b3f-9048-ef9b733cef33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:48:01.872533 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f2378f-1809-4b3f-9048-ef9b733cef33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:01.875989 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f2378f-1809-4b3f-9048-ef9b733cef33 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:01.883736 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:01.903901 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 854/1703] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:48:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:48:01.908390 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5e72e-c03e-4de2-8e84-efff38bcdd63 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:01.923968 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5e72e-c03e-4de2-8e84-efff38bcdd63 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:01.932585 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109bffd6-272f-4b39-825d-cb8e1909a195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:01.933734 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109bffd6-272f-4b39-825d-cb8e1909a195 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:01.934170 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109bffd6-272f-4b39-825d-cb8e1909a195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:01.934601 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109bffd6-272f-4b39-825d-cb8e1909a195 admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:01.935474 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109bffd6-272f-4b39-825d-cb8e1909a195 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:01.937711 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109bffd6-272f-4b39-825d-cb8e1909a195 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:02.079499 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 850/1704] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:48:01 2022] POST /identity/v3/projects => generated 381 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:48:02.084071 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2378f-1809-4b3f-9048-ef9b733cef33 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:02.099657 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2378f-1809-4b3f-9048-ef9b733cef33 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:02.284303 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c03726-e2dd-43e8-8b00-e2308ed5ab74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:02.284961 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c03726-e2dd-43e8-8b00-e2308ed5ab74 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:02.286267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c03726-e2dd-43e8-8b00-e2308ed5ab74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:02.286267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c03726-e2dd-43e8-8b00-e2308ed5ab74 admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:02.286267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c03726-e2dd-43e8-8b00-e2308ed5ab74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:02.308268 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c03726-e2dd-43e8-8b00-e2308ed5ab74 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:02.425438 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 855/1705] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:48:02 2022] POST /identity/v3/users => generated 291 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:48:02.429959 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109bffd6-272f-4b39-825d-cb8e1909a195 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:02.445902 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109bffd6-272f-4b39-825d-cb8e1909a195 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:02.457499 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051c262-8a68-426c-929a-46581922babf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:02.458152 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051c262-8a68-426c-929a-46581922babf admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:02.458435 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051c262-8a68-426c-929a-46581922babf admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:02.458709 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051c262-8a68-426c-929a-46581922babf admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:02.459603 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4051c262-8a68-426c-929a-46581922babf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:02.464205 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4051c262-8a68-426c-929a-46581922babf admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:02.500534 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c03726-e2dd-43e8-8b00-e2308ed5ab74 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:02.507673 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 851/1706] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:48:02.512295 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c03726-e2dd-43e8-8b00-e2308ed5ab74 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:02.521990 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8555e-0ff7-4a2e-843b-cfbcce43645d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:02.522634 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8555e-0ff7-4a2e-843b-cfbcce43645d admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:02.525224 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8555e-0ff7-4a2e-843b-cfbcce43645d admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:02.525224 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8555e-0ff7-4a2e-843b-cfbcce43645d admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:02.527779 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8555e-0ff7-4a2e-843b-cfbcce43645d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:02.529429 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8555e-0ff7-4a2e-843b-cfbcce43645d admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:02.568080 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 856/1707] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:48:02.569041 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051c262-8a68-426c-929a-46581922babf admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:02.592769 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051c262-8a68-426c-929a-46581922babf admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:02.612385 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f9dee0-cae5-40a9-83f3-a2deaa5b475b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:02.613102 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9dee0-cae5-40a9-83f3-a2deaa5b475b admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:02.613398 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9dee0-cae5-40a9-83f3-a2deaa5b475b admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:02.613705 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9dee0-cae5-40a9-83f3-a2deaa5b475b admin admin] PATH_INFO: `/v3/projects/beacfc5f793a4068bade0710858b5988/users/468ae41766394879bc9865ff195134a8/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:02.653806 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f9dee0-cae5-40a9-83f3-a2deaa5b475b admin admin] RBAC: Authorizing `identity:create_grant(project_id=beacfc5f793a4068bade0710858b5988, user_id=468ae41766394879bc9865ff195134a8, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:02.656766 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f9dee0-cae5-40a9-83f3-a2deaa5b475b admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:02.675315 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:02.733377 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c71224-a44e-4e02-8a60-ef1916978564 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:02.733916 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c71224-a44e-4e02-8a60-ef1916978564 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:02.733916 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c71224-a44e-4e02-8a60-ef1916978564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:02.757117 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 852/1708] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:48:02 2022] PUT /identity/v3/projects/beacfc5f793a4068bade0710858b5988/users/468ae41766394879bc9865ff195134a8/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:48:02.762989 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73d59b-7f1f-49fc-9b91-22bebd6abf9d None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:02.763312 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73d59b-7f1f-49fc-9b91-22bebd6abf9d None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:02.763588 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73d59b-7f1f-49fc-9b91-22bebd6abf9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:02.816559 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-05c71224-a44e-4e02-8a60-ef1916978564 None None] MFA Rules not processed for user `8f8ed7d12ca44a058ed8b888ca723b57`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:02.817874 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-05c71224-a44e-4e02-8a60-ef1916978564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:02.834842 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-0b73d59b-7f1f-49fc-9b91-22bebd6abf9d None None] MFA Rules not processed for user `468ae41766394879bc9865ff195134a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:02.836104 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-0b73d59b-7f1f-49fc-9b91-22bebd6abf9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:02.931097 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 853/1709] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:48:02.932363 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73d59b-7f1f-49fc-9b91-22bebd6abf9d None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:02.934070 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-0b73d59b-7f1f-49fc-9b91-22bebd6abf9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:02.979186 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 857/1710] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:02 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:48:02.980063 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c71224-a44e-4e02-8a60-ef1916978564 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:03.027089 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73d59b-7f1f-49fc-9b91-22bebd6abf9d None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:03.031821 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41cb30-0f6c-4342-92cb-b44b290a6166 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:03.031956 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41cb30-0f6c-4342-92cb-b44b290a6166 service cinder] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:03.032573 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41cb30-0f6c-4342-92cb-b44b290a6166 service cinder] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:03.033163 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41cb30-0f6c-4342-92cb-b44b290a6166 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:03.035961 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-7f41cb30-0f6c-4342-92cb-b44b290a6166 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:03.071165 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c71224-a44e-4e02-8a60-ef1916978564 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:03.075998 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd763a1-5832-46db-9da0-d0590db40a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:03.076724 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd763a1-5832-46db-9da0-d0590db40a9a admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:03.077083 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd763a1-5832-46db-9da0-d0590db40a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:03.077433 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd763a1-5832-46db-9da0-d0590db40a9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:03.078183 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd763a1-5832-46db-9da0-d0590db40a9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:03.080336 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd763a1-5832-46db-9da0-d0590db40a9a admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:03.092733 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:03.112215 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f41cb30-0f6c-4342-92cb-b44b290a6166 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:03.113947 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f41cb30-0f6c-4342-92cb-b44b290a6166 service cinder] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:03.126830 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 854/1711] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:48:02 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:48:03.128589 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e708dd-ecfa-4580-8d07-b7413e99023f None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:03.128959 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e708dd-ecfa-4580-8d07-b7413e99023f None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:03.129349 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e708dd-ecfa-4580-8d07-b7413e99023f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:03.152347 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-d6e708dd-ecfa-4580-8d07-b7413e99023f None None] MFA Rules not processed for user `8f8ed7d12ca44a058ed8b888ca723b57`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:03.154124 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-d6e708dd-ecfa-4580-8d07-b7413e99023f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:03.163116 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 855/1712] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:03 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:03.175480 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e708dd-ecfa-4580-8d07-b7413e99023f None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:03.177849 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-d6e708dd-ecfa-4580-8d07-b7413e99023f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:03.204114 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 858/1713] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:48:02 2022] POST /identity/v3/projects => generated 381 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:48:03.209030 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd763a1-5832-46db-9da0-d0590db40a9a admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:03.371663 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd763a1-5832-46db-9da0-d0590db40a9a admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:03.385150 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:03.398136 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312886f-3332-4e60-876e-4e2f999dfcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:03.398890 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312886f-3332-4e60-876e-4e2f999dfcc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:03.399192 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312886f-3332-4e60-876e-4e2f999dfcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:03.399407 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312886f-3332-4e60-876e-4e2f999dfcc2 admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:03.400088 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6312886f-3332-4e60-876e-4e2f999dfcc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:03.405174 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e708dd-ecfa-4580-8d07-b7413e99023f None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:03.407257 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6312886f-3332-4e60-876e-4e2f999dfcc2 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:03.516588 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 859/1714] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:48:03 2022] POST /identity/v3/users => generated 297 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:48:03.538091 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312886f-3332-4e60-876e-4e2f999dfcc2 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:03.554762 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312886f-3332-4e60-876e-4e2f999dfcc2 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:03.554993 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606aaa43-bbec-46e7-82f1-2e0e4a4bd3d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:03.556152 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606aaa43-bbec-46e7-82f1-2e0e4a4bd3d2 service nova] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:03.556999 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606aaa43-bbec-46e7-82f1-2e0e4a4bd3d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:03.557298 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606aaa43-bbec-46e7-82f1-2e0e4a4bd3d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:03.567878 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afef9f-6005-4162-9316-b6d4a5741031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:03.568523 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afef9f-6005-4162-9316-b6d4a5741031 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:03.568817 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afef9f-6005-4162-9316-b6d4a5741031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:03.569085 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afef9f-6005-4162-9316-b6d4a5741031 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:03.572158 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9afef9f-6005-4162-9316-b6d4a5741031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:03.576250 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9afef9f-6005-4162-9316-b6d4a5741031 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:03.599981 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 860/1715] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:48:03.608070 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afef9f-6005-4162-9316-b6d4a5741031 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:03.628503 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afef9f-6005-4162-9316-b6d4a5741031 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:03.649219 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66550c6-e809-438a-ae03-0e7a536ace03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:03.650567 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66550c6-e809-438a-ae03-0e7a536ace03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:03.652318 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66550c6-e809-438a-ae03-0e7a536ace03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:03.657620 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66550c6-e809-438a-ae03-0e7a536ace03 admin admin] PATH_INFO: `/v3/projects/9cff67a247fa4fe0b01fa640cd2405ba/users/ad3069d5735b4ba784e98fdc245a6885/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:03.668554 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606aaa43-bbec-46e7-82f1-2e0e4a4bd3d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:03.673728 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606aaa43-bbec-46e7-82f1-2e0e4a4bd3d2 service nova] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:03.696484 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66550c6-e809-438a-ae03-0e7a536ace03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cff67a247fa4fe0b01fa640cd2405ba, user_id=ad3069d5735b4ba784e98fdc245a6885, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:03.700381 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66550c6-e809-438a-ae03-0e7a536ace03 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:03.717167 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 856/1716] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:48:03 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:48:03.772157 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 861/1717] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:48:03 2022] PUT /identity/v3/projects/9cff67a247fa4fe0b01fa640cd2405ba/users/ad3069d5735b4ba784e98fdc245a6885/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:48:03.775192 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606aaa43-bbec-46e7-82f1-2e0e4a4bd3d2 service nova] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:03.796813 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606aaa43-bbec-46e7-82f1-2e0e4a4bd3d2 service nova] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:03.962746 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4c56b-e13a-4051-a06b-517a8a9b2923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:03.963182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4c56b-e13a-4051-a06b-517a8a9b2923 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:03.963848 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4c56b-e13a-4051-a06b-517a8a9b2923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:03.963848 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4c56b-e13a-4051-a06b-517a8a9b2923 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:03.964457 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4c56b-e13a-4051-a06b-517a8a9b2923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:03.966104 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4c56b-e13a-4051-a06b-517a8a9b2923 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:03.999417 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 857/1718] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:48:04.004427 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66550c6-e809-438a-ae03-0e7a536ace03 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:04.016387 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66550c6-e809-438a-ae03-0e7a536ace03 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:04.025018 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fda9bc-86d9-4f01-8cd7-b91a08230f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:04.030153 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fda9bc-86d9-4f01-8cd7-b91a08230f67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:04.030153 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fda9bc-86d9-4f01-8cd7-b91a08230f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:04.030550 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fda9bc-86d9-4f01-8cd7-b91a08230f67 admin admin] PATH_INFO: `/v3/projects/9cff67a247fa4fe0b01fa640cd2405ba/users/ad3069d5735b4ba784e98fdc245a6885/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:04.039756 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fda9bc-86d9-4f01-8cd7-b91a08230f67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cff67a247fa4fe0b01fa640cd2405ba, user_id=ad3069d5735b4ba784e98fdc245a6885, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:04.046868 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fda9bc-86d9-4f01-8cd7-b91a08230f67 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:04.076374 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 862/1719] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:48:04 2022] PUT /identity/v3/projects/9cff67a247fa4fe0b01fa640cd2405ba/users/ad3069d5735b4ba784e98fdc245a6885/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:48:04.092878 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84591eb-7f31-4d1e-ab7a-925d8fc04f03 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:04.093154 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84591eb-7f31-4d1e-ab7a-925d8fc04f03 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:04.093556 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84591eb-7f31-4d1e-ab7a-925d8fc04f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:04.114105 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:04.153006 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-d84591eb-7f31-4d1e-ab7a-925d8fc04f03 None None] MFA Rules not processed for user `ad3069d5735b4ba784e98fdc245a6885`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:04.154562 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-d84591eb-7f31-4d1e-ab7a-925d8fc04f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:04.312889 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 858/1720] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:04 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:04.683849 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad356f1-4fc6-4c67-aa26-53bc2e01654c None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:04.684139 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad356f1-4fc6-4c67-aa26-53bc2e01654c None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:04.684423 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad356f1-4fc6-4c67-aa26-53bc2e01654c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:04.693143 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768f4fb-a8d5-4abb-870c-b05ef674cf68 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:04.693432 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768f4fb-a8d5-4abb-870c-b05ef674cf68 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:04.693706 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768f4fb-a8d5-4abb-870c-b05ef674cf68 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:04.696229 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 859/1721] 10.222.0.42 () {54 vars in 912 bytes} [Fri Aug 5 02:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:48:04.717347 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60dcf90-8102-48b8-a28f-5b53df63200f None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:04.725190 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60dcf90-8102-48b8-a28f-5b53df63200f None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:04.725190 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60dcf90-8102-48b8-a28f-5b53df63200f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:04.764744 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-3ad356f1-4fc6-4c67-aa26-53bc2e01654c None None] MFA Rules not processed for user `4033953c81e5494ea03a7031df9ddcc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:04.770378 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-3ad356f1-4fc6-4c67-aa26-53bc2e01654c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:04.809509 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-e60dcf90-8102-48b8-a28f-5b53df63200f None None] MFA Rules not processed for user `a0035fcd8b06400bb7946f7ac37393a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:04.812493 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-e60dcf90-8102-48b8-a28f-5b53df63200f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:04.943973 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 860/1722] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Aug 5 02:48:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:48:04.965337 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60dcf90-8102-48b8-a28f-5b53df63200f None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:04.974039 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-e60dcf90-8102-48b8-a28f-5b53df63200f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:04.990870 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60dcf90-8102-48b8-a28f-5b53df63200f None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:05.005333 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd6cce-ef1d-4166-900f-728a8f777089 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:05.005333 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd6cce-ef1d-4166-900f-728a8f777089 service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:05.005333 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd6cce-ef1d-4166-900f-728a8f777089 service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:05.005333 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd6cce-ef1d-4166-900f-728a8f777089 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:05.019190 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bd6cce-ef1d-4166-900f-728a8f777089 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:05.021768 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bd6cce-ef1d-4166-900f-728a8f777089 service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:05.029796 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 863/1723] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:05.045907 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 861/1724] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:48:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:48:05.062037 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad356f1-4fc6-4c67-aa26-53bc2e01654c None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:05.064024 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-3ad356f1-4fc6-4c67-aa26-53bc2e01654c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:05.110409 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:05.283552 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad356f1-4fc6-4c67-aa26-53bc2e01654c None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:05.297510 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa7115-caa3-4f27-866b-f6af1f968ec0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:05.298637 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa7115-caa3-4f27-866b-f6af1f968ec0 service nova] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:05.299722 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa7115-caa3-4f27-866b-f6af1f968ec0 service nova] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:05.300209 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa7115-caa3-4f27-866b-f6af1f968ec0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:05.320111 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa7115-caa3-4f27-866b-f6af1f968ec0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:05.321981 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa7115-caa3-4f27-866b-f6af1f968ec0 service nova] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:05.358856 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 864/1725] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:48:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:48:06.018862 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9009774-c2ad-45a4-9ef2-5ae154f6d171 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:06.018862 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9009774-c2ad-45a4-9ef2-5ae154f6d171 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:06.018862 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9009774-c2ad-45a4-9ef2-5ae154f6d171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:06.110744 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-c9009774-c2ad-45a4-9ef2-5ae154f6d171 None None] MFA Rules not processed for user `ae630508f5284c8296ba67519c59d8b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:06.115206 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-c9009774-c2ad-45a4-9ef2-5ae154f6d171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:06.313108 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5f1a1-dff6-4ddd-8d3a-632e65fda66f None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:06.318161 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5f1a1-dff6-4ddd-8d3a-632e65fda66f None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:06.318161 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5f1a1-dff6-4ddd-8d3a-632e65fda66f None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:06.318161 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 865/1726] 10.222.0.42 () {54 vars in 961 bytes} [Fri Aug 5 02:48:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:48:06.324863 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24afb7-075a-4350-bf73-c629e4b31d65 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:06.325143 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24afb7-075a-4350-bf73-c629e4b31d65 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:06.325645 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24afb7-075a-4350-bf73-c629e4b31d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:06.368446 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 862/1727] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:06.381462 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f193ff7-fe99-4ab9-9239-6ff17354c860 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:06.382063 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f193ff7-fe99-4ab9-9239-6ff17354c860 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:06.383697 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f193ff7-fe99-4ab9-9239-6ff17354c860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:06.435670 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-6e24afb7-075a-4350-bf73-c629e4b31d65 None None] MFA Rules not processed for user `8b647f2cb18a41d6a9e124e886faa994`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:06.442542 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-6e24afb7-075a-4350-bf73-c629e4b31d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:06.443049 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:06.484167 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-8f193ff7-fe99-4ab9-9239-6ff17354c860 None None] MFA Rules not processed for user `ae630508f5284c8296ba67519c59d8b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:06.485475 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-8f193ff7-fe99-4ab9-9239-6ff17354c860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:06.548072 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 863/1728] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:06.560508 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f193ff7-fe99-4ab9-9239-6ff17354c860 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:06.597595 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f193ff7-fe99-4ab9-9239-6ff17354c860 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:06.625109 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0703bcf6-5bc8-45ca-8e15-f3a728e5a826 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:06.626607 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703bcf6-5bc8-45ca-8e15-f3a728e5a826 service nova] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:06.626607 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703bcf6-5bc8-45ca-8e15-f3a728e5a826 service nova] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:06.626607 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703bcf6-5bc8-45ca-8e15-f3a728e5a826 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:06.661521 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0703bcf6-5bc8-45ca-8e15-f3a728e5a826 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:06.663454 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0703bcf6-5bc8-45ca-8e15-f3a728e5a826 service nova] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:06.673455 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 866/1729] 10.222.0.42 () {58 vars in 1058 bytes} [Fri Aug 5 02:48:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:06.679338 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b0f3b-366a-46a3-8109-b6827e64c249 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:06.679747 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b0f3b-366a-46a3-8109-b6827e64c249 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:06.680050 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b0f3b-366a-46a3-8109-b6827e64c249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:06.707133 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 864/1730] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:48:06 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:48:06.708130 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0703bcf6-5bc8-45ca-8e15-f3a728e5a826 service nova] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:06.728494 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-f28b0f3b-366a-46a3-8109-b6827e64c249 None None] MFA Rules not processed for user `8f8ed7d12ca44a058ed8b888ca723b57`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:06.733054 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-f28b0f3b-366a-46a3-8109-b6827e64c249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:06.745515 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0703bcf6-5bc8-45ca-8e15-f3a728e5a826 service nova] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:06.759639 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2755775e-3f4c-4357-96e2-6b48c1cce45a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647f2cb18a41d6a9e124e886faa994', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:06.760277 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755775e-3f4c-4357-96e2-6b48c1cce45a service placement] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:06.760560 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755775e-3f4c-4357-96e2-6b48c1cce45a service placement] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:06.760836 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755775e-3f4c-4357-96e2-6b48c1cce45a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:06.769102 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-2755775e-3f4c-4357-96e2-6b48c1cce45a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:06.809710 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2755775e-3f4c-4357-96e2-6b48c1cce45a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:06.811425 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2755775e-3f4c-4357-96e2-6b48c1cce45a service placement] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:06.852344 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 865/1731] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:48:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:48:06.911679 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 867/1732] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:06 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:07.559949 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b0f0c-395d-4a60-99d5-01ee9a44825b None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:07.559949 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b0f0c-395d-4a60-99d5-01ee9a44825b None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:07.559949 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b0f0c-395d-4a60-99d5-01ee9a44825b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:07.617188 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-a52b0f0c-395d-4a60-99d5-01ee9a44825b None None] MFA Rules not processed for user `16970234a29e41cf8639b6ffc1aeadaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:07.618711 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-a52b0f0c-395d-4a60-99d5-01ee9a44825b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:07.776278 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 866/1733] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:07 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:08.558175 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70037942-5335-4919-9c3d-130a73f7c5c7 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:08.560178 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70037942-5335-4919-9c3d-130a73f7c5c7 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:08.560683 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70037942-5335-4919-9c3d-130a73f7c5c7 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:08.563032 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 868/1734] 10.222.0.42 () {54 vars in 912 bytes} [Fri Aug 5 02:48:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:48:08.568680 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a66984-ab58-4189-9734-5304d1b6042a None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:08.569999 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a66984-ab58-4189-9734-5304d1b6042a None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:08.569999 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a66984-ab58-4189-9734-5304d1b6042a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:08.608207 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-13a66984-ab58-4189-9734-5304d1b6042a None None] MFA Rules not processed for user `a0035fcd8b06400bb7946f7ac37393a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:08.612526 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-13a66984-ab58-4189-9734-5304d1b6042a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:08.629404 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 867/1735] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Aug 5 02:48:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:08.690548 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70037942-5335-4919-9c3d-130a73f7c5c7 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:08.709206 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70037942-5335-4919-9c3d-130a73f7c5c7 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:08.728437 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6568a-f17c-4344-80dc-59515d470c5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:08.729403 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6568a-f17c-4344-80dc-59515d470c5f service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:08.729965 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6568a-f17c-4344-80dc-59515d470c5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:08.730376 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6568a-f17c-4344-80dc-59515d470c5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:08.751806 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f6568a-f17c-4344-80dc-59515d470c5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:08.756727 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f6568a-f17c-4344-80dc-59515d470c5f service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:08.781940 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 869/1736] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:48:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:48:09.190013 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a66984-ab58-4189-9734-5304d1b6042a None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:09.214158 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a66984-ab58-4189-9734-5304d1b6042a None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:09.228771 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19662a1-208c-40f2-a07e-f27c87dfb8ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:09.229505 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19662a1-208c-40f2-a07e-f27c87dfb8ab service nova] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:09.229833 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19662a1-208c-40f2-a07e-f27c87dfb8ab service nova] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:09.230120 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19662a1-208c-40f2-a07e-f27c87dfb8ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:09.252384 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19662a1-208c-40f2-a07e-f27c87dfb8ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:09.259076 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19662a1-208c-40f2-a07e-f27c87dfb8ab service nova] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:09.292881 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 868/1737] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:48:09 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:48:09.864271 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6568a-f17c-4344-80dc-59515d470c5f service neutron] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:09.866321 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-78f6568a-f17c-4344-80dc-59515d470c5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:09.953902 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:09.999917 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6568a-f17c-4344-80dc-59515d470c5f service neutron] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:10.012677 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739e933-023d-45a0-85bc-73b877529929 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:10.018756 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739e933-023d-45a0-85bc-73b877529929 service cinder] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:10.020315 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739e933-023d-45a0-85bc-73b877529929 service cinder] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:10.026168 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739e933-023d-45a0-85bc-73b877529929 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:10.026662 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-c739e933-023d-45a0-85bc-73b877529929 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:10.165541 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739e933-023d-45a0-85bc-73b877529929 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:10.170805 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739e933-023d-45a0-85bc-73b877529929 service cinder] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:10.199448 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 870/1738] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:48:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:48:10.672808 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04910072-c5cf-4354-8032-8ba1a25e350e None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:10.674376 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04910072-c5cf-4354-8032-8ba1a25e350e None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:10.674832 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04910072-c5cf-4354-8032-8ba1a25e350e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:10.738602 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-04910072-c5cf-4354-8032-8ba1a25e350e None None] MFA Rules not processed for user `526cd8eb496f4389a52dd557306dd314`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:10.739884 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-04910072-c5cf-4354-8032-8ba1a25e350e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:10.963682 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 869/1739] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:10.979853 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739e933-023d-45a0-85bc-73b877529929 service cinder] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:10.999550 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739e933-023d-45a0-85bc-73b877529929 service cinder] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:11.008811 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59feac48-da08-4dac-9765-0293fed1ae1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:11.009925 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59feac48-da08-4dac-9765-0293fed1ae1a service nova] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:11.010463 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59feac48-da08-4dac-9765-0293fed1ae1a service nova] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:11.010837 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59feac48-da08-4dac-9765-0293fed1ae1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:11.020858 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59feac48-da08-4dac-9765-0293fed1ae1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:11.022677 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59feac48-da08-4dac-9765-0293fed1ae1a service nova] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:11.036386 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 871/1740] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:48:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:48:12.200618 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cab33-4a44-4c18-b296-37349d0d301e None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:12.201421 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cab33-4a44-4c18-b296-37349d0d301e None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:12.201840 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cab33-4a44-4c18-b296-37349d0d301e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:12.304202 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:12.325310 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-f90cab33-4a44-4c18-b296-37349d0d301e None None] MFA Rules not processed for user `6bea520676244effbbe212aa62b1cc68`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:12.327659 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-f90cab33-4a44-4c18-b296-37349d0d301e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:12.428698 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 870/1741] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Aug 5 02:48:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:13.013003 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cab33-4a44-4c18-b296-37349d0d301e None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:13.014117 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8657192-acf1-418d-83c7-fbb2ce8c5295 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:13.015451 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8657192-acf1-418d-83c7-fbb2ce8c5295 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:13.016405 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8657192-acf1-418d-83c7-fbb2ce8c5295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:13.016920 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-f90cab33-4a44-4c18-b296-37349d0d301e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:13.096350 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-f8657192-acf1-418d-83c7-fbb2ce8c5295 None None] MFA Rules not processed for user `4033953c81e5494ea03a7031df9ddcc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:13.099550 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-f8657192-acf1-418d-83c7-fbb2ce8c5295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:13.129530 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 872/1742] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:13.352392 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cab33-4a44-4c18-b296-37349d0d301e None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:13.380892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824f72a-7361-47c7-8879-c5669955184d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40f706f1eb2b4137afd367cb5060ced0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:13.382493 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824f72a-7361-47c7-8879-c5669955184d service swift] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:13.383031 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824f72a-7361-47c7-8879-c5669955184d service swift] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:13.383645 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824f72a-7361-47c7-8879-c5669955184d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:13.400982 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a824f72a-7361-47c7-8879-c5669955184d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:13.404629 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a824f72a-7361-47c7-8879-c5669955184d service swift] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:13.450099 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 871/1743] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 5 02:48:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 02:48:13.808160 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8657192-acf1-418d-83c7-fbb2ce8c5295 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:13.812374 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-f8657192-acf1-418d-83c7-fbb2ce8c5295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:14.183314 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8657192-acf1-418d-83c7-fbb2ce8c5295 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:14.206537 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495aa808-c293-4de1-b7c3-86f86de64609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:14.207539 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495aa808-c293-4de1-b7c3-86f86de64609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:14.207956 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495aa808-c293-4de1-b7c3-86f86de64609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:14.213577 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495aa808-c293-4de1-b7c3-86f86de64609 admin admin] PATH_INFO: `/v3/users/ccdb55fa60e741b69e02707bc71ccda9` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:14.236209 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495aa808-c293-4de1-b7c3-86f86de64609 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccdb55fa60e741b69e02707bc71ccda9)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:14.238445 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495aa808-c293-4de1-b7c3-86f86de64609 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:14.239013 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f59eb9-0937-4839-ace5-574d57b62688 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:14.239259 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f59eb9-0937-4839-ace5-574d57b62688 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:14.239555 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f59eb9-0937-4839-ace5-574d57b62688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:14.324588 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-a4f59eb9-0937-4839-ace5-574d57b62688 None None] MFA Rules not processed for user `a0035fcd8b06400bb7946f7ac37393a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:14.325842 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-a4f59eb9-0937-4839-ace5-574d57b62688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:14.381492 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 872/1744] 10.222.0.44 () {58 vars in 1015 bytes} [Fri Aug 5 02:48:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:14.507474 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f59eb9-0937-4839-ace5-574d57b62688 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:14.521103 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f59eb9-0937-4839-ace5-574d57b62688 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:14.539874 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b360dcdb-ae90-4242-bb28-67db23445336 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:14.540884 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360dcdb-ae90-4242-bb28-67db23445336 service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:14.541335 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360dcdb-ae90-4242-bb28-67db23445336 service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:14.541769 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360dcdb-ae90-4242-bb28-67db23445336 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:14.575115 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b360dcdb-ae90-4242-bb28-67db23445336 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:14.578857 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-495aa808-c293-4de1-b7c3-86f86de64609 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccdb55fa60e741b69e02707bc71ccda9'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:14.579920 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b360dcdb-ae90-4242-bb28-67db23445336 service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:14.643385 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 873/1745] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:48:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:48:14.676070 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-495aa808-c293-4de1-b7c3-86f86de64609 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccdb55fa60e741b69e02707bc71ccda9'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:14.699711 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-495aa808-c293-4de1-b7c3-86f86de64609 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccdb55fa60e741b69e02707bc71ccda9'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:14.709783 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:14.735674 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-495aa808-c293-4de1-b7c3-86f86de64609 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccdb55fa60e741b69e02707bc71ccda9'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:14.737547 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-495aa808-c293-4de1-b7c3-86f86de64609 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccdb55fa60e741b69e02707bc71ccda9'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:14.754373 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 873/1746] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:48:13 2022] DELETE /identity/v3/users/ccdb55fa60e741b69e02707bc71ccda9 => generated 0 bytes in 942 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:48:14.756378 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66fc58b-feb3-4bc4-9fce-5c74749a8ee3 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:14.756698 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66fc58b-feb3-4bc4-9fce-5c74749a8ee3 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:14.763161 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66fc58b-feb3-4bc4-9fce-5c74749a8ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:14.829430 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-b66fc58b-feb3-4bc4-9fce-5c74749a8ee3 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:14.830818 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-b66fc58b-feb3-4bc4-9fce-5c74749a8ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:14.999458 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:15.035199 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 874/1747] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:15.160876 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495aa808-c293-4de1-b7c3-86f86de64609 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:15.163129 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-495aa808-c293-4de1-b7c3-86f86de64609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:15.361903 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495aa808-c293-4de1-b7c3-86f86de64609 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:15.388362 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca1f54-0b4c-4a17-b947-b3ae869d47da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:15.388362 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca1f54-0b4c-4a17-b947-b3ae869d47da service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:15.388362 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca1f54-0b4c-4a17-b947-b3ae869d47da service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:15.388362 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca1f54-0b4c-4a17-b947-b3ae869d47da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:15.425882 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca1f54-0b4c-4a17-b947-b3ae869d47da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:15.428469 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca1f54-0b4c-4a17-b947-b3ae869d47da service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:15.480214 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 874/1748] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:48:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:48:16.304012 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66fc58b-feb3-4bc4-9fce-5c74749a8ee3 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:16.305862 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-b66fc58b-feb3-4bc4-9fce-5c74749a8ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:16.320974 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca1f54-0b4c-4a17-b947-b3ae869d47da service neutron] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:16.322898 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-fbca1f54-0b4c-4a17-b947-b3ae869d47da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:16.368099 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca1f54-0b4c-4a17-b947-b3ae869d47da service neutron] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:16.387174 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d353534-730b-46eb-a0d0-bb4872d6956e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:16.391227 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d353534-730b-46eb-a0d0-bb4872d6956e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:16.391227 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d353534-730b-46eb-a0d0-bb4872d6956e admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:16.391227 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d353534-730b-46eb-a0d0-bb4872d6956e admin admin] PATH_INFO: `/v3/users/c668306b2a94444084fbbd41f09e1135` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:16.391227 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d353534-730b-46eb-a0d0-bb4872d6956e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c668306b2a94444084fbbd41f09e1135)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:16.393663 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d353534-730b-46eb-a0d0-bb4872d6956e admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:16.451599 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66fc58b-feb3-4bc4-9fce-5c74749a8ee3 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:16.462533 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a5047-0ca1-48ac-a1ae-52afde23383a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:16.465931 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a5047-0ca1-48ac-a1ae-52afde23383a service cinder] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:16.465931 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a5047-0ca1-48ac-a1ae-52afde23383a service cinder] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:16.465931 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a5047-0ca1-48ac-a1ae-52afde23383a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:16.467000 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-fb1a5047-0ca1-48ac-a1ae-52afde23383a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:16.636584 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a5047-0ca1-48ac-a1ae-52afde23383a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:16.637209 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-5d353534-730b-46eb-a0d0-bb4872d6956e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c668306b2a94444084fbbd41f09e1135'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:16.639736 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a5047-0ca1-48ac-a1ae-52afde23383a service cinder] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:16.662242 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 875/1749] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:48:16 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:48:16.664213 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29edc34e-e9d6-45ff-b8d7-fcf0fbf97edc None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:16.665493 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29edc34e-e9d6-45ff-b8d7-fcf0fbf97edc None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:16.666629 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29edc34e-e9d6-45ff-b8d7-fcf0fbf97edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:16.702684 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-29edc34e-e9d6-45ff-b8d7-fcf0fbf97edc None None] MFA Rules not processed for user `16970234a29e41cf8639b6ffc1aeadaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:16.704205 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-29edc34e-e9d6-45ff-b8d7-fcf0fbf97edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:16.714424 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-5d353534-730b-46eb-a0d0-bb4872d6956e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c668306b2a94444084fbbd41f09e1135'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:16.725435 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-5d353534-730b-46eb-a0d0-bb4872d6956e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c668306b2a94444084fbbd41f09e1135'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:16.786348 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-5d353534-730b-46eb-a0d0-bb4872d6956e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c668306b2a94444084fbbd41f09e1135'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:16.791364 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-5d353534-730b-46eb-a0d0-bb4872d6956e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c668306b2a94444084fbbd41f09e1135'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:16.807552 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 875/1750] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:48:16 2022] DELETE /identity/v3/users/c668306b2a94444084fbbd41f09e1135 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:48:16.812730 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2387be2-27c6-4b15-984d-fee3c18b8ec2 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:16.814247 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2387be2-27c6-4b15-984d-fee3c18b8ec2 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:16.814247 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2387be2-27c6-4b15-984d-fee3c18b8ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:16.877896 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-b2387be2-27c6-4b15-984d-fee3c18b8ec2 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:16.880741 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-b2387be2-27c6-4b15-984d-fee3c18b8ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:16.915462 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 876/1751] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:16 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:17.072133 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 876/1752] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:17.121563 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29edc34e-e9d6-45ff-b8d7-fcf0fbf97edc None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:17.131802 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-29edc34e-e9d6-45ff-b8d7-fcf0fbf97edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:17.150536 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29edc34e-e9d6-45ff-b8d7-fcf0fbf97edc None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:17.289646 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3674edd-6f9d-4377-a730-07242419bfe7 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:17.290265 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3674edd-6f9d-4377-a730-07242419bfe7 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:17.290932 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3674edd-6f9d-4377-a730-07242419bfe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:17.322787 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:17.336344 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cdd1f2-8848-4215-833e-27dde9481597 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:17.336344 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cdd1f2-8848-4215-833e-27dde9481597 service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:17.336344 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cdd1f2-8848-4215-833e-27dde9481597 service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:17.336344 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cdd1f2-8848-4215-833e-27dde9481597 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:17.343225 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:17.376799 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cdd1f2-8848-4215-833e-27dde9481597 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:17.379268 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cdd1f2-8848-4215-833e-27dde9481597 service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:17.410122 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-f3674edd-6f9d-4377-a730-07242419bfe7 None None] MFA Rules not processed for user `526cd8eb496f4389a52dd557306dd314`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:17.415698 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-f3674edd-6f9d-4377-a730-07242419bfe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:17.435317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 877/1753] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:48:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:48:17.559903 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 877/1754] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:17.840650 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cdd1f2-8848-4215-833e-27dde9481597 service neutron] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:17.842515 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-b4cdd1f2-8848-4215-833e-27dde9481597 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:17.929475 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cdd1f2-8848-4215-833e-27dde9481597 service neutron] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:17.965938 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9422af-cd8e-4d97-b75d-eb566697ca6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:17.966978 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9422af-cd8e-4d97-b75d-eb566697ca6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:17.967321 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9422af-cd8e-4d97-b75d-eb566697ca6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:17.967660 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9422af-cd8e-4d97-b75d-eb566697ca6a admin admin] PATH_INFO: `/v3/projects/a2d8d6762ffe45a0852d548466fe0bda` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:17.971052 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9422af-cd8e-4d97-b75d-eb566697ca6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2d8d6762ffe45a0852d548466fe0bda)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:17.974693 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9422af-cd8e-4d97-b75d-eb566697ca6a admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:18.080351 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3674edd-6f9d-4377-a730-07242419bfe7 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:18.082924 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-f3674edd-6f9d-4377-a730-07242419bfe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:18.293511 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-5b9422af-cd8e-4d97-b75d-eb566697ca6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2d8d6762ffe45a0852d548466fe0bda', 'request_id': 'req-5b9422af-cd8e-4d97-b75d-eb566697ca6a'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:18.321662 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3674edd-6f9d-4377-a730-07242419bfe7 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:18.381098 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-5b9422af-cd8e-4d97-b75d-eb566697ca6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2d8d6762ffe45a0852d548466fe0bda', 'request_id': 'req-5b9422af-cd8e-4d97-b75d-eb566697ca6a'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:18.407726 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-5b9422af-cd8e-4d97-b75d-eb566697ca6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2d8d6762ffe45a0852d548466fe0bda', 'request_id': 'req-5b9422af-cd8e-4d97-b75d-eb566697ca6a'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:18.436785 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e37ae-7d4b-411a-9557-a24448c6df13 tempest-VolumeQuotaClassesTest-1047447097 tempest-VolumeQuotaClassesTest-1047447097-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3069d5735b4ba784e98fdc245a6885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cff67a247fa4fe0b01fa640cd2405ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:18.437433 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e37ae-7d4b-411a-9557-a24448c6df13 tempest-VolumeQuotaClassesTest-1047447097 tempest-VolumeQuotaClassesTest-1047447097-project-admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:18.437719 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e37ae-7d4b-411a-9557-a24448c6df13 tempest-VolumeQuotaClassesTest-1047447097 tempest-VolumeQuotaClassesTest-1047447097-project-admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:18.437996 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e37ae-7d4b-411a-9557-a24448c6df13 tempest-VolumeQuotaClassesTest-1047447097 tempest-VolumeQuotaClassesTest-1047447097-project-admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:18.439618 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e37ae-7d4b-411a-9557-a24448c6df13 tempest-VolumeQuotaClassesTest-1047447097 tempest-VolumeQuotaClassesTest-1047447097-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:48:18.444932 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e37ae-7d4b-411a-9557-a24448c6df13 tempest-VolumeQuotaClassesTest-1047447097 tempest-VolumeQuotaClassesTest-1047447097-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:18.444932 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e37ae-7d4b-411a-9557-a24448c6df13 tempest-VolumeQuotaClassesTest-1047447097 tempest-VolumeQuotaClassesTest-1047447097-project-admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:18.473865 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-5b9422af-cd8e-4d97-b75d-eb566697ca6a admin admin] The token cache is being invalidate because project a2d8d6762ffe45a0852d548466fe0bda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:48:18.473865 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-5b9422af-cd8e-4d97-b75d-eb566697ca6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:18.474034 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 878/1755] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:48:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:48:18.474034 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e37ae-7d4b-411a-9557-a24448c6df13 tempest-VolumeQuotaClassesTest-1047447097 tempest-VolumeQuotaClassesTest-1047447097-project-admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:18.496881 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e37ae-7d4b-411a-9557-a24448c6df13 tempest-VolumeQuotaClassesTest-1047447097 tempest-VolumeQuotaClassesTest-1047447097-project-admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:18.507191 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-5b9422af-cd8e-4d97-b75d-eb566697ca6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:18.513713 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 878/1756] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:48:17 2022] DELETE /identity/v3/projects/a2d8d6762ffe45a0852d548466fe0bda => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:48:18.524068 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9422af-cd8e-4d97-b75d-eb566697ca6a admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:18.530857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-5b9422af-cd8e-4d97-b75d-eb566697ca6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:18.531286 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716e99c-05d5-41f8-9561-92cdf1517be0 tempest-VolumeQuotaClassesTest-1047447097 tempest-VolumeQuotaClassesTest-1047447097-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3069d5735b4ba784e98fdc245a6885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cff67a247fa4fe0b01fa640cd2405ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:18.541076 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716e99c-05d5-41f8-9561-92cdf1517be0 tempest-VolumeQuotaClassesTest-1047447097 tempest-VolumeQuotaClassesTest-1047447097-project-admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:18.547355 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716e99c-05d5-41f8-9561-92cdf1517be0 tempest-VolumeQuotaClassesTest-1047447097 tempest-VolumeQuotaClassesTest-1047447097-project-admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:18.547738 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716e99c-05d5-41f8-9561-92cdf1517be0 tempest-VolumeQuotaClassesTest-1047447097 tempest-VolumeQuotaClassesTest-1047447097-project-admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:18.554216 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e716e99c-05d5-41f8-9561-92cdf1517be0 tempest-VolumeQuotaClassesTest-1047447097 tempest-VolumeQuotaClassesTest-1047447097-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:18.567572 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e716e99c-05d5-41f8-9561-92cdf1517be0 tempest-VolumeQuotaClassesTest-1047447097 tempest-VolumeQuotaClassesTest-1047447097-project-admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:18.777904 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 879/1757] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:48:18 2022] POST /identity/v3/projects => generated 353 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:48:18.780007 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716e99c-05d5-41f8-9561-92cdf1517be0 tempest-VolumeQuotaClassesTest-1047447097 tempest-VolumeQuotaClassesTest-1047447097-project-admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:18.785283 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-e716e99c-05d5-41f8-9561-92cdf1517be0 tempest-VolumeQuotaClassesTest-1047447097 tempest-VolumeQuotaClassesTest-1047447097-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:18.816891 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9422af-cd8e-4d97-b75d-eb566697ca6a admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:18.909543 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:19.001065 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec7122-247d-49e6-8791-304b99a1afc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:19.003391 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec7122-247d-49e6-8791-304b99a1afc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:19.003775 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec7122-247d-49e6-8791-304b99a1afc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:19.004240 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec7122-247d-49e6-8791-304b99a1afc9 admin admin] PATH_INFO: `/v3/users/8e27fe170efc486fae3be71f453166a6` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:19.007266 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec7122-247d-49e6-8791-304b99a1afc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e27fe170efc486fae3be71f453166a6)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:19.012147 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec7122-247d-49e6-8791-304b99a1afc9 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:19.067577 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716e99c-05d5-41f8-9561-92cdf1517be0 tempest-VolumeQuotaClassesTest-1047447097 tempest-VolumeQuotaClassesTest-1047447097-project-admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:19.072193 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:19.083889 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85910d-44ed-4faf-b1c8-9180e42b35ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:19.087122 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85910d-44ed-4faf-b1c8-9180e42b35ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:19.089507 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85910d-44ed-4faf-b1c8-9180e42b35ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:19.091773 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85910d-44ed-4faf-b1c8-9180e42b35ee admin admin] PATH_INFO: `/v3/projects/7a809b8808894b57986419ea7ed5864f` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:19.096478 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f85910d-44ed-4faf-b1c8-9180e42b35ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a809b8808894b57986419ea7ed5864f)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:19.118170 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f85910d-44ed-4faf-b1c8-9180e42b35ee admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:19.300503 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-2cec7122-247d-49e6-8791-304b99a1afc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e27fe170efc486fae3be71f453166a6'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:19.354539 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-4f85910d-44ed-4faf-b1c8-9180e42b35ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a809b8808894b57986419ea7ed5864f', 'request_id': 'req-4f85910d-44ed-4faf-b1c8-9180e42b35ee'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:19.397386 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-2cec7122-247d-49e6-8791-304b99a1afc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e27fe170efc486fae3be71f453166a6'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:19.412582 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-2cec7122-247d-49e6-8791-304b99a1afc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e27fe170efc486fae3be71f453166a6'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:19.413674 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-2cec7122-247d-49e6-8791-304b99a1afc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e27fe170efc486fae3be71f453166a6'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:19.437512 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-2cec7122-247d-49e6-8791-304b99a1afc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e27fe170efc486fae3be71f453166a6'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:19.469229 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 879/1758] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:48:18 2022] DELETE /identity/v3/users/8e27fe170efc486fae3be71f453166a6 => generated 0 bytes in 949 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:48:19.469861 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec7122-247d-49e6-8791-304b99a1afc9 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:19.482238 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-4f85910d-44ed-4faf-b1c8-9180e42b35ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a809b8808894b57986419ea7ed5864f', 'request_id': 'req-4f85910d-44ed-4faf-b1c8-9180e42b35ee'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:19.493858 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-4f85910d-44ed-4faf-b1c8-9180e42b35ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a809b8808894b57986419ea7ed5864f', 'request_id': 'req-4f85910d-44ed-4faf-b1c8-9180e42b35ee'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:19.494473 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-2cec7122-247d-49e6-8791-304b99a1afc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:19.556578 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-4f85910d-44ed-4faf-b1c8-9180e42b35ee admin admin] The token cache is being invalidate because project 7a809b8808894b57986419ea7ed5864f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:48:19.558371 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-4f85910d-44ed-4faf-b1c8-9180e42b35ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:19.559971 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-4f85910d-44ed-4faf-b1c8-9180e42b35ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:19.568423 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 880/1759] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:48:18 2022] DELETE /identity/v3/projects/7a809b8808894b57986419ea7ed5864f => generated 0 bytes in 790 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:48:19.572663 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85910d-44ed-4faf-b1c8-9180e42b35ee admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:19.575721 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-4f85910d-44ed-4faf-b1c8-9180e42b35ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:19.695146 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec7122-247d-49e6-8791-304b99a1afc9 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:19.714665 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14311f1-55f2-45b2-a0ea-fbf67c73deae tempest-VolumeQuotaClassesTest-1047447097 tempest-VolumeQuotaClassesTest-1047447097-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3069d5735b4ba784e98fdc245a6885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cff67a247fa4fe0b01fa640cd2405ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:19.715445 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14311f1-55f2-45b2-a0ea-fbf67c73deae tempest-VolumeQuotaClassesTest-1047447097 tempest-VolumeQuotaClassesTest-1047447097-project-admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:19.715931 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14311f1-55f2-45b2-a0ea-fbf67c73deae tempest-VolumeQuotaClassesTest-1047447097 tempest-VolumeQuotaClassesTest-1047447097-project-admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:19.716158 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14311f1-55f2-45b2-a0ea-fbf67c73deae tempest-VolumeQuotaClassesTest-1047447097 tempest-VolumeQuotaClassesTest-1047447097-project-admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:19.716891 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14311f1-55f2-45b2-a0ea-fbf67c73deae tempest-VolumeQuotaClassesTest-1047447097 tempest-VolumeQuotaClassesTest-1047447097-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:48:19.717294 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14311f1-55f2-45b2-a0ea-fbf67c73deae tempest-VolumeQuotaClassesTest-1047447097 tempest-VolumeQuotaClassesTest-1047447097-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:19.719296 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14311f1-55f2-45b2-a0ea-fbf67c73deae tempest-VolumeQuotaClassesTest-1047447097 tempest-VolumeQuotaClassesTest-1047447097-project-admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:19.745414 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 880/1760] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:48:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:48:19.754617 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85910d-44ed-4faf-b1c8-9180e42b35ee admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:19.815814 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14311f1-55f2-45b2-a0ea-fbf67c73deae tempest-VolumeQuotaClassesTest-1047447097 tempest-VolumeQuotaClassesTest-1047447097-project-admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:19.818011 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-b14311f1-55f2-45b2-a0ea-fbf67c73deae tempest-VolumeQuotaClassesTest-1047447097 tempest-VolumeQuotaClassesTest-1047447097-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:19.840419 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14311f1-55f2-45b2-a0ea-fbf67c73deae tempest-VolumeQuotaClassesTest-1047447097 tempest-VolumeQuotaClassesTest-1047447097-project-admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:19.864766 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2589f2d-6b7b-4ed8-9f19-84def8c9d746 tempest-VolumeQuotaClassesTest-1047447097 tempest-VolumeQuotaClassesTest-1047447097-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3069d5735b4ba784e98fdc245a6885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cff67a247fa4fe0b01fa640cd2405ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:19.866966 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2589f2d-6b7b-4ed8-9f19-84def8c9d746 tempest-VolumeQuotaClassesTest-1047447097 tempest-VolumeQuotaClassesTest-1047447097-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:19.868712 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2589f2d-6b7b-4ed8-9f19-84def8c9d746 tempest-VolumeQuotaClassesTest-1047447097 tempest-VolumeQuotaClassesTest-1047447097-project-admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:19.869577 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2589f2d-6b7b-4ed8-9f19-84def8c9d746 tempest-VolumeQuotaClassesTest-1047447097 tempest-VolumeQuotaClassesTest-1047447097-project-admin] PATH_INFO: `/v3/projects/480f6bed11bd48b187b2e516b5ab7dc3` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:19.870774 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2589f2d-6b7b-4ed8-9f19-84def8c9d746 tempest-VolumeQuotaClassesTest-1047447097 tempest-VolumeQuotaClassesTest-1047447097-project-admin] RBAC: Authorizing `identity:delete_project(project_id=480f6bed11bd48b187b2e516b5ab7dc3)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:19.873091 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2589f2d-6b7b-4ed8-9f19-84def8c9d746 tempest-VolumeQuotaClassesTest-1047447097 tempest-VolumeQuotaClassesTest-1047447097-project-admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:19.953575 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb80a2-07fa-46a9-9932-1bba9a6dbe73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:19.955045 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb80a2-07fa-46a9-9932-1bba9a6dbe73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:19.955343 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb80a2-07fa-46a9-9932-1bba9a6dbe73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:19.955619 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb80a2-07fa-46a9-9932-1bba9a6dbe73 admin admin] PATH_INFO: `/v3/users/89e48d6223104ad6944515751fb92277` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:19.959271 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bb80a2-07fa-46a9-9932-1bba9a6dbe73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89e48d6223104ad6944515751fb92277)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:19.963320 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bb80a2-07fa-46a9-9932-1bba9a6dbe73 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:19.969725 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:20.107247 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-f2589f2d-6b7b-4ed8-9f19-84def8c9d746 tempest-VolumeQuotaClassesTest-1047447097 tempest-VolumeQuotaClassesTest-1047447097-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '480f6bed11bd48b187b2e516b5ab7dc3', 'request_id': 'req-f2589f2d-6b7b-4ed8-9f19-84def8c9d746'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:20.219748 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-f2589f2d-6b7b-4ed8-9f19-84def8c9d746 tempest-VolumeQuotaClassesTest-1047447097 tempest-VolumeQuotaClassesTest-1047447097-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '480f6bed11bd48b187b2e516b5ab7dc3', 'request_id': 'req-f2589f2d-6b7b-4ed8-9f19-84def8c9d746'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:20.228079 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-f2589f2d-6b7b-4ed8-9f19-84def8c9d746 tempest-VolumeQuotaClassesTest-1047447097 tempest-VolumeQuotaClassesTest-1047447097-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '480f6bed11bd48b187b2e516b5ab7dc3', 'request_id': 'req-f2589f2d-6b7b-4ed8-9f19-84def8c9d746'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:20.248064 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-f2589f2d-6b7b-4ed8-9f19-84def8c9d746 tempest-VolumeQuotaClassesTest-1047447097 tempest-VolumeQuotaClassesTest-1047447097-project-admin] The token cache is being invalidate because project 480f6bed11bd48b187b2e516b5ab7dc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:48:20.249412 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-f2589f2d-6b7b-4ed8-9f19-84def8c9d746 tempest-VolumeQuotaClassesTest-1047447097 tempest-VolumeQuotaClassesTest-1047447097-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:20.250363 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-f2589f2d-6b7b-4ed8-9f19-84def8c9d746 tempest-VolumeQuotaClassesTest-1047447097 tempest-VolumeQuotaClassesTest-1047447097-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:20.259098 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 881/1761] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:48:19 2022] DELETE /identity/v3/projects/480f6bed11bd48b187b2e516b5ab7dc3 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:48:20.361268 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-00bb80a2-07fa-46a9-9932-1bba9a6dbe73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89e48d6223104ad6944515751fb92277'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:20.503847 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-00bb80a2-07fa-46a9-9932-1bba9a6dbe73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89e48d6223104ad6944515751fb92277'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:20.512706 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-00bb80a2-07fa-46a9-9932-1bba9a6dbe73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89e48d6223104ad6944515751fb92277'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:20.512858 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2589f2d-6b7b-4ed8-9f19-84def8c9d746 tempest-VolumeQuotaClassesTest-1047447097 tempest-VolumeQuotaClassesTest-1047447097-project-admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:20.514741 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-f2589f2d-6b7b-4ed8-9f19-84def8c9d746 tempest-VolumeQuotaClassesTest-1047447097 tempest-VolumeQuotaClassesTest-1047447097-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:20.540269 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-00bb80a2-07fa-46a9-9932-1bba9a6dbe73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89e48d6223104ad6944515751fb92277'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:20.541024 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-00bb80a2-07fa-46a9-9932-1bba9a6dbe73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89e48d6223104ad6944515751fb92277'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:20.559949 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 881/1762] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:48:19 2022] DELETE /identity/v3/users/89e48d6223104ad6944515751fb92277 => generated 0 bytes in 985 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:48:20.562364 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52dc75-6fa6-40dc-b48a-9473cea284e0 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:20.562704 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52dc75-6fa6-40dc-b48a-9473cea284e0 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:20.562920 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52dc75-6fa6-40dc-b48a-9473cea284e0 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:20.565000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 882/1763] 10.222.0.42 () {54 vars in 921 bytes} [Fri Aug 5 02:48:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:48:20.585804 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12a465-cef2-4a15-a26e-7b963596f88e None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:20.586089 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12a465-cef2-4a15-a26e-7b963596f88e None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:20.586369 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12a465-cef2-4a15-a26e-7b963596f88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:20.593192 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:20.640499 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-6d12a465-cef2-4a15-a26e-7b963596f88e None None] MFA Rules not processed for user `55374d3bccd541c9a8f82da9b21c2fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:20.644836 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-6d12a465-cef2-4a15-a26e-7b963596f88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:20.711839 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2589f2d-6b7b-4ed8-9f19-84def8c9d746 tempest-VolumeQuotaClassesTest-1047447097 tempest-VolumeQuotaClassesTest-1047447097-project-admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:20.801706 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732db23b-5f6a-4a7b-a906-7dac0d202f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:20.802987 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732db23b-5f6a-4a7b-a906-7dac0d202f67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:20.803419 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732db23b-5f6a-4a7b-a906-7dac0d202f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:20.803878 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732db23b-5f6a-4a7b-a906-7dac0d202f67 admin admin] PATH_INFO: `/v3/projects/e411961868da41ff85799c83d576d23b` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:20.805094 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732db23b-5f6a-4a7b-a906-7dac0d202f67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e411961868da41ff85799c83d576d23b)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:20.807742 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732db23b-5f6a-4a7b-a906-7dac0d202f67 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:20.863493 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 883/1764] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Aug 5 02:48:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 05 02:48:21.063700 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-732db23b-5f6a-4a7b-a906-7dac0d202f67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e411961868da41ff85799c83d576d23b', 'request_id': 'req-732db23b-5f6a-4a7b-a906-7dac0d202f67'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:21.167381 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-732db23b-5f6a-4a7b-a906-7dac0d202f67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e411961868da41ff85799c83d576d23b', 'request_id': 'req-732db23b-5f6a-4a7b-a906-7dac0d202f67'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:21.175663 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-732db23b-5f6a-4a7b-a906-7dac0d202f67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e411961868da41ff85799c83d576d23b', 'request_id': 'req-732db23b-5f6a-4a7b-a906-7dac0d202f67'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:21.208496 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-732db23b-5f6a-4a7b-a906-7dac0d202f67 admin admin] The token cache is being invalidate because project e411961868da41ff85799c83d576d23b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:48:21.208790 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-732db23b-5f6a-4a7b-a906-7dac0d202f67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:21.221933 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-732db23b-5f6a-4a7b-a906-7dac0d202f67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:21.228540 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 882/1765] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:48:20 2022] DELETE /identity/v3/projects/e411961868da41ff85799c83d576d23b => generated 0 bytes in 714 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:48:21.234478 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3955588-80ad-470d-88d7-bdd24af3011e None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:21.234478 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3955588-80ad-470d-88d7-bdd24af3011e None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:21.234478 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3955588-80ad-470d-88d7-bdd24af3011e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:21.238035 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732db23b-5f6a-4a7b-a906-7dac0d202f67 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:21.239494 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-732db23b-5f6a-4a7b-a906-7dac0d202f67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:21.285640 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-f3955588-80ad-470d-88d7-bdd24af3011e None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:21.293554 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-f3955588-80ad-470d-88d7-bdd24af3011e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:21.412205 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:21.425948 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 884/1766] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:48:21.432275 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb98be-7029-4e59-bd76-6fd22e2c8d90 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:21.432817 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb98be-7029-4e59-bd76-6fd22e2c8d90 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:21.433335 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb98be-7029-4e59-bd76-6fd22e2c8d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:21.439368 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732db23b-5f6a-4a7b-a906-7dac0d202f67 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:21.453939 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b2e5f-7034-4440-8ca0-0e853b4667a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:21.455268 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b2e5f-7034-4440-8ca0-0e853b4667a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:21.455551 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b2e5f-7034-4440-8ca0-0e853b4667a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:21.455826 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b2e5f-7034-4440-8ca0-0e853b4667a1 admin admin] PATH_INFO: `/v3/users/468ae41766394879bc9865ff195134a8` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:21.457083 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b2e5f-7034-4440-8ca0-0e853b4667a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=468ae41766394879bc9865ff195134a8)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:21.459065 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b2e5f-7034-4440-8ca0-0e853b4667a1 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:21.475134 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-3bcb98be-7029-4e59-bd76-6fd22e2c8d90 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:21.479058 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-3bcb98be-7029-4e59-bd76-6fd22e2c8d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:21.498521 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 885/1767] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:21.503241 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb98be-7029-4e59-bd76-6fd22e2c8d90 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:21.525035 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb98be-7029-4e59-bd76-6fd22e2c8d90 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:21.537940 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91bcf1-b366-42ac-b4d8-c304b58e179e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:21.541341 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91bcf1-b366-42ac-b4d8-c304b58e179e admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:21.551897 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91bcf1-b366-42ac-b4d8-c304b58e179e admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:21.552442 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91bcf1-b366-42ac-b4d8-c304b58e179e admin admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:21.552941 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef91bcf1-b366-42ac-b4d8-c304b58e179e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:48:21.553279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef91bcf1-b366-42ac-b4d8-c304b58e179e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:21.554987 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef91bcf1-b366-42ac-b4d8-c304b58e179e admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:21.571281 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:21.599256 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 886/1768] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:48:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:48:21.600635 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91bcf1-b366-42ac-b4d8-c304b58e179e admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:21.602403 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-ef91bcf1-b366-42ac-b4d8-c304b58e179e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:21.625499 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91bcf1-b366-42ac-b4d8-c304b58e179e admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:21.643830 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83726510-a122-4cb4-a03c-b2a2ff341b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:21.644576 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83726510-a122-4cb4-a03c-b2a2ff341b38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:21.649686 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83726510-a122-4cb4-a03c-b2a2ff341b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:21.649686 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83726510-a122-4cb4-a03c-b2a2ff341b38 admin admin] PATH_INFO: `/v3/projects/1be3da8bcc504c93a6f0079a8e3766e0` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:21.649686 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83726510-a122-4cb4-a03c-b2a2ff341b38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1be3da8bcc504c93a6f0079a8e3766e0)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:21.651305 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83726510-a122-4cb4-a03c-b2a2ff341b38 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:21.768349 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-3e8b2e5f-7034-4440-8ca0-0e853b4667a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '468ae41766394879bc9865ff195134a8'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:21.826007 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-83726510-a122-4cb4-a03c-b2a2ff341b38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1be3da8bcc504c93a6f0079a8e3766e0', 'request_id': 'req-83726510-a122-4cb4-a03c-b2a2ff341b38'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:21.874004 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-3e8b2e5f-7034-4440-8ca0-0e853b4667a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '468ae41766394879bc9865ff195134a8'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:21.892528 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-3e8b2e5f-7034-4440-8ca0-0e853b4667a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '468ae41766394879bc9865ff195134a8'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:21.893292 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-3e8b2e5f-7034-4440-8ca0-0e853b4667a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '468ae41766394879bc9865ff195134a8'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:21.913834 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-83726510-a122-4cb4-a03c-b2a2ff341b38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1be3da8bcc504c93a6f0079a8e3766e0', 'request_id': 'req-83726510-a122-4cb4-a03c-b2a2ff341b38'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:21.922318 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-83726510-a122-4cb4-a03c-b2a2ff341b38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1be3da8bcc504c93a6f0079a8e3766e0', 'request_id': 'req-83726510-a122-4cb4-a03c-b2a2ff341b38'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:21.934006 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-3e8b2e5f-7034-4440-8ca0-0e853b4667a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '468ae41766394879bc9865ff195134a8'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:21.944669 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 883/1769] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:48:21 2022] DELETE /identity/v3/users/468ae41766394879bc9865ff195134a8 => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:48:21.945249 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b2e5f-7034-4440-8ca0-0e853b4667a1 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:21.957655 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-83726510-a122-4cb4-a03c-b2a2ff341b38 admin admin] The token cache is being invalidate because project 1be3da8bcc504c93a6f0079a8e3766e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:48:21.957655 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-83726510-a122-4cb4-a03c-b2a2ff341b38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:21.959231 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-83726510-a122-4cb4-a03c-b2a2ff341b38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:21.959850 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-3e8b2e5f-7034-4440-8ca0-0e853b4667a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:21.964613 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 887/1770] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:48:21 2022] DELETE /identity/v3/projects/1be3da8bcc504c93a6f0079a8e3766e0 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:48:21.965749 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6ad64-72e8-4745-986a-347db79866ca None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:21.966045 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6ad64-72e8-4745-986a-347db79866ca None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:21.966329 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6ad64-72e8-4745-986a-347db79866ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:22.012892 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-4cc6ad64-72e8-4745-986a-347db79866ca None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:22.014191 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-4cc6ad64-72e8-4745-986a-347db79866ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:22.051739 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b2e5f-7034-4440-8ca0-0e853b4667a1 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:22.056833 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf51c6b-2082-4634-ab74-07fa91efb277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:22.057472 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf51c6b-2082-4634-ab74-07fa91efb277 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:22.057912 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf51c6b-2082-4634-ab74-07fa91efb277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:22.058194 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf51c6b-2082-4634-ab74-07fa91efb277 admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:22.058871 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf51c6b-2082-4634-ab74-07fa91efb277 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:22.060853 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf51c6b-2082-4634-ab74-07fa91efb277 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:22.170804 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 884/1771] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:48:21 2022] POST /identity/v3/projects => generated 357 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:48:22.172637 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf51c6b-2082-4634-ab74-07fa91efb277 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:22.176685 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-4cf51c6b-2082-4634-ab74-07fa91efb277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:22.228690 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 888/1772] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:22.230874 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6ad64-72e8-4745-986a-347db79866ca None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:22.239872 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-4cc6ad64-72e8-4745-986a-347db79866ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:22.274327 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6ad64-72e8-4745-986a-347db79866ca None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:22.372459 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:22.414971 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf51c6b-2082-4634-ab74-07fa91efb277 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:22.437116 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f9b8e-a68f-4c9f-af93-ecab09cbfe42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:22.438012 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f9b8e-a68f-4c9f-af93-ecab09cbfe42 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:22.438600 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f9b8e-a68f-4c9f-af93-ecab09cbfe42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:22.439578 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f9b8e-a68f-4c9f-af93-ecab09cbfe42 admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:22.440386 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f9b8e-a68f-4c9f-af93-ecab09cbfe42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:22.440499 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899b8c5-4773-41a4-9227-2733d2a35be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:22.441058 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899b8c5-4773-41a4-9227-2733d2a35be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:22.441348 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899b8c5-4773-41a4-9227-2733d2a35be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:22.441632 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899b8c5-4773-41a4-9227-2733d2a35be6 admin admin] PATH_INFO: `/v3/users/888666d3c7e84e10b920419cad9ec379` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:22.442397 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f9b8e-a68f-4c9f-af93-ecab09cbfe42 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:22.450550 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0899b8c5-4773-41a4-9227-2733d2a35be6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=888666d3c7e84e10b920419cad9ec379)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:22.452651 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0899b8c5-4773-41a4-9227-2733d2a35be6 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:22.620993 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 889/1773] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:48:22 2022] POST /identity/v3/users => generated 279 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:48:22.626849 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f9b8e-a68f-4c9f-af93-ecab09cbfe42 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:22.634168 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-8e8f9b8e-a68f-4c9f-af93-ecab09cbfe42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:22.666992 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:22.673974 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-0899b8c5-4773-41a4-9227-2733d2a35be6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '888666d3c7e84e10b920419cad9ec379'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:22.733334 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-0899b8c5-4773-41a4-9227-2733d2a35be6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '888666d3c7e84e10b920419cad9ec379'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:22.760390 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-0899b8c5-4773-41a4-9227-2733d2a35be6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '888666d3c7e84e10b920419cad9ec379'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:22.762370 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-0899b8c5-4773-41a4-9227-2733d2a35be6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '888666d3c7e84e10b920419cad9ec379'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:22.855268 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-0899b8c5-4773-41a4-9227-2733d2a35be6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '888666d3c7e84e10b920419cad9ec379'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:22.864402 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f9b8e-a68f-4c9f-af93-ecab09cbfe42 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:22.872394 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 885/1774] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:48:22 2022] DELETE /identity/v3/users/888666d3c7e84e10b920419cad9ec379 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:48:22.873650 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899b8c5-4773-41a4-9227-2733d2a35be6 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:22.876079 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-0899b8c5-4773-41a4-9227-2733d2a35be6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:22.898034 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64f84d-0917-41b4-a419-4c09a521bfc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:22.898730 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64f84d-0917-41b4-a419-4c09a521bfc8 service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:22.899611 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64f84d-0917-41b4-a419-4c09a521bfc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:22.900712 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64f84d-0917-41b4-a419-4c09a521bfc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:22.909230 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-9a64f84d-0917-41b4-a419-4c09a521bfc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:22.960135 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64f84d-0917-41b4-a419-4c09a521bfc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:22.962607 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64f84d-0917-41b4-a419-4c09a521bfc8 service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:23.024878 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 890/1775] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:48:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:48:23.035197 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899b8c5-4773-41a4-9227-2733d2a35be6 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:23.044627 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02063f46-b2ef-408b-abba-3dd498654429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:23.046012 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02063f46-b2ef-408b-abba-3dd498654429 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:23.046306 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02063f46-b2ef-408b-abba-3dd498654429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:23.046673 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02063f46-b2ef-408b-abba-3dd498654429 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:23.048440 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02063f46-b2ef-408b-abba-3dd498654429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:23.050275 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02063f46-b2ef-408b-abba-3dd498654429 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:23.068289 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64f84d-0917-41b4-a419-4c09a521bfc8 service neutron] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:23.072542 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 886/1776] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:48:22 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:48:23.087630 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64f84d-0917-41b4-a419-4c09a521bfc8 service neutron] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:23.113978 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85526c7-394a-47b0-9336-f44c00f20e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:23.116609 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85526c7-394a-47b0-9336-f44c00f20e03 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:23.117680 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85526c7-394a-47b0-9336-f44c00f20e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:23.121593 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85526c7-394a-47b0-9336-f44c00f20e03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:23.124316 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85526c7-394a-47b0-9336-f44c00f20e03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:23.127233 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85526c7-394a-47b0-9336-f44c00f20e03 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:23.170577 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 891/1777] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:48:23.178122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02063f46-b2ef-408b-abba-3dd498654429 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:23.194734 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02063f46-b2ef-408b-abba-3dd498654429 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:23.229846 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68439f9-2919-4c55-9ab0-78d1ee5be25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:23.231115 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68439f9-2919-4c55-9ab0-78d1ee5be25d admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:23.250164 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68439f9-2919-4c55-9ab0-78d1ee5be25d admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:23.252595 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68439f9-2919-4c55-9ab0-78d1ee5be25d admin admin] PATH_INFO: `/v3/projects/d233100331034057b6433d7c6a33ae19/users/a6a790e41adf4cb2a2e45a34121f4993/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:23.347756 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68439f9-2919-4c55-9ab0-78d1ee5be25d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d233100331034057b6433d7c6a33ae19, user_id=a6a790e41adf4cb2a2e45a34121f4993, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:23.367550 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68439f9-2919-4c55-9ab0-78d1ee5be25d admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:23.521379 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 887/1778] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:48:23 2022] PUT /identity/v3/projects/d233100331034057b6433d7c6a33ae19/users/a6a790e41adf4cb2a2e45a34121f4993/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:48:23.542304 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2286e1c-4df4-4359-8f7a-96a672a43369 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:23.542304 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2286e1c-4df4-4359-8f7a-96a672a43369 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:23.542304 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2286e1c-4df4-4359-8f7a-96a672a43369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:23.552206 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68439f9-2919-4c55-9ab0-78d1ee5be25d admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:23.554022 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-e68439f9-2919-4c55-9ab0-78d1ee5be25d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:23.651863 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-b2286e1c-4df4-4359-8f7a-96a672a43369 None None] MFA Rules not processed for user `a6a790e41adf4cb2a2e45a34121f4993`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:23.653413 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-b2286e1c-4df4-4359-8f7a-96a672a43369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:23.727629 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:23.803964 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68439f9-2919-4c55-9ab0-78d1ee5be25d admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:23.816628 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1585e16-63a4-44f9-ade4-64c30cb2bc41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:23.817524 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1585e16-63a4-44f9-ade4-64c30cb2bc41 service nova] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:23.817956 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1585e16-63a4-44f9-ade4-64c30cb2bc41 service nova] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:23.818445 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1585e16-63a4-44f9-ade4-64c30cb2bc41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:23.825108 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-a1585e16-63a4-44f9-ade4-64c30cb2bc41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:23.854054 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1585e16-63a4-44f9-ade4-64c30cb2bc41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:23.856458 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1585e16-63a4-44f9-ade4-64c30cb2bc41 service nova] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:23.910702 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 888/1779] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:48:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:48:23.920549 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 892/1780] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:23 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:23.926145 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1585e16-63a4-44f9-ade4-64c30cb2bc41 service nova] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:24.082664 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1585e16-63a4-44f9-ade4-64c30cb2bc41 service nova] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:24.101161 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2bba11-5f3c-4d17-986b-c61e6b629e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:24.102064 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2bba11-5f3c-4d17-986b-c61e6b629e86 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:24.102563 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2bba11-5f3c-4d17-986b-c61e6b629e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:24.103082 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2bba11-5f3c-4d17-986b-c61e6b629e86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:24.103981 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2bba11-5f3c-4d17-986b-c61e6b629e86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:24.106145 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2bba11-5f3c-4d17-986b-c61e6b629e86 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:24.310348 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 889/1781] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:48:23 2022] POST /identity/v3/projects => generated 357 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:48:24.316056 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2286e1c-4df4-4359-8f7a-96a672a43369 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:24.337863 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2286e1c-4df4-4359-8f7a-96a672a43369 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:24.507876 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55fd40-3d09-4d8b-bd77-d84b6a91965e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:24.508458 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55fd40-3d09-4d8b-bd77-d84b6a91965e admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:24.508742 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55fd40-3d09-4d8b-bd77-d84b6a91965e admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:24.509148 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55fd40-3d09-4d8b-bd77-d84b6a91965e admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:24.509842 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da55fd40-3d09-4d8b-bd77-d84b6a91965e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:24.511875 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da55fd40-3d09-4d8b-bd77-d84b6a91965e admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:24.652915 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 893/1782] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:48:24 2022] POST /identity/v3/users => generated 285 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:48:24.657945 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2bba11-5f3c-4d17-986b-c61e6b629e86 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:24.673326 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2bba11-5f3c-4d17-986b-c61e6b629e86 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:24.684405 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddebf6b-361b-43e1-845a-9ef3fa3fbde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:24.685988 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddebf6b-361b-43e1-845a-9ef3fa3fbde2 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:24.687359 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddebf6b-361b-43e1-845a-9ef3fa3fbde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:24.687925 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddebf6b-361b-43e1-845a-9ef3fa3fbde2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:24.689644 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddebf6b-361b-43e1-845a-9ef3fa3fbde2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:24.699673 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddebf6b-361b-43e1-845a-9ef3fa3fbde2 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:24.753775 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 890/1783] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:48:24.758266 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55fd40-3d09-4d8b-bd77-d84b6a91965e admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:24.772590 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55fd40-3d09-4d8b-bd77-d84b6a91965e admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:24.808575 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72105553-d7cf-4977-a003-7cc71360512b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:24.808575 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72105553-d7cf-4977-a003-7cc71360512b admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:24.808575 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72105553-d7cf-4977-a003-7cc71360512b admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:24.808575 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72105553-d7cf-4977-a003-7cc71360512b admin admin] PATH_INFO: `/v3/projects/a7b4e599ca2f4c66a9687939b4b794a4/users/a4545abdd1394744adef61eebe5cf3cf/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:24.851482 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72105553-d7cf-4977-a003-7cc71360512b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7b4e599ca2f4c66a9687939b4b794a4, user_id=a4545abdd1394744adef61eebe5cf3cf, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:24.854358 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72105553-d7cf-4977-a003-7cc71360512b admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:24.861598 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:24.979712 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 894/1784] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:48:24 2022] PUT /identity/v3/projects/a7b4e599ca2f4c66a9687939b4b794a4/users/a4545abdd1394744adef61eebe5cf3cf/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:48:24.983823 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddebf6b-361b-43e1-845a-9ef3fa3fbde2 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:25.001402 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddebf6b-361b-43e1-845a-9ef3fa3fbde2 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:25.190656 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc4c8f0-d7f1-48c6-b7b5-bef7d4a172a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:25.191338 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4c8f0-d7f1-48c6-b7b5-bef7d4a172a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:25.191707 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4c8f0-d7f1-48c6-b7b5-bef7d4a172a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:25.191973 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4c8f0-d7f1-48c6-b7b5-bef7d4a172a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:25.192672 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc4c8f0-d7f1-48c6-b7b5-bef7d4a172a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:25.194321 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc4c8f0-d7f1-48c6-b7b5-bef7d4a172a0 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:25.215101 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 891/1785] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:48:25.221743 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72105553-d7cf-4977-a003-7cc71360512b admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:25.235039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72105553-d7cf-4977-a003-7cc71360512b admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:25.246774 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c728caa-36ec-41a2-a8d0-02f91aeaf27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:25.256693 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c728caa-36ec-41a2-a8d0-02f91aeaf27b admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:25.256693 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c728caa-36ec-41a2-a8d0-02f91aeaf27b admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:25.256693 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c728caa-36ec-41a2-a8d0-02f91aeaf27b admin admin] PATH_INFO: `/v3/projects/a7b4e599ca2f4c66a9687939b4b794a4/users/a4545abdd1394744adef61eebe5cf3cf/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:25.256693 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c728caa-36ec-41a2-a8d0-02f91aeaf27b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7b4e599ca2f4c66a9687939b4b794a4, user_id=a4545abdd1394744adef61eebe5cf3cf, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:25.259750 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c728caa-36ec-41a2-a8d0-02f91aeaf27b admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:25.306045 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 895/1786] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:48:25 2022] PUT /identity/v3/projects/a7b4e599ca2f4c66a9687939b4b794a4/users/a4545abdd1394744adef61eebe5cf3cf/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:48:25.307767 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cec5de-c39e-4f7a-bfa1-baa8c9ca1683 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:25.308208 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cec5de-c39e-4f7a-bfa1-baa8c9ca1683 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:25.308629 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cec5de-c39e-4f7a-bfa1-baa8c9ca1683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:25.384284 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-14cec5de-c39e-4f7a-bfa1-baa8c9ca1683 None None] MFA Rules not processed for user `a4545abdd1394744adef61eebe5cf3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:25.390542 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-14cec5de-c39e-4f7a-bfa1-baa8c9ca1683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:25.483531 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:25.567716 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 892/1787] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:25 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:25.580374 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c728caa-36ec-41a2-a8d0-02f91aeaf27b admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:25.583201 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-6c728caa-36ec-41a2-a8d0-02f91aeaf27b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:25.651173 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cec5de-c39e-4f7a-bfa1-baa8c9ca1683 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:25.654746 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-14cec5de-c39e-4f7a-bfa1-baa8c9ca1683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:25.811443 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c728caa-36ec-41a2-a8d0-02f91aeaf27b admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:25.811443 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d111324c-cd9d-4e8b-9310-974209c98f29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:25.815793 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cec5de-c39e-4f7a-bfa1-baa8c9ca1683 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:25.823001 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472dbfcb-d7bf-4489-a7e7-df70aaa0ad89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:25.823811 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111324c-cd9d-4e8b-9310-974209c98f29 service cinder] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:25.824409 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111324c-cd9d-4e8b-9310-974209c98f29 service cinder] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:25.824409 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111324c-cd9d-4e8b-9310-974209c98f29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:25.825269 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472dbfcb-d7bf-4489-a7e7-df70aaa0ad89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:25.825932 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472dbfcb-d7bf-4489-a7e7-df70aaa0ad89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:25.826384 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472dbfcb-d7bf-4489-a7e7-df70aaa0ad89 admin admin] PATH_INFO: `/v3/projects/b31c8b0154474d0fb2e62dcbab548bb2` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:25.828758 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472dbfcb-d7bf-4489-a7e7-df70aaa0ad89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b31c8b0154474d0fb2e62dcbab548bb2)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:25.831568 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472dbfcb-d7bf-4489-a7e7-df70aaa0ad89 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:25.879222 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d111324c-cd9d-4e8b-9310-974209c98f29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:25.882008 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d111324c-cd9d-4e8b-9310-974209c98f29 service cinder] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:25.945302 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 896/1788] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:48:25 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:48:25.951122 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d111324c-cd9d-4e8b-9310-974209c98f29 service cinder] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:25.957516 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-d111324c-cd9d-4e8b-9310-974209c98f29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:25.990403 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d111324c-cd9d-4e8b-9310-974209c98f29 service cinder] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:26.028105 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-472dbfcb-d7bf-4489-a7e7-df70aaa0ad89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b31c8b0154474d0fb2e62dcbab548bb2', 'request_id': 'req-472dbfcb-d7bf-4489-a7e7-df70aaa0ad89'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:26.119445 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-472dbfcb-d7bf-4489-a7e7-df70aaa0ad89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b31c8b0154474d0fb2e62dcbab548bb2', 'request_id': 'req-472dbfcb-d7bf-4489-a7e7-df70aaa0ad89'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:26.129760 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-472dbfcb-d7bf-4489-a7e7-df70aaa0ad89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b31c8b0154474d0fb2e62dcbab548bb2', 'request_id': 'req-472dbfcb-d7bf-4489-a7e7-df70aaa0ad89'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:26.147337 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6eef3-580a-4b97-a3b8-499114d30404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:26.150115 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6eef3-580a-4b97-a3b8-499114d30404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:26.153442 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6eef3-580a-4b97-a3b8-499114d30404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:26.154940 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6eef3-580a-4b97-a3b8-499114d30404 admin admin] PATH_INFO: `/v3/projects/beacfc5f793a4068bade0710858b5988` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:26.161193 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d6eef3-580a-4b97-a3b8-499114d30404 admin admin] RBAC: Authorizing `identity:delete_project(project_id=beacfc5f793a4068bade0710858b5988)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:26.163455 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-472dbfcb-d7bf-4489-a7e7-df70aaa0ad89 admin admin] The token cache is being invalidate because project b31c8b0154474d0fb2e62dcbab548bb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:48:26.165894 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-472dbfcb-d7bf-4489-a7e7-df70aaa0ad89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:26.165894 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-472dbfcb-d7bf-4489-a7e7-df70aaa0ad89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:26.167409 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d6eef3-580a-4b97-a3b8-499114d30404 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:26.171534 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 893/1789] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:48:25 2022] DELETE /identity/v3/projects/b31c8b0154474d0fb2e62dcbab548bb2 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:48:26.177096 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674aae70-0760-4fba-a2cf-ff4a86502d6e None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:26.177516 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674aae70-0760-4fba-a2cf-ff4a86502d6e None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:26.177984 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674aae70-0760-4fba-a2cf-ff4a86502d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:26.236654 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-674aae70-0760-4fba-a2cf-ff4a86502d6e None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:26.240688 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-674aae70-0760-4fba-a2cf-ff4a86502d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:26.292403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 894/1790] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:48:26.294126 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674aae70-0760-4fba-a2cf-ff4a86502d6e None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:26.296761 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-674aae70-0760-4fba-a2cf-ff4a86502d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:26.356702 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-20d6eef3-580a-4b97-a3b8-499114d30404 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beacfc5f793a4068bade0710858b5988', 'request_id': 'req-20d6eef3-580a-4b97-a3b8-499114d30404'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:26.423567 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674aae70-0760-4fba-a2cf-ff4a86502d6e None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:26.437177 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:26.467935 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-20d6eef3-580a-4b97-a3b8-499114d30404 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beacfc5f793a4068bade0710858b5988', 'request_id': 'req-20d6eef3-580a-4b97-a3b8-499114d30404'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:26.481878 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-20d6eef3-580a-4b97-a3b8-499114d30404 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beacfc5f793a4068bade0710858b5988', 'request_id': 'req-20d6eef3-580a-4b97-a3b8-499114d30404'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:26.515295 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-20d6eef3-580a-4b97-a3b8-499114d30404 admin admin] The token cache is being invalidate because project beacfc5f793a4068bade0710858b5988 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:48:26.518102 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-20d6eef3-580a-4b97-a3b8-499114d30404 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:26.519086 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-20d6eef3-580a-4b97-a3b8-499114d30404 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:26.527362 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 897/1791] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:48:25 2022] DELETE /identity/v3/projects/beacfc5f793a4068bade0710858b5988 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:48:26.528799 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1fd502-3d07-4ed4-bc27-68db9ee6a726 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:26.529097 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1fd502-3d07-4ed4-bc27-68db9ee6a726 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:26.529381 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1fd502-3d07-4ed4-bc27-68db9ee6a726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:26.548961 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38502b-d4c2-44a3-a001-4e5901e35b4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:26.549946 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38502b-d4c2-44a3-a001-4e5901e35b4a service cinder] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:26.550372 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38502b-d4c2-44a3-a001-4e5901e35b4a service cinder] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:26.550987 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38502b-d4c2-44a3-a001-4e5901e35b4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:26.555617 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-ae38502b-d4c2-44a3-a001-4e5901e35b4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:26.606282 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-ac1fd502-3d07-4ed4-bc27-68db9ee6a726 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:26.618980 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-ac1fd502-3d07-4ed4-bc27-68db9ee6a726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:26.661464 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:26.701825 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae38502b-d4c2-44a3-a001-4e5901e35b4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:26.703717 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae38502b-d4c2-44a3-a001-4e5901e35b4a service cinder] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:26.727560 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 895/1792] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:48:26 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:48:26.728684 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38502b-d4c2-44a3-a001-4e5901e35b4a service cinder] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:26.730295 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-ae38502b-d4c2-44a3-a001-4e5901e35b4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:26.860538 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 898/1793] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:26.865203 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1fd502-3d07-4ed4-bc27-68db9ee6a726 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:26.879500 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1fd502-3d07-4ed4-bc27-68db9ee6a726 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:26.885234 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b447268-f9c7-4552-8e5e-1d68c2e96ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:26.886258 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b447268-f9c7-4552-8e5e-1d68c2e96ffe admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:26.886902 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b447268-f9c7-4552-8e5e-1d68c2e96ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:26.887466 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b447268-f9c7-4552-8e5e-1d68c2e96ffe admin admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:26.888506 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b447268-f9c7-4552-8e5e-1d68c2e96ffe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:48:26.888966 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b447268-f9c7-4552-8e5e-1d68c2e96ffe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:26.892080 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b447268-f9c7-4552-8e5e-1d68c2e96ffe admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:26.914664 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38502b-d4c2-44a3-a001-4e5901e35b4a service cinder] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:26.929845 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925addbd-6e77-4720-8dfd-7c728647b34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:26.933879 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925addbd-6e77-4720-8dfd-7c728647b34f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:26.933879 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925addbd-6e77-4720-8dfd-7c728647b34f admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:26.933879 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925addbd-6e77-4720-8dfd-7c728647b34f admin admin] PATH_INFO: `/v3/users/ad3069d5735b4ba784e98fdc245a6885` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:26.935307 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 899/1794] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:48:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:48:26.936814 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b447268-f9c7-4552-8e5e-1d68c2e96ffe admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:26.937951 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925addbd-6e77-4720-8dfd-7c728647b34f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad3069d5735b4ba784e98fdc245a6885)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:26.945443 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925addbd-6e77-4720-8dfd-7c728647b34f admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:26.949087 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b447268-f9c7-4552-8e5e-1d68c2e96ffe admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:26.954710 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba068d6-a03d-4f89-954d-92b04b230104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:26.955623 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba068d6-a03d-4f89-954d-92b04b230104 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:26.956332 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba068d6-a03d-4f89-954d-92b04b230104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:26.956963 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba068d6-a03d-4f89-954d-92b04b230104 admin admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:26.957793 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba068d6-a03d-4f89-954d-92b04b230104 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:26.960235 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba068d6-a03d-4f89-954d-92b04b230104 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:27.537430 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 900/1795] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:48:26 2022] POST /identity/v3/projects => generated 401 bytes in 601 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:48:27.540123 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba068d6-a03d-4f89-954d-92b04b230104 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:27.679217 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba068d6-a03d-4f89-954d-92b04b230104 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:27.691050 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f388f17-d60d-41e2-9d71-66b54ddc774b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:27.691923 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f388f17-d60d-41e2-9d71-66b54ddc774b admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:27.696429 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f388f17-d60d-41e2-9d71-66b54ddc774b admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:27.696939 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f388f17-d60d-41e2-9d71-66b54ddc774b admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:27.697885 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f388f17-d60d-41e2-9d71-66b54ddc774b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:27.701775 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f388f17-d60d-41e2-9d71-66b54ddc774b admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:28.314067 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 901/1796] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:48:27 2022] POST /identity/v3/users => generated 301 bytes in 776 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:48:28.319430 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f388f17-d60d-41e2-9d71-66b54ddc774b admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:28.332595 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-925addbd-6e77-4720-8dfd-7c728647b34f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad3069d5735b4ba784e98fdc245a6885'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:28.340179 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f388f17-d60d-41e2-9d71-66b54ddc774b admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:28.347761 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0e9fb-bf5e-450d-808d-da88991c6787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:28.348670 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0e9fb-bf5e-450d-808d-da88991c6787 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:28.349187 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0e9fb-bf5e-450d-808d-da88991c6787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:28.349401 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0e9fb-bf5e-450d-808d-da88991c6787 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:28.350320 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0e9fb-bf5e-450d-808d-da88991c6787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:28.353057 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0e9fb-bf5e-450d-808d-da88991c6787 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:28.371767 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 902/1797] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:48:28.381408 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0e9fb-bf5e-450d-808d-da88991c6787 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:28.429611 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0e9fb-bf5e-450d-808d-da88991c6787 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:28.434178 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-925addbd-6e77-4720-8dfd-7c728647b34f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad3069d5735b4ba784e98fdc245a6885'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:28.444281 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-925addbd-6e77-4720-8dfd-7c728647b34f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad3069d5735b4ba784e98fdc245a6885'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:28.445404 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-925addbd-6e77-4720-8dfd-7c728647b34f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad3069d5735b4ba784e98fdc245a6885'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:28.448385 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:28.480567 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a16f5b-6459-4dd7-a703-1042902d54a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:28.480567 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a16f5b-6459-4dd7-a703-1042902d54a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:28.480567 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a16f5b-6459-4dd7-a703-1042902d54a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:28.480567 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a16f5b-6459-4dd7-a703-1042902d54a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:28.481004 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a16f5b-6459-4dd7-a703-1042902d54a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:28.481004 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a16f5b-6459-4dd7-a703-1042902d54a0 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:28.482816 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-925addbd-6e77-4720-8dfd-7c728647b34f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad3069d5735b4ba784e98fdc245a6885'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:28.513354 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 903/1798] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:48:28.527084 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a16f5b-6459-4dd7-a703-1042902d54a0 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:28.529272 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-e7a16f5b-6459-4dd7-a703-1042902d54a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:28.541419 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 896/1799] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:48:26 2022] DELETE /identity/v3/users/ad3069d5735b4ba784e98fdc245a6885 => generated 0 bytes in 1813 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:48:28.564943 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a16f5b-6459-4dd7-a703-1042902d54a0 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:28.689675 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:28.715246 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e108d9f-64ee-49fc-8099-d05fe1313a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:28.716083 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e108d9f-64ee-49fc-8099-d05fe1313a16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:28.716530 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e108d9f-64ee-49fc-8099-d05fe1313a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:28.716897 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e108d9f-64ee-49fc-8099-d05fe1313a16 admin admin] PATH_INFO: `/v3/projects/dc7e3db1aaa4453a828c85c5922f459d/users/9467b9311f7044ef9e7520b355727da3/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:28.762283 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e108d9f-64ee-49fc-8099-d05fe1313a16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc7e3db1aaa4453a828c85c5922f459d, user_id=9467b9311f7044ef9e7520b355727da3, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:28.765331 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e108d9f-64ee-49fc-8099-d05fe1313a16 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:28.876517 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 904/1800] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:48:28 2022] PUT /identity/v3/projects/dc7e3db1aaa4453a828c85c5922f459d/users/9467b9311f7044ef9e7520b355727da3/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:48:28.877850 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15df576-ddda-4fb0-9b4b-42b1a5930e1a None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:28.878176 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15df576-ddda-4fb0-9b4b-42b1a5930e1a None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:28.878559 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15df576-ddda-4fb0-9b4b-42b1a5930e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:28.957185 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-a15df576-ddda-4fb0-9b4b-42b1a5930e1a None None] MFA Rules not processed for user `9467b9311f7044ef9e7520b355727da3`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:28.962034 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-a15df576-ddda-4fb0-9b4b-42b1a5930e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:29.120952 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 897/1801] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:28 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:29.126312 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e108d9f-64ee-49fc-8099-d05fe1313a16 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:29.253427 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e108d9f-64ee-49fc-8099-d05fe1313a16 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:29.258539 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a5195-e647-4b45-b573-1ededb8a2ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:29.259585 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a5195-e647-4b45-b573-1ededb8a2ce0 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:29.260048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756dfd7f-af2b-48af-8483-c3fa9a608382 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:29.260427 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756dfd7f-af2b-48af-8483-c3fa9a608382 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:29.260953 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756dfd7f-af2b-48af-8483-c3fa9a608382 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:29.261065 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a5195-e647-4b45-b573-1ededb8a2ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:29.261333 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a5195-e647-4b45-b573-1ededb8a2ce0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:29.262198 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432a5195-e647-4b45-b573-1ededb8a2ce0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:29.262587 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 898/1802] 10.222.0.42 () {54 vars in 921 bytes} [Fri Aug 5 02:48:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:48:29.264380 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432a5195-e647-4b45-b573-1ededb8a2ce0 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:29.300419 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186ef97-15f4-4139-916d-382d166dd6a7 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:29.300793 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186ef97-15f4-4139-916d-382d166dd6a7 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:29.301156 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186ef97-15f4-4139-916d-382d166dd6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:29.336751 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-3186ef97-15f4-4139-916d-382d166dd6a7 None None] MFA Rules not processed for user `55374d3bccd541c9a8f82da9b21c2fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:29.339995 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-3186ef97-15f4-4139-916d-382d166dd6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:29.419174 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 905/1803] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:48:29 2022] POST /identity/v3/projects => generated 399 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:48:29.424165 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a5195-e647-4b45-b573-1ededb8a2ce0 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:29.608635 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 899/1804] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Aug 5 02:48:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:48:29.621268 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a5195-e647-4b45-b573-1ededb8a2ce0 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:29.631067 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a572444-4653-48d5-a7b7-bbe6c8503cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:29.632046 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a572444-4653-48d5-a7b7-bbe6c8503cc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:29.632625 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a572444-4653-48d5-a7b7-bbe6c8503cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:29.633051 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a572444-4653-48d5-a7b7-bbe6c8503cc4 admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:29.634482 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a572444-4653-48d5-a7b7-bbe6c8503cc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:29.636546 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a572444-4653-48d5-a7b7-bbe6c8503cc4 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:29.784154 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 906/1805] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:48:29 2022] POST /identity/v3/users => generated 306 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:48:29.787000 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186ef97-15f4-4139-916d-382d166dd6a7 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:29.807042 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186ef97-15f4-4139-916d-382d166dd6a7 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:29.821597 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39010b27-103e-4609-9068-31e59f77e65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:29.823476 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39010b27-103e-4609-9068-31e59f77e65c admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:29.823476 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39010b27-103e-4609-9068-31e59f77e65c admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:29.823476 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39010b27-103e-4609-9068-31e59f77e65c admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:29.823476 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39010b27-103e-4609-9068-31e59f77e65c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:29.825194 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39010b27-103e-4609-9068-31e59f77e65c admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:29.877434 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 900/1806] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:48:29.878076 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a572444-4653-48d5-a7b7-bbe6c8503cc4 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:29.900408 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a572444-4653-48d5-a7b7-bbe6c8503cc4 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:29.910727 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5470a-f30e-44dc-875d-0a51c970a04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:29.911915 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5470a-f30e-44dc-875d-0a51c970a04e admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:29.915489 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5470a-f30e-44dc-875d-0a51c970a04e admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:29.915489 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5470a-f30e-44dc-875d-0a51c970a04e admin admin] PATH_INFO: `/v3/projects/a538fb5f029846e9a8bdebceda161f12/users/e4203383845947d483c6389f91f24919/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:29.976472 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5470a-f30e-44dc-875d-0a51c970a04e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a538fb5f029846e9a8bdebceda161f12, user_id=e4203383845947d483c6389f91f24919, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:29.991918 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5470a-f30e-44dc-875d-0a51c970a04e admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:30.094439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 907/1807] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:48:29 2022] PUT /identity/v3/projects/a538fb5f029846e9a8bdebceda161f12/users/e4203383845947d483c6389f91f24919/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:48:30.098407 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39010b27-103e-4609-9068-31e59f77e65c admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:30.118356 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39010b27-103e-4609-9068-31e59f77e65c admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:30.206662 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:30.217081 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190c79f-e082-4c68-828f-f59b419519ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:30.217970 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190c79f-e082-4c68-828f-f59b419519ca admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:30.219073 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190c79f-e082-4c68-828f-f59b419519ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:30.219073 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190c79f-e082-4c68-828f-f59b419519ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:30.219553 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c190c79f-e082-4c68-828f-f59b419519ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:30.221259 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c190c79f-e082-4c68-828f-f59b419519ca admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:30.232848 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 901/1808] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:48:30.237176 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5470a-f30e-44dc-875d-0a51c970a04e admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:30.251724 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5470a-f30e-44dc-875d-0a51c970a04e admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:30.257140 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c49db6-0580-450e-9e7d-60ad1a99e2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:30.258836 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c49db6-0580-450e-9e7d-60ad1a99e2a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:30.258836 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c49db6-0580-450e-9e7d-60ad1a99e2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:30.258836 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c49db6-0580-450e-9e7d-60ad1a99e2a5 admin admin] PATH_INFO: `/v3/projects/a538fb5f029846e9a8bdebceda161f12/users/e4203383845947d483c6389f91f24919/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:30.260587 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c49db6-0580-450e-9e7d-60ad1a99e2a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a538fb5f029846e9a8bdebceda161f12, user_id=e4203383845947d483c6389f91f24919, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:30.263273 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c49db6-0580-450e-9e7d-60ad1a99e2a5 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:30.276240 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 908/1809] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:48:30 2022] PUT /identity/v3/projects/a538fb5f029846e9a8bdebceda161f12/users/e4203383845947d483c6389f91f24919/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:48:30.287382 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7592eb-0c0f-4e60-b911-4d5b3c27949a None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:30.288706 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7592eb-0c0f-4e60-b911-4d5b3c27949a None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:30.289317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7592eb-0c0f-4e60-b911-4d5b3c27949a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:30.329393 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-ae7592eb-0c0f-4e60-b911-4d5b3c27949a None None] MFA Rules not processed for user `e4203383845947d483c6389f91f24919`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:30.331066 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-ae7592eb-0c0f-4e60-b911-4d5b3c27949a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:30.422248 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 902/1810] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:30 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:30.432949 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c49db6-0580-450e-9e7d-60ad1a99e2a5 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:30.434982 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-91c49db6-0580-450e-9e7d-60ad1a99e2a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:30.447448 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:30.501236 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c49db6-0580-450e-9e7d-60ad1a99e2a5 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:30.505082 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f4f2c-8c4c-4ba9-8b55-326a55b04512 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:30.505784 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f4f2c-8c4c-4ba9-8b55-326a55b04512 service cinder] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:30.506134 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f4f2c-8c4c-4ba9-8b55-326a55b04512 service cinder] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:30.506624 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f4f2c-8c4c-4ba9-8b55-326a55b04512 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:30.516285 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82f4f2c-8c4c-4ba9-8b55-326a55b04512 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:30.517773 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82f4f2c-8c4c-4ba9-8b55-326a55b04512 service cinder] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:30.527332 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 909/1811] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:48:30 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:48:30.679242 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7592eb-0c0f-4e60-b911-4d5b3c27949a None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:30.689027 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7592eb-0c0f-4e60-b911-4d5b3c27949a None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:30.692707 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872976cc-af78-481e-a55f-125fefc004f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:30.693353 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872976cc-af78-481e-a55f-125fefc004f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:30.693702 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872976cc-af78-481e-a55f-125fefc004f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:30.693985 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872976cc-af78-481e-a55f-125fefc004f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:30.774597 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872976cc-af78-481e-a55f-125fefc004f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:30.776335 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872976cc-af78-481e-a55f-125fefc004f0 service cinder] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:30.789600 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 903/1812] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:48:30 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:48:31.014274 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f4f2c-8c4c-4ba9-8b55-326a55b04512 service cinder] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:31.018413 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-d82f4f2c-8c4c-4ba9-8b55-326a55b04512 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:31.021882 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872976cc-af78-481e-a55f-125fefc004f0 service cinder] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:31.024015 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-872976cc-af78-481e-a55f-125fefc004f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:31.158378 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872976cc-af78-481e-a55f-125fefc004f0 service cinder] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:31.164752 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658bfc7-c679-493c-a471-7f982fd2b279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:31.167858 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658bfc7-c679-493c-a471-7f982fd2b279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:31.167858 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658bfc7-c679-493c-a471-7f982fd2b279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:31.167858 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658bfc7-c679-493c-a471-7f982fd2b279 admin admin] PATH_INFO: `/v3/projects/9cff67a247fa4fe0b01fa640cd2405ba` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:31.167858 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f658bfc7-c679-493c-a471-7f982fd2b279 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cff67a247fa4fe0b01fa640cd2405ba)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:31.169539 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f658bfc7-c679-493c-a471-7f982fd2b279 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:31.190780 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f4f2c-8c4c-4ba9-8b55-326a55b04512 service cinder] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:31.190879 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:31.200819 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7621e5-16bc-41e9-8f2f-0c649800dda2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:31.202859 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7621e5-16bc-41e9-8f2f-0c649800dda2 service nova] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:31.203176 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7621e5-16bc-41e9-8f2f-0c649800dda2 service nova] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:31.203892 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7621e5-16bc-41e9-8f2f-0c649800dda2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:31.217349 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7621e5-16bc-41e9-8f2f-0c649800dda2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:31.218541 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7621e5-16bc-41e9-8f2f-0c649800dda2 service nova] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:31.256213 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 910/1813] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:48:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:48:31.293836 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-f658bfc7-c679-493c-a471-7f982fd2b279 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cff67a247fa4fe0b01fa640cd2405ba', 'request_id': 'req-f658bfc7-c679-493c-a471-7f982fd2b279'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:31.376890 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-f658bfc7-c679-493c-a471-7f982fd2b279 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cff67a247fa4fe0b01fa640cd2405ba', 'request_id': 'req-f658bfc7-c679-493c-a471-7f982fd2b279'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:31.383442 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-f658bfc7-c679-493c-a471-7f982fd2b279 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cff67a247fa4fe0b01fa640cd2405ba', 'request_id': 'req-f658bfc7-c679-493c-a471-7f982fd2b279'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:31.404539 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-f658bfc7-c679-493c-a471-7f982fd2b279 admin admin] The token cache is being invalidate because project 9cff67a247fa4fe0b01fa640cd2405ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:48:31.404920 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-f658bfc7-c679-493c-a471-7f982fd2b279 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:31.405685 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-f658bfc7-c679-493c-a471-7f982fd2b279 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:31.415517 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8c11c-850b-4e4f-8fdf-c4869ae4dd2b None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:31.415517 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8c11c-850b-4e4f-8fdf-c4869ae4dd2b None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:31.415517 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8c11c-850b-4e4f-8fdf-c4869ae4dd2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:31.425142 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 904/1814] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:48:31 2022] DELETE /identity/v3/projects/9cff67a247fa4fe0b01fa640cd2405ba => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:48:31.443352 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-f5b8c11c-850b-4e4f-8fdf-c4869ae4dd2b None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:31.444644 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-f5b8c11c-850b-4e4f-8fdf-c4869ae4dd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:31.535172 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 911/1815] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:31.549268 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d71d3-2ba1-41e5-bfe8-25e22ee86365 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:31.549562 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d71d3-2ba1-41e5-bfe8-25e22ee86365 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:31.549873 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d71d3-2ba1-41e5-bfe8-25e22ee86365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:31.590278 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-554d71d3-2ba1-41e5-bfe8-25e22ee86365 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:31.591627 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-554d71d3-2ba1-41e5-bfe8-25e22ee86365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:31.607859 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 905/1816] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:31.608053 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b8c11c-850b-4e4f-8fdf-c4869ae4dd2b None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:31.619606 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b8c11c-850b-4e4f-8fdf-c4869ae4dd2b None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:31.623502 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08983dd-7cf2-41b3-a0ed-a9518af38ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:31.624270 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08983dd-7cf2-41b3-a0ed-a9518af38ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:31.624617 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08983dd-7cf2-41b3-a0ed-a9518af38ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:31.624960 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08983dd-7cf2-41b3-a0ed-a9518af38ad0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:31.625765 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08983dd-7cf2-41b3-a0ed-a9518af38ad0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:48:31.626506 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08983dd-7cf2-41b3-a0ed-a9518af38ad0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:31.628363 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08983dd-7cf2-41b3-a0ed-a9518af38ad0 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:31.641916 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 912/1817] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:48:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:48:31.646276 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d71d3-2ba1-41e5-bfe8-25e22ee86365 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:31.655672 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d71d3-2ba1-41e5-bfe8-25e22ee86365 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:31.660861 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ee92c-11f3-4e12-b392-9beba0b534fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:31.661673 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ee92c-11f3-4e12-b392-9beba0b534fb admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:31.661954 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ee92c-11f3-4e12-b392-9beba0b534fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:31.662375 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ee92c-11f3-4e12-b392-9beba0b534fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:31.663241 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ee92c-11f3-4e12-b392-9beba0b534fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:31.665221 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ee92c-11f3-4e12-b392-9beba0b534fb admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:31.751096 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 906/1818] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:48:31 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:48:31.755408 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08983dd-7cf2-41b3-a0ed-a9518af38ad0 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:31.765300 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08983dd-7cf2-41b3-a0ed-a9518af38ad0 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:31.788149 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:31.828356 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe8d73-435f-4316-886e-25e1db433322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:31.829647 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe8d73-435f-4316-886e-25e1db433322 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:31.829977 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe8d73-435f-4316-886e-25e1db433322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:31.830252 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe8d73-435f-4316-886e-25e1db433322 admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:31.830920 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe8d73-435f-4316-886e-25e1db433322 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:31.833067 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe8d73-435f-4316-886e-25e1db433322 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:31.981385 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 913/1819] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:48:31 2022] POST /identity/v3/users => generated 290 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:48:31.988581 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ee92c-11f3-4e12-b392-9beba0b534fb admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:31.999424 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ee92c-11f3-4e12-b392-9beba0b534fb admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:32.004972 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8178b-e8aa-4025-ac91-4c39b37602bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:32.007935 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8178b-e8aa-4025-ac91-4c39b37602bb admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:32.007935 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8178b-e8aa-4025-ac91-4c39b37602bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:32.007935 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8178b-e8aa-4025-ac91-4c39b37602bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:32.007935 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8178b-e8aa-4025-ac91-4c39b37602bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:32.019750 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8178b-e8aa-4025-ac91-4c39b37602bb admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:32.032184 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 907/1820] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:48:32.036610 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe8d73-435f-4316-886e-25e1db433322 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:32.057070 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe8d73-435f-4316-886e-25e1db433322 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:32.066119 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd19bb-7359-41a3-ab98-8c4777415589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:32.066808 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd19bb-7359-41a3-ab98-8c4777415589 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:32.067137 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd19bb-7359-41a3-ab98-8c4777415589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:32.067514 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd19bb-7359-41a3-ab98-8c4777415589 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:32.068225 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dd19bb-7359-41a3-ab98-8c4777415589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:32.070493 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dd19bb-7359-41a3-ab98-8c4777415589 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:32.085196 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 914/1821] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:48:32.089348 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8178b-e8aa-4025-ac91-4c39b37602bb admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:32.102003 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8178b-e8aa-4025-ac91-4c39b37602bb admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:32.108181 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b652ea-2c57-462d-bd14-d6d2e7ccb3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:32.109383 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b652ea-2c57-462d-bd14-d6d2e7ccb3bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:32.109681 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b652ea-2c57-462d-bd14-d6d2e7ccb3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:32.110015 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b652ea-2c57-462d-bd14-d6d2e7ccb3bc admin admin] PATH_INFO: `/v3/projects/f4f6f6869c1240f6a84f58e10f79fb95/users/763a51d5a1c54f1a97c48457d9d91df8/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:32.135450 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b652ea-2c57-462d-bd14-d6d2e7ccb3bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4f6f6869c1240f6a84f58e10f79fb95, user_id=763a51d5a1c54f1a97c48457d9d91df8, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:32.138146 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b652ea-2c57-462d-bd14-d6d2e7ccb3bc admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:32.239682 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 908/1822] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:48:32 2022] PUT /identity/v3/projects/f4f6f6869c1240f6a84f58e10f79fb95/users/763a51d5a1c54f1a97c48457d9d91df8/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:48:32.249358 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc58129-cac6-483f-8afe-11aab62e0645 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:32.249658 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc58129-cac6-483f-8afe-11aab62e0645 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:32.249935 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc58129-cac6-483f-8afe-11aab62e0645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:32.284187 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-bcc58129-cac6-483f-8afe-11aab62e0645 None None] MFA Rules not processed for user `763a51d5a1c54f1a97c48457d9d91df8`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:32.287585 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-bcc58129-cac6-483f-8afe-11aab62e0645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:32.351788 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 915/1823] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:48:32.356317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b652ea-2c57-462d-bd14-d6d2e7ccb3bc admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:32.418002 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b652ea-2c57-462d-bd14-d6d2e7ccb3bc admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:32.423236 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308ece8-acb2-4c3e-9c4c-b2df2682a2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:32.423850 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308ece8-acb2-4c3e-9c4c-b2df2682a2b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:32.424136 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308ece8-acb2-4c3e-9c4c-b2df2682a2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:32.424417 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308ece8-acb2-4c3e-9c4c-b2df2682a2b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:32.425086 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8308ece8-acb2-4c3e-9c4c-b2df2682a2b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:32.427021 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8308ece8-acb2-4c3e-9c4c-b2df2682a2b4 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:32.532209 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc58129-cac6-483f-8afe-11aab62e0645 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:32.542323 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 909/1824] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:48:32 2022] POST /identity/v3/projects => generated 379 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:48:32.544208 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc58129-cac6-483f-8afe-11aab62e0645 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:32.662156 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4059063-c399-436a-b557-9effded2176d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:32.663191 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4059063-c399-436a-b557-9effded2176d admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:32.663741 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4059063-c399-436a-b557-9effded2176d admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:32.664192 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4059063-c399-436a-b557-9effded2176d admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:32.664988 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4059063-c399-436a-b557-9effded2176d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:32.667486 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4059063-c399-436a-b557-9effded2176d admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:32.795417 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 916/1825] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:48:32 2022] POST /identity/v3/users => generated 296 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:48:32.799078 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308ece8-acb2-4c3e-9c4c-b2df2682a2b4 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:32.814226 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308ece8-acb2-4c3e-9c4c-b2df2682a2b4 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:32.819898 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59878c68-b65d-4e7b-8721-c079cc69b3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:32.821028 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59878c68-b65d-4e7b-8721-c079cc69b3bc admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:32.821537 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59878c68-b65d-4e7b-8721-c079cc69b3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:32.822009 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59878c68-b65d-4e7b-8721-c079cc69b3bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:32.822940 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59878c68-b65d-4e7b-8721-c079cc69b3bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:32.824730 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59878c68-b65d-4e7b-8721-c079cc69b3bc admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:32.839459 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 910/1826] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:48:32.844710 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4059063-c399-436a-b557-9effded2176d admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:32.855956 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4059063-c399-436a-b557-9effded2176d admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:32.861885 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0350e62-fb39-4eca-a404-5e5b9c658f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:32.863052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0350e62-fb39-4eca-a404-5e5b9c658f05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:32.863415 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0350e62-fb39-4eca-a404-5e5b9c658f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:32.863775 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0350e62-fb39-4eca-a404-5e5b9c658f05 admin admin] PATH_INFO: `/v3/projects/ede1770b40a041008f80a78be1325576/users/407ae80cf7b44e60bf7e0b5bc4491062/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:32.880488 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0350e62-fb39-4eca-a404-5e5b9c658f05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ede1770b40a041008f80a78be1325576, user_id=407ae80cf7b44e60bf7e0b5bc4491062, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:32.883531 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0350e62-fb39-4eca-a404-5e5b9c658f05 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:32.977869 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:32.988242 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 917/1827] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:48:32 2022] PUT /identity/v3/projects/ede1770b40a041008f80a78be1325576/users/407ae80cf7b44e60bf7e0b5bc4491062/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:48:32.990166 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59878c68-b65d-4e7b-8721-c079cc69b3bc admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:33.009321 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59878c68-b65d-4e7b-8721-c079cc69b3bc admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:33.037814 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:33.106828 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a2db4a-52bc-440b-b87b-bcc0f0118af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:33.107487 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2db4a-52bc-440b-b87b-bcc0f0118af7 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:33.107776 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2db4a-52bc-440b-b87b-bcc0f0118af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:33.108057 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2db4a-52bc-440b-b87b-bcc0f0118af7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:33.108756 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a2db4a-52bc-440b-b87b-bcc0f0118af7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:33.110440 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a2db4a-52bc-440b-b87b-bcc0f0118af7 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:33.124501 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 911/1828] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:48:33.128308 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0350e62-fb39-4eca-a404-5e5b9c658f05 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:33.140045 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0350e62-fb39-4eca-a404-5e5b9c658f05 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:33.154125 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e8ddd0-0499-4d41-90cf-61bb331b81ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:33.154821 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8ddd0-0499-4d41-90cf-61bb331b81ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:33.155134 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8ddd0-0499-4d41-90cf-61bb331b81ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:33.155416 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8ddd0-0499-4d41-90cf-61bb331b81ef admin admin] PATH_INFO: `/v3/projects/ede1770b40a041008f80a78be1325576/users/407ae80cf7b44e60bf7e0b5bc4491062/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:33.158039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e8ddd0-0499-4d41-90cf-61bb331b81ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=ede1770b40a041008f80a78be1325576, user_id=407ae80cf7b44e60bf7e0b5bc4491062, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:33.160743 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e8ddd0-0499-4d41-90cf-61bb331b81ef admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:33.175825 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 918/1829] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:48:33 2022] PUT /identity/v3/projects/ede1770b40a041008f80a78be1325576/users/407ae80cf7b44e60bf7e0b5bc4491062/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:48:33.189937 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0fccf-ab6f-49e4-a190-d1b89595db07 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:33.190282 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0fccf-ab6f-49e4-a190-d1b89595db07 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:33.190563 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0fccf-ab6f-49e4-a190-d1b89595db07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:33.226620 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-b9f0fccf-ab6f-49e4-a190-d1b89595db07 None None] MFA Rules not processed for user `407ae80cf7b44e60bf7e0b5bc4491062`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:33.227999 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-b9f0fccf-ab6f-49e4-a190-d1b89595db07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:33.356356 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 912/1830] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:33 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:33.369286 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e8ddd0-0499-4d41-90cf-61bb331b81ef admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:33.376423 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-b9e8ddd0-0499-4d41-90cf-61bb331b81ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:33.453456 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e8ddd0-0499-4d41-90cf-61bb331b81ef admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:33.458405 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2913868-5974-4728-bf8f-a81404c463e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:33.459362 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2913868-5974-4728-bf8f-a81404c463e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:33.459953 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2913868-5974-4728-bf8f-a81404c463e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:33.460538 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2913868-5974-4728-bf8f-a81404c463e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:33.472721 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2913868-5974-4728-bf8f-a81404c463e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:33.473896 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2913868-5974-4728-bf8f-a81404c463e3 service cinder] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:33.495394 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 919/1831] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:48:33 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:48:33.682199 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f0fccf-ab6f-49e4-a190-d1b89595db07 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:33.684053 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-b9f0fccf-ab6f-49e4-a190-d1b89595db07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:33.706246 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f0fccf-ab6f-49e4-a190-d1b89595db07 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:33.710076 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09419bac-0c28-4ec7-bd02-3e8e4093ecc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:33.710782 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09419bac-0c28-4ec7-bd02-3e8e4093ecc4 service cinder] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:33.711169 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09419bac-0c28-4ec7-bd02-3e8e4093ecc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:33.711542 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09419bac-0c28-4ec7-bd02-3e8e4093ecc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:33.790824 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09419bac-0c28-4ec7-bd02-3e8e4093ecc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:33.792812 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09419bac-0c28-4ec7-bd02-3e8e4093ecc4 service cinder] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:33.836009 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 913/1832] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:48:33 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:48:35.716333 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c4e88-5dce-472d-aa90-87882af2e06e None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:35.717297 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c4e88-5dce-472d-aa90-87882af2e06e None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:35.717834 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c4e88-5dce-472d-aa90-87882af2e06e None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:35.720036 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 920/1833] 10.222.0.42 () {54 vars in 921 bytes} [Fri Aug 5 02:48:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:48:35.732764 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d705c-8312-45e1-86d9-b31b6c4d5ba3 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:35.732764 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d705c-8312-45e1-86d9-b31b6c4d5ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:35.733448 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d705c-8312-45e1-86d9-b31b6c4d5ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:35.758840 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-ba5d705c-8312-45e1-86d9-b31b6c4d5ba3 None None] MFA Rules not processed for user `55374d3bccd541c9a8f82da9b21c2fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:35.760669 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-ba5d705c-8312-45e1-86d9-b31b6c4d5ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:35.808030 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:35.854220 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 914/1834] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Aug 5 02:48:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:48:35.878333 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c4e88-5dce-472d-aa90-87882af2e06e None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:35.880527 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-2e1c4e88-5dce-472d-aa90-87882af2e06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:35.911053 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c4e88-5dce-472d-aa90-87882af2e06e None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:35.920161 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07ed49-8ce3-4412-8c45-8232f2b314e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:35.921437 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07ed49-8ce3-4412-8c45-8232f2b314e3 service nova] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:35.921796 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07ed49-8ce3-4412-8c45-8232f2b314e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:35.922313 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07ed49-8ce3-4412-8c45-8232f2b314e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:35.935398 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f07ed49-8ce3-4412-8c45-8232f2b314e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:35.938048 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f07ed49-8ce3-4412-8c45-8232f2b314e3 service nova] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:35.952209 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 921/1835] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:48:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:48:36.198245 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d705c-8312-45e1-86d9-b31b6c4d5ba3 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:36.199963 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-ba5d705c-8312-45e1-86d9-b31b6c4d5ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:36.346195 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d705c-8312-45e1-86d9-b31b6c4d5ba3 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:36.352478 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64d080-7df7-47eb-b1ef-266e6cdaca61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:36.353377 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64d080-7df7-47eb-b1ef-266e6cdaca61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:36.353738 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64d080-7df7-47eb-b1ef-266e6cdaca61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:36.354094 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64d080-7df7-47eb-b1ef-266e6cdaca61 admin admin] PATH_INFO: `/v3/users/9467b9311f7044ef9e7520b355727da3` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:36.355457 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b64d080-7df7-47eb-b1ef-266e6cdaca61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9467b9311f7044ef9e7520b355727da3)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:36.357668 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b64d080-7df7-47eb-b1ef-266e6cdaca61 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:36.615815 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-0b64d080-7df7-47eb-b1ef-266e6cdaca61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9467b9311f7044ef9e7520b355727da3'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:36.720140 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-0b64d080-7df7-47eb-b1ef-266e6cdaca61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9467b9311f7044ef9e7520b355727da3'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:36.731966 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-0b64d080-7df7-47eb-b1ef-266e6cdaca61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9467b9311f7044ef9e7520b355727da3'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:36.735184 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-0b64d080-7df7-47eb-b1ef-266e6cdaca61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9467b9311f7044ef9e7520b355727da3'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:36.772819 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-0b64d080-7df7-47eb-b1ef-266e6cdaca61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9467b9311f7044ef9e7520b355727da3'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:36.791288 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 915/1836] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:48:36 2022] DELETE /identity/v3/users/9467b9311f7044ef9e7520b355727da3 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:48:36.793291 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326c3d8-6680-41ca-8751-b05353bc27d8 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:36.793780 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326c3d8-6680-41ca-8751-b05353bc27d8 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:36.793858 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326c3d8-6680-41ca-8751-b05353bc27d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:36.846522 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-8326c3d8-6680-41ca-8751-b05353bc27d8 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:36.847984 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-8326c3d8-6680-41ca-8751-b05353bc27d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:36.945065 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 922/1837] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:36.991399 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64d080-7df7-47eb-b1ef-266e6cdaca61 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:36.992229 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-0b64d080-7df7-47eb-b1ef-266e6cdaca61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:37.066181 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:37.077213 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64d080-7df7-47eb-b1ef-266e6cdaca61 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:37.082762 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc7722-0e39-45f7-a925-4bd2b2adf4ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:37.083509 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc7722-0e39-45f7-a925-4bd2b2adf4ce service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:37.083767 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc7722-0e39-45f7-a925-4bd2b2adf4ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:37.084047 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc7722-0e39-45f7-a925-4bd2b2adf4ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:37.094863 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc7722-0e39-45f7-a925-4bd2b2adf4ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:37.098552 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc7722-0e39-45f7-a925-4bd2b2adf4ce service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:37.107033 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 916/1838] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:48:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:48:37.535431 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326c3d8-6680-41ca-8751-b05353bc27d8 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:37.538941 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-8326c3d8-6680-41ca-8751-b05353bc27d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:37.549426 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326c3d8-6680-41ca-8751-b05353bc27d8 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:37.554174 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b66127-dc3e-4b41-a69a-b8ebaaca531f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:37.554827 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b66127-dc3e-4b41-a69a-b8ebaaca531f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:37.555307 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b66127-dc3e-4b41-a69a-b8ebaaca531f admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:37.555586 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b66127-dc3e-4b41-a69a-b8ebaaca531f admin admin] PATH_INFO: `/v3/users/763a51d5a1c54f1a97c48457d9d91df8` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:37.556778 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b66127-dc3e-4b41-a69a-b8ebaaca531f admin admin] RBAC: Authorizing `identity:delete_user(user_id=763a51d5a1c54f1a97c48457d9d91df8)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:37.558714 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b66127-dc3e-4b41-a69a-b8ebaaca531f admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:37.617842 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc7722-0e39-45f7-a925-4bd2b2adf4ce service neutron] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:37.619345 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-74dc7722-0e39-45f7-a925-4bd2b2adf4ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:37.640062 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc7722-0e39-45f7-a925-4bd2b2adf4ce service neutron] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:37.647273 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247248fd-1cd4-40f5-94f1-f33e8ad786a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:37.648119 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247248fd-1cd4-40f5-94f1-f33e8ad786a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:37.648467 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247248fd-1cd4-40f5-94f1-f33e8ad786a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:37.648851 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247248fd-1cd4-40f5-94f1-f33e8ad786a0 admin admin] PATH_INFO: `/v3/projects/dc7e3db1aaa4453a828c85c5922f459d` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:37.650252 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247248fd-1cd4-40f5-94f1-f33e8ad786a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc7e3db1aaa4453a828c85c5922f459d)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:37.652981 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247248fd-1cd4-40f5-94f1-f33e8ad786a0 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:37.769450 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-04b66127-dc3e-4b41-a69a-b8ebaaca531f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '763a51d5a1c54f1a97c48457d9d91df8'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:37.773986 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-247248fd-1cd4-40f5-94f1-f33e8ad786a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc7e3db1aaa4453a828c85c5922f459d', 'request_id': 'req-247248fd-1cd4-40f5-94f1-f33e8ad786a0'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:37.873157 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-04b66127-dc3e-4b41-a69a-b8ebaaca531f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '763a51d5a1c54f1a97c48457d9d91df8'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:37.881234 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-04b66127-dc3e-4b41-a69a-b8ebaaca531f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '763a51d5a1c54f1a97c48457d9d91df8'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:37.887132 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:37.895454 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-04b66127-dc3e-4b41-a69a-b8ebaaca531f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '763a51d5a1c54f1a97c48457d9d91df8'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:37.896172 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-04b66127-dc3e-4b41-a69a-b8ebaaca531f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '763a51d5a1c54f1a97c48457d9d91df8'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:37.903215 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 923/1839] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:48:37 2022] DELETE /identity/v3/users/763a51d5a1c54f1a97c48457d9d91df8 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:48:37.909355 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ecefb-80fc-4712-909d-59b45dd0f67c None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:37.909355 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ecefb-80fc-4712-909d-59b45dd0f67c None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:37.909355 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ecefb-80fc-4712-909d-59b45dd0f67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:37.929438 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-047ecefb-80fc-4712-909d-59b45dd0f67c None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:37.930640 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-047ecefb-80fc-4712-909d-59b45dd0f67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:37.954022 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-247248fd-1cd4-40f5-94f1-f33e8ad786a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc7e3db1aaa4453a828c85c5922f459d', 'request_id': 'req-247248fd-1cd4-40f5-94f1-f33e8ad786a0'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:37.960851 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-247248fd-1cd4-40f5-94f1-f33e8ad786a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc7e3db1aaa4453a828c85c5922f459d', 'request_id': 'req-247248fd-1cd4-40f5-94f1-f33e8ad786a0'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:37.973278 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-247248fd-1cd4-40f5-94f1-f33e8ad786a0 admin admin] The token cache is being invalidate because project dc7e3db1aaa4453a828c85c5922f459d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:48:37.973578 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-247248fd-1cd4-40f5-94f1-f33e8ad786a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:37.975035 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-247248fd-1cd4-40f5-94f1-f33e8ad786a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:37.976865 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 917/1840] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:48:37 2022] DELETE /identity/v3/projects/dc7e3db1aaa4453a828c85c5922f459d => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:48:37.980918 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247248fd-1cd4-40f5-94f1-f33e8ad786a0 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:37.982578 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-247248fd-1cd4-40f5-94f1-f33e8ad786a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:38.001469 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 924/1841] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:48:38.008157 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ecefb-80fc-4712-909d-59b45dd0f67c None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:38.010509 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-047ecefb-80fc-4712-909d-59b45dd0f67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:38.077886 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ecefb-80fc-4712-909d-59b45dd0f67c None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:38.082723 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f07da-28b7-4908-b577-6b9fdbd33a6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:38.083210 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f07da-28b7-4908-b577-6b9fdbd33a6e service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:38.083495 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f07da-28b7-4908-b577-6b9fdbd33a6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:38.083772 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f07da-28b7-4908-b577-6b9fdbd33a6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:38.089155 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247248fd-1cd4-40f5-94f1-f33e8ad786a0 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:38.094943 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc230879-c927-4680-9ac2-f99dc760cb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:38.095303 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f07da-28b7-4908-b577-6b9fdbd33a6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:38.095662 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc230879-c927-4680-9ac2-f99dc760cb51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:38.095943 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc230879-c927-4680-9ac2-f99dc760cb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:38.096169 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc230879-c927-4680-9ac2-f99dc760cb51 admin admin] PATH_INFO: `/v3/users/e4203383845947d483c6389f91f24919` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:38.096879 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f07da-28b7-4908-b577-6b9fdbd33a6e service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:38.097357 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc230879-c927-4680-9ac2-f99dc760cb51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4203383845947d483c6389f91f24919)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:38.099358 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc230879-c927-4680-9ac2-f99dc760cb51 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:38.108950 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 925/1842] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:48:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:48:38.271498 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-fc230879-c927-4680-9ac2-f99dc760cb51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4203383845947d483c6389f91f24919'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:38.354900 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-fc230879-c927-4680-9ac2-f99dc760cb51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4203383845947d483c6389f91f24919'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:38.373322 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-fc230879-c927-4680-9ac2-f99dc760cb51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4203383845947d483c6389f91f24919'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:38.374991 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-fc230879-c927-4680-9ac2-f99dc760cb51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4203383845947d483c6389f91f24919'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:38.405904 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-fc230879-c927-4680-9ac2-f99dc760cb51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4203383845947d483c6389f91f24919'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:38.413174 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 918/1843] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:48:37 2022] DELETE /identity/v3/users/e4203383845947d483c6389f91f24919 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:48:38.830086 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:38.891737 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f07da-28b7-4908-b577-6b9fdbd33a6e service neutron] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:38.904455 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f07da-28b7-4908-b577-6b9fdbd33a6e service neutron] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:38.988328 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48136c8-a7a3-427b-a3c9-9bdcce02e6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:38.989032 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48136c8-a7a3-427b-a3c9-9bdcce02e6da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:38.989318 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48136c8-a7a3-427b-a3c9-9bdcce02e6da admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:38.989598 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48136c8-a7a3-427b-a3c9-9bdcce02e6da admin admin] PATH_INFO: `/v3/projects/a538fb5f029846e9a8bdebceda161f12` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:38.990771 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48136c8-a7a3-427b-a3c9-9bdcce02e6da admin admin] RBAC: Authorizing `identity:delete_project(project_id=a538fb5f029846e9a8bdebceda161f12)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:38.992854 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48136c8-a7a3-427b-a3c9-9bdcce02e6da admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:39.074300 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-f48136c8-a7a3-427b-a3c9-9bdcce02e6da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a538fb5f029846e9a8bdebceda161f12', 'request_id': 'req-f48136c8-a7a3-427b-a3c9-9bdcce02e6da'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:39.122294 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc230879-c927-4680-9ac2-f99dc760cb51 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:39.124334 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-fc230879-c927-4680-9ac2-f99dc760cb51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:39.130341 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-f48136c8-a7a3-427b-a3c9-9bdcce02e6da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a538fb5f029846e9a8bdebceda161f12', 'request_id': 'req-f48136c8-a7a3-427b-a3c9-9bdcce02e6da'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:39.143482 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-f48136c8-a7a3-427b-a3c9-9bdcce02e6da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a538fb5f029846e9a8bdebceda161f12', 'request_id': 'req-f48136c8-a7a3-427b-a3c9-9bdcce02e6da'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:39.168616 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc230879-c927-4680-9ac2-f99dc760cb51 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:39.170614 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-f48136c8-a7a3-427b-a3c9-9bdcce02e6da admin admin] The token cache is being invalidate because project a538fb5f029846e9a8bdebceda161f12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:48:39.170916 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-f48136c8-a7a3-427b-a3c9-9bdcce02e6da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:39.180437 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-f48136c8-a7a3-427b-a3c9-9bdcce02e6da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:39.186310 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 926/1844] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:48:38 2022] DELETE /identity/v3/projects/a538fb5f029846e9a8bdebceda161f12 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:48:39.191143 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8abc6-a64a-4bc5-a88f-a10af1a0649f None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:39.192734 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8abc6-a64a-4bc5-a88f-a10af1a0649f None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:39.193492 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8abc6-a64a-4bc5-a88f-a10af1a0649f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:39.239480 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-b4c8abc6-a64a-4bc5-a88f-a10af1a0649f None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:39.242629 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-b4c8abc6-a64a-4bc5-a88f-a10af1a0649f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:39.291414 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4e8e9-00d2-4074-93be-6eaa3e0613f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:39.293947 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4e8e9-00d2-4074-93be-6eaa3e0613f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:39.294311 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4e8e9-00d2-4074-93be-6eaa3e0613f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:39.294789 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4e8e9-00d2-4074-93be-6eaa3e0613f4 admin admin] PATH_INFO: `/v3/projects/f4f6f6869c1240f6a84f58e10f79fb95` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:39.296296 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4e8e9-00d2-4074-93be-6eaa3e0613f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4f6f6869c1240f6a84f58e10f79fb95)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:39.298490 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4e8e9-00d2-4074-93be-6eaa3e0613f4 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:39.336634 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 927/1845] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:39.352158 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e90cc5-4fa6-411d-98fe-5ee65899f97b None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:39.352449 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e90cc5-4fa6-411d-98fe-5ee65899f97b None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:39.352729 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e90cc5-4fa6-411d-98fe-5ee65899f97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:39.371523 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-40e90cc5-4fa6-411d-98fe-5ee65899f97b None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:39.372777 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-40e90cc5-4fa6-411d-98fe-5ee65899f97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:39.381122 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 928/1846] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:48:39.384946 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e90cc5-4fa6-411d-98fe-5ee65899f97b None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:39.394339 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e90cc5-4fa6-411d-98fe-5ee65899f97b None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:39.399098 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40dd888-6ccc-447e-963b-9217f43f8eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:39.399705 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40dd888-6ccc-447e-963b-9217f43f8eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:39.399988 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40dd888-6ccc-447e-963b-9217f43f8eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:39.400266 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40dd888-6ccc-447e-963b-9217f43f8eb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:39.400971 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40dd888-6ccc-447e-963b-9217f43f8eb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:48:39.401277 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40dd888-6ccc-447e-963b-9217f43f8eb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:39.402935 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40dd888-6ccc-447e-963b-9217f43f8eb6 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:39.414925 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 929/1847] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:48:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:48:39.419171 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40dd888-6ccc-447e-963b-9217f43f8eb6 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:39.428651 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40dd888-6ccc-447e-963b-9217f43f8eb6 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:39.430705 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-50f4e8e9-00d2-4074-93be-6eaa3e0613f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4f6f6869c1240f6a84f58e10f79fb95', 'request_id': 'req-50f4e8e9-00d2-4074-93be-6eaa3e0613f4'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:39.495601 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337d5af-3c40-4a56-99be-70eab774702e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:39.496239 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337d5af-3c40-4a56-99be-70eab774702e admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:39.496527 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337d5af-3c40-4a56-99be-70eab774702e admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:39.496806 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337d5af-3c40-4a56-99be-70eab774702e admin admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:39.497508 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6337d5af-3c40-4a56-99be-70eab774702e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:39.499498 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6337d5af-3c40-4a56-99be-70eab774702e admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:39.503512 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-50f4e8e9-00d2-4074-93be-6eaa3e0613f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4f6f6869c1240f6a84f58e10f79fb95', 'request_id': 'req-50f4e8e9-00d2-4074-93be-6eaa3e0613f4'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:39.511342 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-50f4e8e9-00d2-4074-93be-6eaa3e0613f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4f6f6869c1240f6a84f58e10f79fb95', 'request_id': 'req-50f4e8e9-00d2-4074-93be-6eaa3e0613f4'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:39.524025 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-50f4e8e9-00d2-4074-93be-6eaa3e0613f4 admin admin] The token cache is being invalidate because project f4f6f6869c1240f6a84f58e10f79fb95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:48:39.524310 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-50f4e8e9-00d2-4074-93be-6eaa3e0613f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:39.525011 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-50f4e8e9-00d2-4074-93be-6eaa3e0613f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:39.526584 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 919/1848] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:48:39 2022] DELETE /identity/v3/projects/f4f6f6869c1240f6a84f58e10f79fb95 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:48:39.531114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4e8e9-00d2-4074-93be-6eaa3e0613f4 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:39.531998 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-50f4e8e9-00d2-4074-93be-6eaa3e0613f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:39.544521 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4e8e9-00d2-4074-93be-6eaa3e0613f4 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:39.549279 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e8267-cd92-491b-8dd6-b03f0bada2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:39.549925 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e8267-cd92-491b-8dd6-b03f0bada2d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:39.550206 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e8267-cd92-491b-8dd6-b03f0bada2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:39.550477 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e8267-cd92-491b-8dd6-b03f0bada2d9 admin admin] PATH_INFO: `/v3/users/407ae80cf7b44e60bf7e0b5bc4491062` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:39.551781 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e8267-cd92-491b-8dd6-b03f0bada2d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=407ae80cf7b44e60bf7e0b5bc4491062)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:39.553559 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e8267-cd92-491b-8dd6-b03f0bada2d9 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:39.576361 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:39.632576 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 930/1849] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:48:39 2022] POST /identity/v3/projects => generated 367 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:48:39.633823 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337d5af-3c40-4a56-99be-70eab774702e admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:39.635422 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-6337d5af-3c40-4a56-99be-70eab774702e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:39.702924 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337d5af-3c40-4a56-99be-70eab774702e admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:39.711686 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458def49-b09f-4642-ba2e-6135a08f35b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:39.712348 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458def49-b09f-4642-ba2e-6135a08f35b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:39.712610 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458def49-b09f-4642-ba2e-6135a08f35b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:39.712882 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458def49-b09f-4642-ba2e-6135a08f35b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:39.713556 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458def49-b09f-4642-ba2e-6135a08f35b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:39.715761 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458def49-b09f-4642-ba2e-6135a08f35b7 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:39.794720 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 931/1850] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:48:39 2022] POST /identity/v3/users => generated 284 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:48:39.799822 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458def49-b09f-4642-ba2e-6135a08f35b7 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:39.801562 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-558e8267-cd92-491b-8dd6-b03f0bada2d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '407ae80cf7b44e60bf7e0b5bc4491062'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:39.820284 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458def49-b09f-4642-ba2e-6135a08f35b7 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:39.841613 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633aba05-6161-4ad0-9a89-d98b422bde98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:39.842432 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633aba05-6161-4ad0-9a89-d98b422bde98 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:39.843630 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633aba05-6161-4ad0-9a89-d98b422bde98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:39.844038 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633aba05-6161-4ad0-9a89-d98b422bde98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:39.845188 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633aba05-6161-4ad0-9a89-d98b422bde98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:39.846909 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633aba05-6161-4ad0-9a89-d98b422bde98 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:39.861810 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 932/1851] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:48:39.865665 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633aba05-6161-4ad0-9a89-d98b422bde98 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:39.878166 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633aba05-6161-4ad0-9a89-d98b422bde98 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:39.885606 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ac702-ea8b-40c3-a066-19659bebaf93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:39.886531 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ac702-ea8b-40c3-a066-19659bebaf93 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:39.886922 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ac702-ea8b-40c3-a066-19659bebaf93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:39.887361 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ac702-ea8b-40c3-a066-19659bebaf93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:39.888177 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843ac702-ea8b-40c3-a066-19659bebaf93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:39.890262 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843ac702-ea8b-40c3-a066-19659bebaf93 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:39.909139 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 933/1852] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:48:39.913606 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ac702-ea8b-40c3-a066-19659bebaf93 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:39.920959 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ac702-ea8b-40c3-a066-19659bebaf93 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:39.928607 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85baca0a-2d8f-4284-87d2-64c31894630e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:39.929303 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85baca0a-2d8f-4284-87d2-64c31894630e admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:39.929642 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85baca0a-2d8f-4284-87d2-64c31894630e admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:39.929929 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85baca0a-2d8f-4284-87d2-64c31894630e admin admin] PATH_INFO: `/v3/projects/72ca0c65bbd548ea89413b0a8eaea7c1/users/b5785f9c4a8d4bb4a3f8cfa4dc9cfd69/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:39.932196 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-558e8267-cd92-491b-8dd6-b03f0bada2d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '407ae80cf7b44e60bf7e0b5bc4491062'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:39.944635 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-558e8267-cd92-491b-8dd6-b03f0bada2d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '407ae80cf7b44e60bf7e0b5bc4491062'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:39.944635 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-558e8267-cd92-491b-8dd6-b03f0bada2d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '407ae80cf7b44e60bf7e0b5bc4491062'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:39.960853 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-558e8267-cd92-491b-8dd6-b03f0bada2d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '407ae80cf7b44e60bf7e0b5bc4491062'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:39.967566 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85baca0a-2d8f-4284-87d2-64c31894630e admin admin] RBAC: Authorizing `identity:create_grant(project_id=72ca0c65bbd548ea89413b0a8eaea7c1, user_id=b5785f9c4a8d4bb4a3f8cfa4dc9cfd69, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:39.972696 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 920/1853] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:48:39 2022] DELETE /identity/v3/users/407ae80cf7b44e60bf7e0b5bc4491062 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:48:39.974186 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85baca0a-2d8f-4284-87d2-64c31894630e admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:40.059241 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 934/1854] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:48:39 2022] PUT /identity/v3/projects/72ca0c65bbd548ea89413b0a8eaea7c1/users/b5785f9c4a8d4bb4a3f8cfa4dc9cfd69/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:48:40.074982 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ddfd6-b76e-4fd6-a6b5-467c3af22bb7 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:40.074982 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ddfd6-b76e-4fd6-a6b5-467c3af22bb7 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:40.074982 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ddfd6-b76e-4fd6-a6b5-467c3af22bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:40.122058 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-fa6ddfd6-b76e-4fd6-a6b5-467c3af22bb7 None None] MFA Rules not processed for user `b5785f9c4a8d4bb4a3f8cfa4dc9cfd69`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:40.123653 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-fa6ddfd6-b76e-4fd6-a6b5-467c3af22bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:40.245244 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 921/1855] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:40.249411 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85baca0a-2d8f-4284-87d2-64c31894630e admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:40.251607 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-85baca0a-2d8f-4284-87d2-64c31894630e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:40.410224 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85baca0a-2d8f-4284-87d2-64c31894630e admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:40.415516 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc1845-449a-4d7b-9df9-98fd31848f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:40.418251 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc1845-449a-4d7b-9df9-98fd31848f9e admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:40.418251 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc1845-449a-4d7b-9df9-98fd31848f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:40.418251 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc1845-449a-4d7b-9df9-98fd31848f9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:40.432948 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fc1845-449a-4d7b-9df9-98fd31848f9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:40.435267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fc1845-449a-4d7b-9df9-98fd31848f9e admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:40.552207 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 935/1856] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:48:40 2022] POST /identity/v3/projects => generated 365 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:48:40.553751 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ddfd6-b76e-4fd6-a6b5-467c3af22bb7 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:40.565780 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ddfd6-b76e-4fd6-a6b5-467c3af22bb7 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:40.639045 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb7828-2c88-4b67-9cf7-6bc1b05565a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:40.639781 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb7828-2c88-4b67-9cf7-6bc1b05565a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:40.640141 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb7828-2c88-4b67-9cf7-6bc1b05565a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:40.641026 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb7828-2c88-4b67-9cf7-6bc1b05565a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:40.641777 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbb7828-2c88-4b67-9cf7-6bc1b05565a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:40.643869 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbb7828-2c88-4b67-9cf7-6bc1b05565a4 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:40.658250 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:40.721174 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc1845-449a-4d7b-9df9-98fd31848f9e admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:40.722939 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-29fc1845-449a-4d7b-9df9-98fd31848f9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:40.738673 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc1845-449a-4d7b-9df9-98fd31848f9e admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:40.745738 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdae406-25aa-4a30-8adc-195f59b83575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:40.749337 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdae406-25aa-4a30-8adc-195f59b83575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:40.749337 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdae406-25aa-4a30-8adc-195f59b83575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:40.749337 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdae406-25aa-4a30-8adc-195f59b83575 admin admin] PATH_INFO: `/v3/projects/ede1770b40a041008f80a78be1325576` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:40.749337 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdae406-25aa-4a30-8adc-195f59b83575 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ede1770b40a041008f80a78be1325576)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:40.751097 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdae406-25aa-4a30-8adc-195f59b83575 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:40.752379 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 922/1857] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:48:40 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:48:40.756702 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb7828-2c88-4b67-9cf7-6bc1b05565a4 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:40.768414 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb7828-2c88-4b67-9cf7-6bc1b05565a4 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:40.782208 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a459c89f-e969-4fef-b5f9-93fff5f9522e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:40.783195 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459c89f-e969-4fef-b5f9-93fff5f9522e admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:40.783691 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459c89f-e969-4fef-b5f9-93fff5f9522e admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:40.784140 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459c89f-e969-4fef-b5f9-93fff5f9522e admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:40.785022 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a459c89f-e969-4fef-b5f9-93fff5f9522e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:40.787161 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a459c89f-e969-4fef-b5f9-93fff5f9522e admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:40.807548 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 923/1858] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:48:40.811629 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a459c89f-e969-4fef-b5f9-93fff5f9522e admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:40.821787 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:40.825565 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a459c89f-e969-4fef-b5f9-93fff5f9522e admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:40.833919 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1e084-4a4d-4084-94e9-aaafd998066f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:40.834603 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1e084-4a4d-4084-94e9-aaafd998066f admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:40.835004 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1e084-4a4d-4084-94e9-aaafd998066f admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:40.835400 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1e084-4a4d-4084-94e9-aaafd998066f admin admin] PATH_INFO: `/v3/projects/92be27ed977042aa9d567fdfe7732c8d/users/9752534892aa4f7a8d9c21dedeaed83a/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:40.855758 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad1e084-4a4d-4084-94e9-aaafd998066f admin admin] RBAC: Authorizing `identity:create_grant(project_id=92be27ed977042aa9d567fdfe7732c8d, user_id=9752534892aa4f7a8d9c21dedeaed83a, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:40.858837 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad1e084-4a4d-4084-94e9-aaafd998066f admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:40.979632 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-acdae406-25aa-4a30-8adc-195f59b83575 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ede1770b40a041008f80a78be1325576', 'request_id': 'req-acdae406-25aa-4a30-8adc-195f59b83575'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:40.986851 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 924/1859] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:48:40 2022] PUT /identity/v3/projects/92be27ed977042aa9d567fdfe7732c8d/users/9752534892aa4f7a8d9c21dedeaed83a/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:48:40.990693 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1e084-4a4d-4084-94e9-aaafd998066f admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:41.038776 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-acdae406-25aa-4a30-8adc-195f59b83575 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ede1770b40a041008f80a78be1325576', 'request_id': 'req-acdae406-25aa-4a30-8adc-195f59b83575'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:41.053382 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-acdae406-25aa-4a30-8adc-195f59b83575 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ede1770b40a041008f80a78be1325576', 'request_id': 'req-acdae406-25aa-4a30-8adc-195f59b83575'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:41.082298 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-acdae406-25aa-4a30-8adc-195f59b83575 admin admin] The token cache is being invalidate because project ede1770b40a041008f80a78be1325576 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:48:41.082761 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-acdae406-25aa-4a30-8adc-195f59b83575 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:41.084282 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-acdae406-25aa-4a30-8adc-195f59b83575 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:41.097988 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 936/1860] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:48:40 2022] DELETE /identity/v3/projects/ede1770b40a041008f80a78be1325576 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:48:41.098382 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1e084-4a4d-4084-94e9-aaafd998066f admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:41.103187 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536d1a7-ea70-4e98-a441-3bf43d13c56a None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:41.103723 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536d1a7-ea70-4e98-a441-3bf43d13c56a None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:41.104284 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536d1a7-ea70-4e98-a441-3bf43d13c56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:41.164480 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-7536d1a7-ea70-4e98-a441-3bf43d13c56a None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:41.167865 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-7536d1a7-ea70-4e98-a441-3bf43d13c56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:41.183049 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c5208-d988-41f9-b1cb-da45fb0583be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:41.183669 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c5208-d988-41f9-b1cb-da45fb0583be admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:41.183954 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c5208-d988-41f9-b1cb-da45fb0583be admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:41.184234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c5208-d988-41f9-b1cb-da45fb0583be admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:41.186120 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c5208-d988-41f9-b1cb-da45fb0583be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:41.187143 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c5208-d988-41f9-b1cb-da45fb0583be admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:41.204719 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 925/1861] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:48:41.205627 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c5208-d988-41f9-b1cb-da45fb0583be admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:41.207825 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-0c2c5208-d988-41f9-b1cb-da45fb0583be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:41.224035 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c5208-d988-41f9-b1cb-da45fb0583be admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:41.230333 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93180285-7054-44c4-80b2-07541d830e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:41.232549 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93180285-7054-44c4-80b2-07541d830e75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:41.232844 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93180285-7054-44c4-80b2-07541d830e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:41.234055 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93180285-7054-44c4-80b2-07541d830e75 admin admin] PATH_INFO: `/v3/projects/92be27ed977042aa9d567fdfe7732c8d/users/9752534892aa4f7a8d9c21dedeaed83a/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:41.238084 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93180285-7054-44c4-80b2-07541d830e75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92be27ed977042aa9d567fdfe7732c8d, user_id=9752534892aa4f7a8d9c21dedeaed83a, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:41.242419 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93180285-7054-44c4-80b2-07541d830e75 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:41.256387 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 926/1862] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:48:41 2022] PUT /identity/v3/projects/92be27ed977042aa9d567fdfe7732c8d/users/9752534892aa4f7a8d9c21dedeaed83a/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:48:41.266747 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677dbf25-0d4c-4c2d-8f10-dc8a0cdf0bde None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:41.267090 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677dbf25-0d4c-4c2d-8f10-dc8a0cdf0bde None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:41.267350 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677dbf25-0d4c-4c2d-8f10-dc8a0cdf0bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:41.282695 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 937/1863] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:41.290856 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14eff5-c730-45e3-9dda-d39dd6877506 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:41.291421 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14eff5-c730-45e3-9dda-d39dd6877506 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:41.291702 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14eff5-c730-45e3-9dda-d39dd6877506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:41.302526 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-677dbf25-0d4c-4c2d-8f10-dc8a0cdf0bde None None] MFA Rules not processed for user `9752534892aa4f7a8d9c21dedeaed83a`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:41.303818 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-677dbf25-0d4c-4c2d-8f10-dc8a0cdf0bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:41.311715 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-5c14eff5-c730-45e3-9dda-d39dd6877506 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:41.313009 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-5c14eff5-c730-45e3-9dda-d39dd6877506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:41.385931 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 938/1864] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:48:41.387624 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14eff5-c730-45e3-9dda-d39dd6877506 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:41.396238 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 927/1865] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:41 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:41.397572 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14eff5-c730-45e3-9dda-d39dd6877506 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:41.408770 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677dbf25-0d4c-4c2d-8f10-dc8a0cdf0bde None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:41.409765 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c942544-fb5c-4a8d-bf29-d5c10cd46661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:41.410417 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c942544-fb5c-4a8d-bf29-d5c10cd46661 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:41.410531 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-677dbf25-0d4c-4c2d-8f10-dc8a0cdf0bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:41.410754 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c942544-fb5c-4a8d-bf29-d5c10cd46661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:41.411068 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c942544-fb5c-4a8d-bf29-d5c10cd46661 admin admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:41.411784 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c942544-fb5c-4a8d-bf29-d5c10cd46661 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:48:41.412087 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c942544-fb5c-4a8d-bf29-d5c10cd46661 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:41.413694 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c942544-fb5c-4a8d-bf29-d5c10cd46661 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:41.430362 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 939/1866] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:48:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:48:41.432139 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c942544-fb5c-4a8d-bf29-d5c10cd46661 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:41.443218 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c942544-fb5c-4a8d-bf29-d5c10cd46661 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:41.449625 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811865e7-d0c1-45fb-a045-ad96c522b05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:41.450588 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811865e7-d0c1-45fb-a045-ad96c522b05e admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:41.451317 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811865e7-d0c1-45fb-a045-ad96c522b05e admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:41.451962 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811865e7-d0c1-45fb-a045-ad96c522b05e admin admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:41.454085 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811865e7-d0c1-45fb-a045-ad96c522b05e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:41.456574 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811865e7-d0c1-45fb-a045-ad96c522b05e admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:41.489488 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677dbf25-0d4c-4c2d-8f10-dc8a0cdf0bde None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:41.493195 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d369d0-083c-48b0-82a2-182ae88e7c38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:41.494197 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d369d0-083c-48b0-82a2-182ae88e7c38 service cinder] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:41.497353 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d369d0-083c-48b0-82a2-182ae88e7c38 service cinder] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:41.497353 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d369d0-083c-48b0-82a2-182ae88e7c38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:41.505438 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d369d0-083c-48b0-82a2-182ae88e7c38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:41.507215 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d369d0-083c-48b0-82a2-182ae88e7c38 service cinder] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:41.518018 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 928/1867] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:48:41 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:48:41.535247 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 940/1868] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:48:41 2022] POST /identity/v3/projects => generated 371 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:48:41.536621 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:41.538262 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d369d0-083c-48b0-82a2-182ae88e7c38 service cinder] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:41.550435 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d369d0-083c-48b0-82a2-182ae88e7c38 service cinder] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:41.628832 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:41.637773 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0bf97-838f-405f-98fe-b5e0732d7970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:41.638402 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0bf97-838f-405f-98fe-b5e0732d7970 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:41.638814 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0bf97-838f-405f-98fe-b5e0732d7970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:41.639135 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0bf97-838f-405f-98fe-b5e0732d7970 admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:41.639797 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c0bf97-838f-405f-98fe-b5e0732d7970 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:41.642471 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c0bf97-838f-405f-98fe-b5e0732d7970 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:41.708278 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811865e7-d0c1-45fb-a045-ad96c522b05e admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:41.721262 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 929/1869] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:48:41 2022] POST /identity/v3/users => generated 286 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:48:41.733379 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0bf97-838f-405f-98fe-b5e0732d7970 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:41.745185 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0bf97-838f-405f-98fe-b5e0732d7970 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:41.752400 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ae993-ca45-4f89-95ef-c103e20f6693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:41.753475 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ae993-ca45-4f89-95ef-c103e20f6693 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:41.753935 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ae993-ca45-4f89-95ef-c103e20f6693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:41.754383 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ae993-ca45-4f89-95ef-c103e20f6693 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:41.755286 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ae993-ca45-4f89-95ef-c103e20f6693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:41.757581 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ae993-ca45-4f89-95ef-c103e20f6693 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:41.769929 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 930/1870] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:48:41.773863 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ae993-ca45-4f89-95ef-c103e20f6693 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:41.789552 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ae993-ca45-4f89-95ef-c103e20f6693 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:41.803303 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122b6e5-5cea-4b58-ac87-e206e740608b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:41.803303 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122b6e5-5cea-4b58-ac87-e206e740608b admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:41.803303 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122b6e5-5cea-4b58-ac87-e206e740608b admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:41.803303 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122b6e5-5cea-4b58-ac87-e206e740608b admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:41.803670 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8122b6e5-5cea-4b58-ac87-e206e740608b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:41.805063 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8122b6e5-5cea-4b58-ac87-e206e740608b admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:41.810075 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811865e7-d0c1-45fb-a045-ad96c522b05e admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:41.814605 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a9cf7-f57d-4200-bb35-73a8877685d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:41.815464 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a9cf7-f57d-4200-bb35-73a8877685d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:41.815849 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 931/1871] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:48:41.816118 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a9cf7-f57d-4200-bb35-73a8877685d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:41.816763 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a9cf7-f57d-4200-bb35-73a8877685d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:41.819841 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-a52a9cf7-f57d-4200-bb35-73a8877685d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:41.819960 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122b6e5-5cea-4b58-ac87-e206e740608b admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:41.830357 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122b6e5-5cea-4b58-ac87-e206e740608b admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:41.834993 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ab1a6-07be-4bc5-b610-7cc55af756df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:41.835670 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ab1a6-07be-4bc5-b610-7cc55af756df admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:41.835946 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ab1a6-07be-4bc5-b610-7cc55af756df admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:41.836221 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ab1a6-07be-4bc5-b610-7cc55af756df admin admin] PATH_INFO: `/v3/projects/1521ef85c5ab4422a5c0f2436d1128d7/users/6036c9d5cf264f8995735430e1bbb448/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:41.853140 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72ab1a6-07be-4bc5-b610-7cc55af756df admin admin] RBAC: Authorizing `identity:create_grant(project_id=1521ef85c5ab4422a5c0f2436d1128d7, user_id=6036c9d5cf264f8995735430e1bbb448, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:41.856277 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72ab1a6-07be-4bc5-b610-7cc55af756df admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:41.891680 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a9cf7-f57d-4200-bb35-73a8877685d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:41.893172 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a9cf7-f57d-4200-bb35-73a8877685d9 service cinder] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:41.911250 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 941/1872] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:48:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:48:41.937138 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 932/1873] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:48:41 2022] PUT /identity/v3/projects/1521ef85c5ab4422a5c0f2436d1128d7/users/6036c9d5cf264f8995735430e1bbb448/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:48:41.942627 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a7e1d-1004-4039-995a-b7c96f2cca07 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:41.947355 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a7e1d-1004-4039-995a-b7c96f2cca07 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:41.947786 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a7e1d-1004-4039-995a-b7c96f2cca07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:41.970667 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-c21a7e1d-1004-4039-995a-b7c96f2cca07 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:41.972041 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-c21a7e1d-1004-4039-995a-b7c96f2cca07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:42.041107 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 942/1874] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:42.052712 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ab1a6-07be-4bc5-b610-7cc55af756df admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:42.054573 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-d72ab1a6-07be-4bc5-b610-7cc55af756df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:42.118012 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ab1a6-07be-4bc5-b610-7cc55af756df admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:42.121594 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584aca64-5e92-4262-8e5d-bc5d60cf1c5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:42.122207 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584aca64-5e92-4262-8e5d-bc5d60cf1c5a service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:42.122485 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584aca64-5e92-4262-8e5d-bc5d60cf1c5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:42.122830 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584aca64-5e92-4262-8e5d-bc5d60cf1c5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:42.132413 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584aca64-5e92-4262-8e5d-bc5d60cf1c5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:42.133878 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584aca64-5e92-4262-8e5d-bc5d60cf1c5a service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:42.146670 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 933/1875] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:48:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:48:42.164668 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:42.719904 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:43.691877 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb07dd-1b85-4c21-bcab-ed061b82b0ad None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:43.692470 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb07dd-1b85-4c21-bcab-ed061b82b0ad None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:43.693127 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb07dd-1b85-4c21-bcab-ed061b82b0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:43.724896 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-86cb07dd-1b85-4c21-bcab-ed061b82b0ad None None] MFA Rules not processed for user `6036c9d5cf264f8995735430e1bbb448`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:43.726166 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-86cb07dd-1b85-4c21-bcab-ed061b82b0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:43.854858 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 943/1876] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:43.871326 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584aca64-5e92-4262-8e5d-bc5d60cf1c5a service neutron] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:43.873966 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-584aca64-5e92-4262-8e5d-bc5d60cf1c5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:43.927436 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:43.947270 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584aca64-5e92-4262-8e5d-bc5d60cf1c5a service neutron] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:43.954625 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501b28e-a6af-44e0-bbca-9ecde872edf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:43.955597 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501b28e-a6af-44e0-bbca-9ecde872edf0 service cinder] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:43.957514 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501b28e-a6af-44e0-bbca-9ecde872edf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:43.957972 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501b28e-a6af-44e0-bbca-9ecde872edf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:43.975285 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0501b28e-a6af-44e0-bbca-9ecde872edf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:43.976919 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0501b28e-a6af-44e0-bbca-9ecde872edf0 service cinder] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:43.991124 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 934/1877] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:48:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:48:45.957597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958c41f-ddc2-41e2-b7e2-2a6c37973e2c None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:45.958438 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958c41f-ddc2-41e2-b7e2-2a6c37973e2c None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:45.959477 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958c41f-ddc2-41e2-b7e2-2a6c37973e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:45.985464 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-2958c41f-ddc2-41e2-b7e2-2a6c37973e2c None None] MFA Rules not processed for user `6036c9d5cf264f8995735430e1bbb448`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:45.987111 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-2958c41f-ddc2-41e2-b7e2-2a6c37973e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:45.999055 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 944/1878] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:49.118176 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501b28e-a6af-44e0-bbca-9ecde872edf0 service cinder] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:49.121547 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-0501b28e-a6af-44e0-bbca-9ecde872edf0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:49.147793 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501b28e-a6af-44e0-bbca-9ecde872edf0 service cinder] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:49.162555 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528ca02-125a-4fad-905e-e4797384770a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:49.163667 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528ca02-125a-4fad-905e-e4797384770a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:49.164143 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528ca02-125a-4fad-905e-e4797384770a admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:49.164444 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528ca02-125a-4fad-905e-e4797384770a admin admin] PATH_INFO: `/v3/users/a6a790e41adf4cb2a2e45a34121f4993` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:49.166395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9528ca02-125a-4fad-905e-e4797384770a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6a790e41adf4cb2a2e45a34121f4993)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:49.173394 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9528ca02-125a-4fad-905e-e4797384770a admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:49.395306 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-9528ca02-125a-4fad-905e-e4797384770a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6a790e41adf4cb2a2e45a34121f4993'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:49.491384 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-9528ca02-125a-4fad-905e-e4797384770a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6a790e41adf4cb2a2e45a34121f4993'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:49.503264 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-9528ca02-125a-4fad-905e-e4797384770a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6a790e41adf4cb2a2e45a34121f4993'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:49.504152 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-9528ca02-125a-4fad-905e-e4797384770a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6a790e41adf4cb2a2e45a34121f4993'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:49.519211 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-9528ca02-125a-4fad-905e-e4797384770a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6a790e41adf4cb2a2e45a34121f4993'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:49.525928 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 935/1879] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:48:49 2022] DELETE /identity/v3/users/a6a790e41adf4cb2a2e45a34121f4993 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:48:49.530495 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abfe25a-ae8e-47ca-ac9d-119c0f8bb891 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:49.531105 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abfe25a-ae8e-47ca-ac9d-119c0f8bb891 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:49.531105 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abfe25a-ae8e-47ca-ac9d-119c0f8bb891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:49.552343 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-2abfe25a-ae8e-47ca-ac9d-119c0f8bb891 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:49.553678 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-2abfe25a-ae8e-47ca-ac9d-119c0f8bb891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:49.577962 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:49.649516 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 945/1880] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:49.662022 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528ca02-125a-4fad-905e-e4797384770a admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:49.663971 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-9528ca02-125a-4fad-905e-e4797384770a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:49.756174 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abfe25a-ae8e-47ca-ac9d-119c0f8bb891 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:49.757475 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-2abfe25a-ae8e-47ca-ac9d-119c0f8bb891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:49.765318 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528ca02-125a-4fad-905e-e4797384770a admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:49.769479 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffcd6b8-048d-465f-939c-f9563205f0da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:49.770159 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcd6b8-048d-465f-939c-f9563205f0da service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:49.770451 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcd6b8-048d-465f-939c-f9563205f0da service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:49.770570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abfe25a-ae8e-47ca-ac9d-119c0f8bb891 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:49.770958 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcd6b8-048d-465f-939c-f9563205f0da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:49.775320 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5e05a-2bdd-4c47-8c91-705e8bb9e9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:49.775971 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5e05a-2bdd-4c47-8c91-705e8bb9e9ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:49.776255 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5e05a-2bdd-4c47-8c91-705e8bb9e9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:49.776540 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5e05a-2bdd-4c47-8c91-705e8bb9e9ba admin admin] PATH_INFO: `/v3/users/b5785f9c4a8d4bb4a3f8cfa4dc9cfd69` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:49.786242 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5e05a-2bdd-4c47-8c91-705e8bb9e9ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5785f9c4a8d4bb4a3f8cfa4dc9cfd69)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:49.788303 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5e05a-2bdd-4c47-8c91-705e8bb9e9ba admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:49.793753 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffcd6b8-048d-465f-939c-f9563205f0da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:49.793753 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffcd6b8-048d-465f-939c-f9563205f0da service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:49.812878 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 936/1881] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:48:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:48:50.011684 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-b4b5e05a-2bdd-4c47-8c91-705e8bb9e9ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5785f9c4a8d4bb4a3f8cfa4dc9cfd69'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:50.107162 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-b4b5e05a-2bdd-4c47-8c91-705e8bb9e9ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5785f9c4a8d4bb4a3f8cfa4dc9cfd69'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:50.117542 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-b4b5e05a-2bdd-4c47-8c91-705e8bb9e9ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5785f9c4a8d4bb4a3f8cfa4dc9cfd69'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:50.130178 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-b4b5e05a-2bdd-4c47-8c91-705e8bb9e9ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5785f9c4a8d4bb4a3f8cfa4dc9cfd69'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:50.130930 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-b4b5e05a-2bdd-4c47-8c91-705e8bb9e9ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5785f9c4a8d4bb4a3f8cfa4dc9cfd69'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:50.136878 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 946/1882] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:48:49 2022] DELETE /identity/v3/users/b5785f9c4a8d4bb4a3f8cfa4dc9cfd69 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:48:50.142159 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6c131-bd2e-4f1c-ae07-0cef5976e196 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:50.146208 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6c131-bd2e-4f1c-ae07-0cef5976e196 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:50.146208 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6c131-bd2e-4f1c-ae07-0cef5976e196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:50.163731 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-17c6c131-bd2e-4f1c-ae07-0cef5976e196 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:50.164566 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-17c6c131-bd2e-4f1c-ae07-0cef5976e196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:50.223077 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:50.231990 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 937/1883] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:50.245557 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5e05a-2bdd-4c47-8c91-705e8bb9e9ba admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:50.252326 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-b4b5e05a-2bdd-4c47-8c91-705e8bb9e9ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:50.392641 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5e05a-2bdd-4c47-8c91-705e8bb9e9ba admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:50.396577 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e927a581-a22c-4cb3-866b-ad90ea133ecd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:50.397642 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927a581-a22c-4cb3-866b-ad90ea133ecd service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:50.398405 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927a581-a22c-4cb3-866b-ad90ea133ecd service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:50.398405 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927a581-a22c-4cb3-866b-ad90ea133ecd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:50.423409 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e927a581-a22c-4cb3-866b-ad90ea133ecd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:50.423409 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e927a581-a22c-4cb3-866b-ad90ea133ecd service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:50.428197 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6c131-bd2e-4f1c-ae07-0cef5976e196 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:50.429934 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-17c6c131-bd2e-4f1c-ae07-0cef5976e196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:50.443237 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 947/1884] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:48:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:48:50.453439 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6c131-bd2e-4f1c-ae07-0cef5976e196 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:50.459688 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2e1cc-806e-4983-91a0-dfce34b167a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:50.460970 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2e1cc-806e-4983-91a0-dfce34b167a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:50.461510 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2e1cc-806e-4983-91a0-dfce34b167a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:50.462036 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2e1cc-806e-4983-91a0-dfce34b167a0 admin admin] PATH_INFO: `/v3/projects/d233100331034057b6433d7c6a33ae19` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:50.463829 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2e1cc-806e-4983-91a0-dfce34b167a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d233100331034057b6433d7c6a33ae19)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:50.466834 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2e1cc-806e-4983-91a0-dfce34b167a0 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:50.635725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-fae2e1cc-806e-4983-91a0-dfce34b167a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd233100331034057b6433d7c6a33ae19', 'request_id': 'req-fae2e1cc-806e-4983-91a0-dfce34b167a0'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:50.701652 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-fae2e1cc-806e-4983-91a0-dfce34b167a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd233100331034057b6433d7c6a33ae19', 'request_id': 'req-fae2e1cc-806e-4983-91a0-dfce34b167a0'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:50.710754 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-fae2e1cc-806e-4983-91a0-dfce34b167a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd233100331034057b6433d7c6a33ae19', 'request_id': 'req-fae2e1cc-806e-4983-91a0-dfce34b167a0'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:50.724884 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-fae2e1cc-806e-4983-91a0-dfce34b167a0 admin admin] The token cache is being invalidate because project d233100331034057b6433d7c6a33ae19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:48:50.725191 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-fae2e1cc-806e-4983-91a0-dfce34b167a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:50.725865 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-fae2e1cc-806e-4983-91a0-dfce34b167a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:50.728101 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 938/1885] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:48:50 2022] DELETE /identity/v3/projects/d233100331034057b6433d7c6a33ae19 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:48:50.732929 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e927a581-a22c-4cb3-866b-ad90ea133ecd service neutron] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:50.743849 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e927a581-a22c-4cb3-866b-ad90ea133ecd service neutron] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:50.825580 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:50.891923 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92f83a-0e70-43ae-b0a0-c8d767cbc7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:50.892589 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92f83a-0e70-43ae-b0a0-c8d767cbc7e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:50.892849 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92f83a-0e70-43ae-b0a0-c8d767cbc7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:50.893139 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92f83a-0e70-43ae-b0a0-c8d767cbc7e5 admin admin] PATH_INFO: `/v3/users/a4545abdd1394744adef61eebe5cf3cf` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:50.895733 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a92f83a-0e70-43ae-b0a0-c8d767cbc7e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4545abdd1394744adef61eebe5cf3cf)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:50.897906 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a92f83a-0e70-43ae-b0a0-c8d767cbc7e5 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:51.183327 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-5a92f83a-0e70-43ae-b0a0-c8d767cbc7e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4545abdd1394744adef61eebe5cf3cf'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:51.228927 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2e1cc-806e-4983-91a0-dfce34b167a0 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:51.231497 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-fae2e1cc-806e-4983-91a0-dfce34b167a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:51.249008 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2e1cc-806e-4983-91a0-dfce34b167a0 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:51.288799 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6679ce-198a-4e4e-8069-2e9ddf7e3e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:51.292446 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6679ce-198a-4e4e-8069-2e9ddf7e3e44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:51.292962 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6679ce-198a-4e4e-8069-2e9ddf7e3e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:51.293992 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6679ce-198a-4e4e-8069-2e9ddf7e3e44 admin admin] PATH_INFO: `/v3/projects/72ca0c65bbd548ea89413b0a8eaea7c1` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:51.296603 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-5a92f83a-0e70-43ae-b0a0-c8d767cbc7e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4545abdd1394744adef61eebe5cf3cf'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:51.308898 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-5a92f83a-0e70-43ae-b0a0-c8d767cbc7e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4545abdd1394744adef61eebe5cf3cf'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:51.311332 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6679ce-198a-4e4e-8069-2e9ddf7e3e44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72ca0c65bbd548ea89413b0a8eaea7c1)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:51.317958 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6679ce-198a-4e4e-8069-2e9ddf7e3e44 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:51.344740 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-5a92f83a-0e70-43ae-b0a0-c8d767cbc7e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4545abdd1394744adef61eebe5cf3cf'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:51.346082 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-5a92f83a-0e70-43ae-b0a0-c8d767cbc7e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4545abdd1394744adef61eebe5cf3cf'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:51.354005 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 948/1886] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:48:50 2022] DELETE /identity/v3/users/a4545abdd1394744adef61eebe5cf3cf => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:48:51.517264 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-fe6679ce-198a-4e4e-8069-2e9ddf7e3e44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72ca0c65bbd548ea89413b0a8eaea7c1', 'request_id': 'req-fe6679ce-198a-4e4e-8069-2e9ddf7e3e44'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:51.598627 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-fe6679ce-198a-4e4e-8069-2e9ddf7e3e44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72ca0c65bbd548ea89413b0a8eaea7c1', 'request_id': 'req-fe6679ce-198a-4e4e-8069-2e9ddf7e3e44'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:51.606626 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-fe6679ce-198a-4e4e-8069-2e9ddf7e3e44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72ca0c65bbd548ea89413b0a8eaea7c1', 'request_id': 'req-fe6679ce-198a-4e4e-8069-2e9ddf7e3e44'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:51.621303 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-fe6679ce-198a-4e4e-8069-2e9ddf7e3e44 admin admin] The token cache is being invalidate because project 72ca0c65bbd548ea89413b0a8eaea7c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:48:51.625701 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-fe6679ce-198a-4e4e-8069-2e9ddf7e3e44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:51.625701 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-fe6679ce-198a-4e4e-8069-2e9ddf7e3e44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:51.625701 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 939/1887] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:48:51 2022] DELETE /identity/v3/projects/72ca0c65bbd548ea89413b0a8eaea7c1 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:48:51.628635 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92f83a-0e70-43ae-b0a0-c8d767cbc7e5 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:51.630269 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-5a92f83a-0e70-43ae-b0a0-c8d767cbc7e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:51.731948 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92f83a-0e70-43ae-b0a0-c8d767cbc7e5 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:51.827053 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceae156-3154-4ae0-8a89-c2ae48ab5550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:51.828252 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceae156-3154-4ae0-8a89-c2ae48ab5550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:51.828526 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceae156-3154-4ae0-8a89-c2ae48ab5550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:51.828804 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceae156-3154-4ae0-8a89-c2ae48ab5550 admin admin] PATH_INFO: `/v3/users/9752534892aa4f7a8d9c21dedeaed83a` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:51.829994 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceae156-3154-4ae0-8a89-c2ae48ab5550 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9752534892aa4f7a8d9c21dedeaed83a)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:51.832031 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceae156-3154-4ae0-8a89-c2ae48ab5550 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:51.837181 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:51.892111 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6679ce-198a-4e4e-8069-2e9ddf7e3e44 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:51.894698 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-fe6679ce-198a-4e4e-8069-2e9ddf7e3e44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:51.914885 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6679ce-198a-4e4e-8069-2e9ddf7e3e44 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:51.920111 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc7f607-a865-42dc-a31e-1b479827a324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:51.920816 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7f607-a865-42dc-a31e-1b479827a324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:51.921148 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7f607-a865-42dc-a31e-1b479827a324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:51.921339 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7f607-a865-42dc-a31e-1b479827a324 admin admin] PATH_INFO: `/v3/projects/a7b4e599ca2f4c66a9687939b4b794a4` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:51.922587 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc7f607-a865-42dc-a31e-1b479827a324 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7b4e599ca2f4c66a9687939b4b794a4)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:51.924545 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc7f607-a865-42dc-a31e-1b479827a324 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:52.021715 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-6ceae156-3154-4ae0-8a89-c2ae48ab5550 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9752534892aa4f7a8d9c21dedeaed83a'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:52.051881 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-bfc7f607-a865-42dc-a31e-1b479827a324 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7b4e599ca2f4c66a9687939b4b794a4', 'request_id': 'req-bfc7f607-a865-42dc-a31e-1b479827a324'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:52.067021 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-6ceae156-3154-4ae0-8a89-c2ae48ab5550 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9752534892aa4f7a8d9c21dedeaed83a'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:52.078066 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-6ceae156-3154-4ae0-8a89-c2ae48ab5550 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9752534892aa4f7a8d9c21dedeaed83a'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:52.097282 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-6ceae156-3154-4ae0-8a89-c2ae48ab5550 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9752534892aa4f7a8d9c21dedeaed83a'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:52.097282 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-6ceae156-3154-4ae0-8a89-c2ae48ab5550 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9752534892aa4f7a8d9c21dedeaed83a'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:52.102466 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 949/1888] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:48:51 2022] DELETE /identity/v3/users/9752534892aa4f7a8d9c21dedeaed83a => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:48:52.124623 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-bfc7f607-a865-42dc-a31e-1b479827a324 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7b4e599ca2f4c66a9687939b4b794a4', 'request_id': 'req-bfc7f607-a865-42dc-a31e-1b479827a324'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:52.129483 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=77,keystone:DELETE=20,keystone:INSERT=3 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:52.137201 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-bfc7f607-a865-42dc-a31e-1b479827a324 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7b4e599ca2f4c66a9687939b4b794a4', 'request_id': 'req-bfc7f607-a865-42dc-a31e-1b479827a324'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:52.150711 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-bfc7f607-a865-42dc-a31e-1b479827a324 admin admin] The token cache is being invalidate because project a7b4e599ca2f4c66a9687939b4b794a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:48:52.151099 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-bfc7f607-a865-42dc-a31e-1b479827a324 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:52.152005 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-bfc7f607-a865-42dc-a31e-1b479827a324 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:52.157042 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 940/1889] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:48:51 2022] DELETE /identity/v3/projects/a7b4e599ca2f4c66a9687939b4b794a4 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:48:52.158728 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f964bd-ffff-4e45-aa83-3617e683a3ed None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:52.159052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f964bd-ffff-4e45-aa83-3617e683a3ed None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:52.159391 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f964bd-ffff-4e45-aa83-3617e683a3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:52.204017 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-64f964bd-ffff-4e45-aa83-3617e683a3ed None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:52.205730 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-64f964bd-ffff-4e45-aa83-3617e683a3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:52.287103 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 950/1890] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:52.290809 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9047ad-c32e-430b-908f-16b69118ab2d None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:52.291352 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9047ad-c32e-430b-908f-16b69118ab2d None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:52.291445 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9047ad-c32e-430b-908f-16b69118ab2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:52.323091 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-ee9047ad-c32e-430b-908f-16b69118ab2d None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:52.328145 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-ee9047ad-c32e-430b-908f-16b69118ab2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:52.336809 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 941/1891] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:52.341338 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f964bd-ffff-4e45-aa83-3617e683a3ed None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:52.366501 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f964bd-ffff-4e45-aa83-3617e683a3ed None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:52.375245 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9502922-44e4-456b-89f1-5d07e610cb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:52.376044 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9502922-44e4-456b-89f1-5d07e610cb20 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:52.376991 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9502922-44e4-456b-89f1-5d07e610cb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:52.376991 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9502922-44e4-456b-89f1-5d07e610cb20 admin admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:52.378281 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9502922-44e4-456b-89f1-5d07e610cb20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:48:52.378708 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9502922-44e4-456b-89f1-5d07e610cb20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:52.381897 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9502922-44e4-456b-89f1-5d07e610cb20 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:52.402072 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 951/1892] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:48:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:48:52.402724 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9047ad-c32e-430b-908f-16b69118ab2d None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:52.412492 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9047ad-c32e-430b-908f-16b69118ab2d None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:52.428438 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05975d85-5a42-4d3f-a386-2a4d12fccee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:52.429866 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05975d85-5a42-4d3f-a386-2a4d12fccee9 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:52.430180 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05975d85-5a42-4d3f-a386-2a4d12fccee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:52.430461 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05975d85-5a42-4d3f-a386-2a4d12fccee9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:52.431194 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05975d85-5a42-4d3f-a386-2a4d12fccee9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:52.433329 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05975d85-5a42-4d3f-a386-2a4d12fccee9 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:52.505392 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 942/1893] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:48:52 2022] POST /identity/v3/projects => generated 363 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:48:52.510231 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9502922-44e4-456b-89f1-5d07e610cb20 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:52.525278 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9502922-44e4-456b-89f1-5d07e610cb20 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:52.590455 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01329669-844a-4d70-a4ef-2c4d88ee03fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:52.593248 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01329669-844a-4d70-a4ef-2c4d88ee03fc admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:52.593248 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01329669-844a-4d70-a4ef-2c4d88ee03fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:52.593248 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01329669-844a-4d70-a4ef-2c4d88ee03fc admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:52.593248 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01329669-844a-4d70-a4ef-2c4d88ee03fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:52.594605 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01329669-844a-4d70-a4ef-2c4d88ee03fc admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:52.650977 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05975d85-5a42-4d3f-a386-2a4d12fccee9 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:52.656633 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-05975d85-5a42-4d3f-a386-2a4d12fccee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:52.665542 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05975d85-5a42-4d3f-a386-2a4d12fccee9 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:52.668936 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:52.673250 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15e1a1-1744-4995-9427-78a13bdfe393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:52.679288 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15e1a1-1744-4995-9427-78a13bdfe393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:52.679288 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15e1a1-1744-4995-9427-78a13bdfe393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:52.679288 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15e1a1-1744-4995-9427-78a13bdfe393 admin admin] PATH_INFO: `/v3/projects/92be27ed977042aa9d567fdfe7732c8d` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:52.680138 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 952/1894] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:48:52 2022] POST /identity/v3/users => generated 282 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:48:52.680606 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b15e1a1-1744-4995-9427-78a13bdfe393 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92be27ed977042aa9d567fdfe7732c8d)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:52.680606 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b15e1a1-1744-4995-9427-78a13bdfe393 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:52.682589 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01329669-844a-4d70-a4ef-2c4d88ee03fc admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:52.694205 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01329669-844a-4d70-a4ef-2c4d88ee03fc admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:52.699122 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f23052-77d6-41a3-a8bd-b8ff5e288df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:52.700468 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f23052-77d6-41a3-a8bd-b8ff5e288df9 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:52.700468 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f23052-77d6-41a3-a8bd-b8ff5e288df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:52.700468 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f23052-77d6-41a3-a8bd-b8ff5e288df9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:52.700990 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f23052-77d6-41a3-a8bd-b8ff5e288df9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:52.702739 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f23052-77d6-41a3-a8bd-b8ff5e288df9 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:52.714565 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 953/1895] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:48:52.718778 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f23052-77d6-41a3-a8bd-b8ff5e288df9 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:52.728984 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f23052-77d6-41a3-a8bd-b8ff5e288df9 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:52.742713 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35637f20-dbdf-4b73-8de5-f6f8b809582a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:52.742713 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35637f20-dbdf-4b73-8de5-f6f8b809582a admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:52.742713 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35637f20-dbdf-4b73-8de5-f6f8b809582a admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:52.742713 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35637f20-dbdf-4b73-8de5-f6f8b809582a admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:52.743295 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35637f20-dbdf-4b73-8de5-f6f8b809582a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:52.743295 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35637f20-dbdf-4b73-8de5-f6f8b809582a admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:52.752581 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 954/1896] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:48:52.756772 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35637f20-dbdf-4b73-8de5-f6f8b809582a admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:52.767681 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35637f20-dbdf-4b73-8de5-f6f8b809582a admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:52.776249 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7b65c-c3ff-4224-836a-a2f694a5d53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:52.777173 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7b65c-c3ff-4224-836a-a2f694a5d53b admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:52.777469 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7b65c-c3ff-4224-836a-a2f694a5d53b admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:52.777756 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7b65c-c3ff-4224-836a-a2f694a5d53b admin admin] PATH_INFO: `/v3/projects/3faf9f1ec2f64884bd5283fdd3fe5f74/users/473f1812445b4a81bc14fdbf67763efb/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:52.794146 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-1b15e1a1-1744-4995-9427-78a13bdfe393 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92be27ed977042aa9d567fdfe7732c8d', 'request_id': 'req-1b15e1a1-1744-4995-9427-78a13bdfe393'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:52.796853 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f7b65c-c3ff-4224-836a-a2f694a5d53b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3faf9f1ec2f64884bd5283fdd3fe5f74, user_id=473f1812445b4a81bc14fdbf67763efb, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:52.801565 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f7b65c-c3ff-4224-836a-a2f694a5d53b admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:52.872588 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-1b15e1a1-1744-4995-9427-78a13bdfe393 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92be27ed977042aa9d567fdfe7732c8d', 'request_id': 'req-1b15e1a1-1744-4995-9427-78a13bdfe393'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:52.879845 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-1b15e1a1-1744-4995-9427-78a13bdfe393 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92be27ed977042aa9d567fdfe7732c8d', 'request_id': 'req-1b15e1a1-1744-4995-9427-78a13bdfe393'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:52.892033 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-1b15e1a1-1744-4995-9427-78a13bdfe393 admin admin] The token cache is being invalidate because project 92be27ed977042aa9d567fdfe7732c8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:48:52.892444 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-1b15e1a1-1744-4995-9427-78a13bdfe393 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:52.893121 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-1b15e1a1-1744-4995-9427-78a13bdfe393 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:52.895133 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 943/1897] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:48:52 2022] DELETE /identity/v3/projects/92be27ed977042aa9d567fdfe7732c8d => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:48:52.904540 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcab828-d2dd-4eea-a420-3331eb0f8f24 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:52.904540 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcab828-d2dd-4eea-a420-3331eb0f8f24 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:52.904540 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcab828-d2dd-4eea-a420-3331eb0f8f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:52.922317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-5bcab828-d2dd-4eea-a420-3331eb0f8f24 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:52.923703 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-5bcab828-d2dd-4eea-a420-3331eb0f8f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:52.933436 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 955/1898] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:48:52 2022] PUT /identity/v3/projects/3faf9f1ec2f64884bd5283fdd3fe5f74/users/473f1812445b4a81bc14fdbf67763efb/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:48:52.944186 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd29d5-9fbb-4e85-8abd-a77dc73117c2 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:52.944483 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd29d5-9fbb-4e85-8abd-a77dc73117c2 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:52.944771 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd29d5-9fbb-4e85-8abd-a77dc73117c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:52.979276 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-3cbd29d5-9fbb-4e85-8abd-a77dc73117c2 None None] MFA Rules not processed for user `473f1812445b4a81bc14fdbf67763efb`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:52.979276 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-3cbd29d5-9fbb-4e85-8abd-a77dc73117c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:53.021870 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 944/1899] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:53.031180 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635aeafd-a362-4673-9909-4331a7506af7 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:53.035684 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635aeafd-a362-4673-9909-4331a7506af7 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:53.035684 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635aeafd-a362-4673-9909-4331a7506af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:53.067589 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-635aeafd-a362-4673-9909-4331a7506af7 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:53.068945 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-635aeafd-a362-4673-9909-4331a7506af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:53.081094 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 945/1900] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:53.082090 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635aeafd-a362-4673-9909-4331a7506af7 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:53.089806 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 956/1901] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:53.095114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635aeafd-a362-4673-9909-4331a7506af7 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:53.097901 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd29d5-9fbb-4e85-8abd-a77dc73117c2 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:53.098057 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc1b92-5a0d-4320-83d2-c300c1bcedcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:53.098654 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc1b92-5a0d-4320-83d2-c300c1bcedcc admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:53.099045 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc1b92-5a0d-4320-83d2-c300c1bcedcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:53.099407 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc1b92-5a0d-4320-83d2-c300c1bcedcc admin admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:53.100282 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc1b92-5a0d-4320-83d2-c300c1bcedcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:48:53.100537 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc1b92-5a0d-4320-83d2-c300c1bcedcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:53.101145 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-3cbd29d5-9fbb-4e85-8abd-a77dc73117c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:53.102290 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc1b92-5a0d-4320-83d2-c300c1bcedcc admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:53.117349 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd29d5-9fbb-4e85-8abd-a77dc73117c2 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:53.118973 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 946/1902] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:48:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:48:53.124857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc1b92-5a0d-4320-83d2-c300c1bcedcc admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:53.125729 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab0a8a6-9a3a-450e-b979-7e75c359d2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:53.126472 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0a8a6-9a3a-450e-b979-7e75c359d2f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:53.126756 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0a8a6-9a3a-450e-b979-7e75c359d2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:53.127077 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0a8a6-9a3a-450e-b979-7e75c359d2f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:53.128319 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab0a8a6-9a3a-450e-b979-7e75c359d2f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:53.130297 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab0a8a6-9a3a-450e-b979-7e75c359d2f8 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:53.143787 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc1b92-5a0d-4320-83d2-c300c1bcedcc admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:53.151200 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab4f14-cd71-45e4-913d-e045a4b7987f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:53.151914 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab4f14-cd71-45e4-913d-e045a4b7987f admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:53.152211 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab4f14-cd71-45e4-913d-e045a4b7987f admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:53.152494 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab4f14-cd71-45e4-913d-e045a4b7987f admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:53.153197 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab4f14-cd71-45e4-913d-e045a4b7987f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:53.156724 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab4f14-cd71-45e4-913d-e045a4b7987f admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:53.239294 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 957/1903] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:48:53 2022] POST /identity/v3/projects => generated 365 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:48:53.241412 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab0a8a6-9a3a-450e-b979-7e75c359d2f8 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:53.257537 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:53.271061 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 947/1904] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:48:53 2022] POST /identity/v3/projects => generated 361 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:48:53.272568 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab4f14-cd71-45e4-913d-e045a4b7987f admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:53.343580 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab0a8a6-9a3a-450e-b979-7e75c359d2f8 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:53.345214 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab4f14-cd71-45e4-913d-e045a4b7987f admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:53.350134 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc157f7-2b81-4e02-8aba-a6a315bee1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:53.350287 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adbb769-7794-45e5-a771-3088ae850125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:53.350784 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc157f7-2b81-4e02-8aba-a6a315bee1e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:53.351144 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adbb769-7794-45e5-a771-3088ae850125 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:53.356675 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc157f7-2b81-4e02-8aba-a6a315bee1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:53.356790 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adbb769-7794-45e5-a771-3088ae850125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:53.356886 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc157f7-2b81-4e02-8aba-a6a315bee1e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:53.356971 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adbb769-7794-45e5-a771-3088ae850125 admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:53.356971 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adbb769-7794-45e5-a771-3088ae850125 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:53.357132 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc157f7-2b81-4e02-8aba-a6a315bee1e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:53.357213 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adbb769-7794-45e5-a771-3088ae850125 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:53.357299 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc157f7-2b81-4e02-8aba-a6a315bee1e5 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:53.450705 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 958/1905] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:48:53 2022] POST /identity/v3/users => generated 289 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:48:53.453040 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 948/1906] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:48:53 2022] POST /identity/v3/users => generated 281 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:48:53.455669 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc157f7-2b81-4e02-8aba-a6a315bee1e5 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:53.456731 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adbb769-7794-45e5-a771-3088ae850125 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:53.467250 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc157f7-2b81-4e02-8aba-a6a315bee1e5 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:53.471360 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adbb769-7794-45e5-a771-3088ae850125 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:53.473341 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ddd4d4-1837-4a8c-82fd-1255337268af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:53.474042 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ddd4d4-1837-4a8c-82fd-1255337268af admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:53.474422 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c9ec2-4eac-4629-a04b-7f7a71762c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:53.474544 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ddd4d4-1837-4a8c-82fd-1255337268af admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:53.474826 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ddd4d4-1837-4a8c-82fd-1255337268af admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:53.475388 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c9ec2-4eac-4629-a04b-7f7a71762c0f admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:53.475716 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ddd4d4-1837-4a8c-82fd-1255337268af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:53.475812 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c9ec2-4eac-4629-a04b-7f7a71762c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:53.476165 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c9ec2-4eac-4629-a04b-7f7a71762c0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:53.477065 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c9ec2-4eac-4629-a04b-7f7a71762c0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:53.477612 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ddd4d4-1837-4a8c-82fd-1255337268af admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:53.479302 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c9ec2-4eac-4629-a04b-7f7a71762c0f admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:53.484733 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:53.496328 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 959/1907] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:48:53.501920 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 949/1908] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:48:53.502998 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ddd4d4-1837-4a8c-82fd-1255337268af admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:53.504459 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c9ec2-4eac-4629-a04b-7f7a71762c0f admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:53.513819 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ddd4d4-1837-4a8c-82fd-1255337268af admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:53.517462 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c9ec2-4eac-4629-a04b-7f7a71762c0f admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:53.519298 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac57d57-03d7-4f98-a7a4-987825396097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:53.519970 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac57d57-03d7-4f98-a7a4-987825396097 admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:53.520319 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac57d57-03d7-4f98-a7a4-987825396097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:53.520597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac57d57-03d7-4f98-a7a4-987825396097 admin admin] PATH_INFO: `/v3/projects/d7b4c0f21f3b4dc69e11c6f8f97cca7d/users/58a3b8fc72dc46398755600643b28e40/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:53.523368 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3b3ae-443a-4341-9c6c-4cdd5271aec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:53.524145 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3b3ae-443a-4341-9c6c-4cdd5271aec9 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:53.524498 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3b3ae-443a-4341-9c6c-4cdd5271aec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:53.524835 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3b3ae-443a-4341-9c6c-4cdd5271aec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:53.525626 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f3b3ae-443a-4341-9c6c-4cdd5271aec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:53.527377 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f3b3ae-443a-4341-9c6c-4cdd5271aec9 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:53.538558 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac57d57-03d7-4f98-a7a4-987825396097 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7b4c0f21f3b4dc69e11c6f8f97cca7d, user_id=58a3b8fc72dc46398755600643b28e40, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:53.538855 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 950/1909] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:48:53.542827 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3b3ae-443a-4341-9c6c-4cdd5271aec9 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:53.544629 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac57d57-03d7-4f98-a7a4-987825396097 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:53.553496 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3b3ae-443a-4341-9c6c-4cdd5271aec9 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:53.559296 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487b07c-df93-4de9-a9ce-602986c2018a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:53.560139 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487b07c-df93-4de9-a9ce-602986c2018a admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:53.560424 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487b07c-df93-4de9-a9ce-602986c2018a admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:53.560698 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487b07c-df93-4de9-a9ce-602986c2018a admin admin] PATH_INFO: `/v3/projects/f8a840dfc7f348afa5b6ed99fa37d9ee/users/287fb70e490147c08d4dae713e427b81/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:53.576004 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487b07c-df93-4de9-a9ce-602986c2018a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8a840dfc7f348afa5b6ed99fa37d9ee, user_id=287fb70e490147c08d4dae713e427b81, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:53.579407 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487b07c-df93-4de9-a9ce-602986c2018a admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:53.622245 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 960/1910] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:48:53 2022] PUT /identity/v3/projects/d7b4c0f21f3b4dc69e11c6f8f97cca7d/users/58a3b8fc72dc46398755600643b28e40/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:48:53.622245 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac57d57-03d7-4f98-a7a4-987825396097 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:53.691765 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac57d57-03d7-4f98-a7a4-987825396097 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:53.694473 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 951/1911] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:48:53 2022] PUT /identity/v3/projects/f8a840dfc7f348afa5b6ed99fa37d9ee/users/287fb70e490147c08d4dae713e427b81/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:48:53.705178 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c196c07-e5b3-4041-92d5-3a41805684fb None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:53.705458 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c196c07-e5b3-4041-92d5-3a41805684fb None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:53.705744 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c196c07-e5b3-4041-92d5-3a41805684fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:53.740167 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-0c196c07-e5b3-4041-92d5-3a41805684fb None None] MFA Rules not processed for user `287fb70e490147c08d4dae713e427b81`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:53.741796 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-0c196c07-e5b3-4041-92d5-3a41805684fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:53.764129 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457e7e2-3b15-47c0-a677-bac845172659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:53.765541 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457e7e2-3b15-47c0-a677-bac845172659 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:53.765924 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457e7e2-3b15-47c0-a677-bac845172659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:53.766259 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457e7e2-3b15-47c0-a677-bac845172659 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:53.767243 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f457e7e2-3b15-47c0-a677-bac845172659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:53.769302 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f457e7e2-3b15-47c0-a677-bac845172659 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:53.784792 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 961/1912] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:48:53.787846 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457e7e2-3b15-47c0-a677-bac845172659 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:53.798012 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457e7e2-3b15-47c0-a677-bac845172659 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:53.804240 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17880f-af32-45cb-bfb7-dd9a69688fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:53.806061 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17880f-af32-45cb-bfb7-dd9a69688fd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:53.806358 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17880f-af32-45cb-bfb7-dd9a69688fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:53.806640 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17880f-af32-45cb-bfb7-dd9a69688fd5 admin admin] PATH_INFO: `/v3/projects/d7b4c0f21f3b4dc69e11c6f8f97cca7d/users/58a3b8fc72dc46398755600643b28e40/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:53.808958 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b17880f-af32-45cb-bfb7-dd9a69688fd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7b4c0f21f3b4dc69e11c6f8f97cca7d, user_id=58a3b8fc72dc46398755600643b28e40, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:53.812850 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b17880f-af32-45cb-bfb7-dd9a69688fd5 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:53.824649 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 962/1913] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:48:53 2022] PUT /identity/v3/projects/d7b4c0f21f3b4dc69e11c6f8f97cca7d/users/58a3b8fc72dc46398755600643b28e40/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:48:53.836257 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281ed06-61fd-4a3a-b850-6a6ffa15438e None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:53.836584 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281ed06-61fd-4a3a-b850-6a6ffa15438e None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:53.836867 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281ed06-61fd-4a3a-b850-6a6ffa15438e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:53.839428 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 952/1914] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:48:53.887237 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c196c07-e5b3-4041-92d5-3a41805684fb None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:53.889182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-0c196c07-e5b3-4041-92d5-3a41805684fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:53.897267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-4281ed06-61fd-4a3a-b850-6a6ffa15438e None None] MFA Rules not processed for user `58a3b8fc72dc46398755600643b28e40`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:53.900073 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-4281ed06-61fd-4a3a-b850-6a6ffa15438e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:53.971028 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c196c07-e5b3-4041-92d5-3a41805684fb None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:54.046880 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e805f-c893-41db-b58d-15a84d05dc83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:54.047761 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e805f-c893-41db-b58d-15a84d05dc83 service cinder] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:54.048162 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e805f-c893-41db-b58d-15a84d05dc83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:54.048538 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e805f-c893-41db-b58d-15a84d05dc83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:54.055780 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 963/1915] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:53 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:54.070648 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4281ed06-61fd-4a3a-b850-6a6ffa15438e None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:54.073262 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:54.075279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-4281ed06-61fd-4a3a-b850-6a6ffa15438e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:54.100439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4281ed06-61fd-4a3a-b850-6a6ffa15438e None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:54.111473 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc67bd3d-ff45-405d-942b-069df9de4e3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:54.113051 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67bd3d-ff45-405d-942b-069df9de4e3b service cinder] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:54.113577 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67bd3d-ff45-405d-942b-069df9de4e3b service cinder] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:54.114043 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67bd3d-ff45-405d-942b-069df9de4e3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:54.125078 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc67bd3d-ff45-405d-942b-069df9de4e3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:54.126559 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc67bd3d-ff45-405d-942b-069df9de4e3b service cinder] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:54.131896 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:54.143016 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 964/1916] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:48:54 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:48:54.152364 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e805f-c893-41db-b58d-15a84d05dc83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:54.154013 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e805f-c893-41db-b58d-15a84d05dc83 service cinder] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:54.165041 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 953/1917] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:48:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:48:54.181421 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc67bd3d-ff45-405d-942b-069df9de4e3b service cinder] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:54.256118 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc67bd3d-ff45-405d-942b-069df9de4e3b service cinder] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:54.263878 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42b7d4-e6a7-48e5-baa8-704aedb12afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:54.264121 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42b7d4-e6a7-48e5-baa8-704aedb12afe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:54.264381 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42b7d4-e6a7-48e5-baa8-704aedb12afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:54.265391 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42b7d4-e6a7-48e5-baa8-704aedb12afe admin admin] PATH_INFO: `/v3/users/287fb70e490147c08d4dae713e427b81` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:54.266711 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b42b7d4-e6a7-48e5-baa8-704aedb12afe admin admin] RBAC: Authorizing `identity:delete_user(user_id=287fb70e490147c08d4dae713e427b81)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:54.269338 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b42b7d4-e6a7-48e5-baa8-704aedb12afe admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:54.407588 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e805f-c893-41db-b58d-15a84d05dc83 service cinder] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:54.416152 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e805f-c893-41db-b58d-15a84d05dc83 service cinder] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:54.421043 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029cdad7-ca66-4380-bf3d-57c241adb3a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:54.421653 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cdad7-ca66-4380-bf3d-57c241adb3a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:54.421935 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cdad7-ca66-4380-bf3d-57c241adb3a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:54.422214 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cdad7-ca66-4380-bf3d-57c241adb3a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:54.487061 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-9b42b7d4-e6a7-48e5-baa8-704aedb12afe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '287fb70e490147c08d4dae713e427b81'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:54.488325 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029cdad7-ca66-4380-bf3d-57c241adb3a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:54.489782 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029cdad7-ca66-4380-bf3d-57c241adb3a7 service cinder] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:54.501213 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 954/1918] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:48:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:48:54.552530 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-9b42b7d4-e6a7-48e5-baa8-704aedb12afe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '287fb70e490147c08d4dae713e427b81'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:54.560404 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-9b42b7d4-e6a7-48e5-baa8-704aedb12afe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '287fb70e490147c08d4dae713e427b81'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:54.573003 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-9b42b7d4-e6a7-48e5-baa8-704aedb12afe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '287fb70e490147c08d4dae713e427b81'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:54.573789 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-9b42b7d4-e6a7-48e5-baa8-704aedb12afe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '287fb70e490147c08d4dae713e427b81'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:54.581948 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 965/1919] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:48:54 2022] DELETE /identity/v3/users/287fb70e490147c08d4dae713e427b81 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:48:54.588354 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e893224-8501-4729-bf3c-55c037c0a426 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:54.588717 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e893224-8501-4729-bf3c-55c037c0a426 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:54.591531 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e893224-8501-4729-bf3c-55c037c0a426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:54.613246 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-3e893224-8501-4729-bf3c-55c037c0a426 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:54.615453 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-3e893224-8501-4729-bf3c-55c037c0a426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:54.694181 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 955/1920] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:54.704033 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42b7d4-e6a7-48e5-baa8-704aedb12afe admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:54.705594 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-9b42b7d4-e6a7-48e5-baa8-704aedb12afe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:54.764270 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42b7d4-e6a7-48e5-baa8-704aedb12afe admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:54.767880 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb7e82d-a90c-47df-bc8a-690c2cc0378c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:54.768618 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7e82d-a90c-47df-bc8a-690c2cc0378c service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:54.768895 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7e82d-a90c-47df-bc8a-690c2cc0378c service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:54.769165 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7e82d-a90c-47df-bc8a-690c2cc0378c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:54.778420 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb7e82d-a90c-47df-bc8a-690c2cc0378c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:54.781485 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb7e82d-a90c-47df-bc8a-690c2cc0378c service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:54.789542 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 966/1921] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:48:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:48:54.801765 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:54.951199 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:55.257355 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e893224-8501-4729-bf3c-55c037c0a426 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:55.258875 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-3e893224-8501-4729-bf3c-55c037c0a426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:55.271363 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e893224-8501-4729-bf3c-55c037c0a426 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:55.277639 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce7942-66de-476d-8aed-31b9479655d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:55.277639 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce7942-66de-476d-8aed-31b9479655d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:55.278468 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce7942-66de-476d-8aed-31b9479655d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:55.278468 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce7942-66de-476d-8aed-31b9479655d8 admin admin] PATH_INFO: `/v3/projects/f8a840dfc7f348afa5b6ed99fa37d9ee` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:55.279975 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce7942-66de-476d-8aed-31b9479655d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8a840dfc7f348afa5b6ed99fa37d9ee)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:55.282666 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce7942-66de-476d-8aed-31b9479655d8 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:55.412416 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-0dce7942-66de-476d-8aed-31b9479655d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8a840dfc7f348afa5b6ed99fa37d9ee', 'request_id': 'req-0dce7942-66de-476d-8aed-31b9479655d8'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:55.506409 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-0dce7942-66de-476d-8aed-31b9479655d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8a840dfc7f348afa5b6ed99fa37d9ee', 'request_id': 'req-0dce7942-66de-476d-8aed-31b9479655d8'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:55.512889 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-0dce7942-66de-476d-8aed-31b9479655d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8a840dfc7f348afa5b6ed99fa37d9ee', 'request_id': 'req-0dce7942-66de-476d-8aed-31b9479655d8'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:55.524732 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-0dce7942-66de-476d-8aed-31b9479655d8 admin admin] The token cache is being invalidate because project f8a840dfc7f348afa5b6ed99fa37d9ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:48:55.525018 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-0dce7942-66de-476d-8aed-31b9479655d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:55.525675 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-0dce7942-66de-476d-8aed-31b9479655d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:48:55.527248 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 956/1922] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:48:55 2022] DELETE /identity/v3/projects/f8a840dfc7f348afa5b6ed99fa37d9ee => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:48:55.532913 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332ebc2-2769-47d5-80e4-8d4bbc231ed3 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:55.533368 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332ebc2-2769-47d5-80e4-8d4bbc231ed3 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:55.541412 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332ebc2-2769-47d5-80e4-8d4bbc231ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:55.552877 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-c332ebc2-2769-47d5-80e4-8d4bbc231ed3 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:55.554069 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-c332ebc2-2769-47d5-80e4-8d4bbc231ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:55.629099 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 967/1923] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:55.636698 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888cd2ba-3106-40a7-b9a2-d59d314c7c87 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:55.636984 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888cd2ba-3106-40a7-b9a2-d59d314c7c87 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:55.637258 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888cd2ba-3106-40a7-b9a2-d59d314c7c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:55.658227 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-888cd2ba-3106-40a7-b9a2-d59d314c7c87 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:55.659404 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-888cd2ba-3106-40a7-b9a2-d59d314c7c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:55.667287 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 957/1924] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:55.671501 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332ebc2-2769-47d5-80e4-8d4bbc231ed3 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:55.681182 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332ebc2-2769-47d5-80e4-8d4bbc231ed3 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:55.685889 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a0fa0b-e494-43f8-ad40-0642a8f72a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:55.686535 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0fa0b-e494-43f8-ad40-0642a8f72a26 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:55.687290 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0fa0b-e494-43f8-ad40-0642a8f72a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:55.687290 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0fa0b-e494-43f8-ad40-0642a8f72a26 admin admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:55.687819 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a0fa0b-e494-43f8-ad40-0642a8f72a26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:48:55.688125 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a0fa0b-e494-43f8-ad40-0642a8f72a26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:55.689736 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a0fa0b-e494-43f8-ad40-0642a8f72a26 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:55.701735 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 968/1925] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:48:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:48:55.706875 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888cd2ba-3106-40a7-b9a2-d59d314c7c87 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:55.716271 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888cd2ba-3106-40a7-b9a2-d59d314c7c87 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:55.721956 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a4a4bf-faaa-43db-9194-24d6deb33188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:55.722631 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4a4bf-faaa-43db-9194-24d6deb33188 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:55.722941 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4a4bf-faaa-43db-9194-24d6deb33188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:55.723283 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4a4bf-faaa-43db-9194-24d6deb33188 admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:55.723959 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a4a4bf-faaa-43db-9194-24d6deb33188 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:55.725899 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a4a4bf-faaa-43db-9194-24d6deb33188 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:55.846277 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 958/1926] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:48:55 2022] POST /identity/v3/projects => generated 375 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:48:55.850550 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a0fa0b-e494-43f8-ad40-0642a8f72a26 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:55.861076 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a0fa0b-e494-43f8-ad40-0642a8f72a26 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:55.933903 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e66c93-9857-4e31-9622-08e33256192a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:55.934676 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e66c93-9857-4e31-9622-08e33256192a admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:55.934994 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e66c93-9857-4e31-9622-08e33256192a admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:55.935276 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e66c93-9857-4e31-9622-08e33256192a admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:55.935983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e66c93-9857-4e31-9622-08e33256192a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:55.938424 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e66c93-9857-4e31-9622-08e33256192a admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:56.049432 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 969/1927] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:48:55 2022] POST /identity/v3/users => generated 288 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:48:56.053498 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a4a4bf-faaa-43db-9194-24d6deb33188 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:56.064951 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a4a4bf-faaa-43db-9194-24d6deb33188 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:56.069440 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855fa90-fe2b-4771-9c15-0a26491e234e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:56.070047 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855fa90-fe2b-4771-9c15-0a26491e234e admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:56.070324 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855fa90-fe2b-4771-9c15-0a26491e234e admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:56.070595 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855fa90-fe2b-4771-9c15-0a26491e234e admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:56.071347 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5855fa90-fe2b-4771-9c15-0a26491e234e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:56.072935 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5855fa90-fe2b-4771-9c15-0a26491e234e admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:56.084040 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 959/1928] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:48:56.088052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e66c93-9857-4e31-9622-08e33256192a admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:56.098599 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e66c93-9857-4e31-9622-08e33256192a admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:56.103400 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3fbc6b-4724-4422-88a7-94bbde53a46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:56.104028 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fbc6b-4724-4422-88a7-94bbde53a46d admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:56.104311 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fbc6b-4724-4422-88a7-94bbde53a46d admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:56.104588 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fbc6b-4724-4422-88a7-94bbde53a46d admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:56.105452 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3fbc6b-4724-4422-88a7-94bbde53a46d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:56.107254 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3fbc6b-4724-4422-88a7-94bbde53a46d admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:56.118974 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 970/1929] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:48:56.122779 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855fa90-fe2b-4771-9c15-0a26491e234e admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:56.133378 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855fa90-fe2b-4771-9c15-0a26491e234e admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:56.138157 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de39a0-2593-4c05-8f4d-aa5892ace5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:56.138921 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de39a0-2593-4c05-8f4d-aa5892ace5a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:56.140374 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de39a0-2593-4c05-8f4d-aa5892ace5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:56.140374 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de39a0-2593-4c05-8f4d-aa5892ace5a1 admin admin] PATH_INFO: `/v3/projects/db444c608be74bd686a8574ce72d95c4/users/e3b0e9bd4085482aacc0c899d664919e/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:56.155727 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de39a0-2593-4c05-8f4d-aa5892ace5a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db444c608be74bd686a8574ce72d95c4, user_id=e3b0e9bd4085482aacc0c899d664919e, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:56.158466 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de39a0-2593-4c05-8f4d-aa5892ace5a1 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:56.226797 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 960/1930] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:48:56 2022] PUT /identity/v3/projects/db444c608be74bd686a8574ce72d95c4/users/e3b0e9bd4085482aacc0c899d664919e/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:48:56.238573 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edd898-14f6-48c6-9f96-13509ec1968b None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:56.238978 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edd898-14f6-48c6-9f96-13509ec1968b None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:56.239274 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edd898-14f6-48c6-9f96-13509ec1968b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:56.271569 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-60edd898-14f6-48c6-9f96-13509ec1968b None None] MFA Rules not processed for user `e3b0e9bd4085482aacc0c899d664919e`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:48:56.272948 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-60edd898-14f6-48c6-9f96-13509ec1968b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:56.329539 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:48:56.338303 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 971/1931] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:48:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:48:56.348990 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de39a0-2593-4c05-8f4d-aa5892ace5a1 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:48:56.350759 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-d6de39a0-2593-4c05-8f4d-aa5892ace5a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:48:56.411707 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de39a0-2593-4c05-8f4d-aa5892ace5a1 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:48:56.417082 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358d336-ab0a-479f-aeaa-2d993860de9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:48:56.417708 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358d336-ab0a-479f-aeaa-2d993860de9c service cinder] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:48:56.417991 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358d336-ab0a-479f-aeaa-2d993860de9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:48:56.418269 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358d336-ab0a-479f-aeaa-2d993860de9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:48:56.427678 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358d336-ab0a-479f-aeaa-2d993860de9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:48:56.429196 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358d336-ab0a-479f-aeaa-2d993860de9c service cinder] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:48:56.439385 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 961/1932] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:48:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:49:00.691039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60edd898-14f6-48c6-9f96-13509ec1968b None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:00.755349 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60edd898-14f6-48c6-9f96-13509ec1968b None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:00.760051 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d734af-c469-487a-8265-17a9ce88289b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:00.760692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d734af-c469-487a-8265-17a9ce88289b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:00.760971 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d734af-c469-487a-8265-17a9ce88289b admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:00.761248 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d734af-c469-487a-8265-17a9ce88289b admin admin] PATH_INFO: `/v3/users/e3b0e9bd4085482aacc0c899d664919e` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:00.762408 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d734af-c469-487a-8265-17a9ce88289b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3b0e9bd4085482aacc0c899d664919e)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:00.764382 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d734af-c469-487a-8265-17a9ce88289b admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:00.944640 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-d3d734af-c469-487a-8265-17a9ce88289b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3b0e9bd4085482aacc0c899d664919e'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:01.059579 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-d3d734af-c469-487a-8265-17a9ce88289b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3b0e9bd4085482aacc0c899d664919e'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:01.066973 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-d3d734af-c469-487a-8265-17a9ce88289b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3b0e9bd4085482aacc0c899d664919e'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:01.078927 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-d3d734af-c469-487a-8265-17a9ce88289b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3b0e9bd4085482aacc0c899d664919e'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:01.079573 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-d3d734af-c469-487a-8265-17a9ce88289b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3b0e9bd4085482aacc0c899d664919e'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:01.085336 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 972/1933] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:49:00 2022] DELETE /identity/v3/users/e3b0e9bd4085482aacc0c899d664919e => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:49:01.089736 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661ce6e-1dbc-4fdb-9cc3-de93b1946be5 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:01.092842 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661ce6e-1dbc-4fdb-9cc3-de93b1946be5 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:01.092842 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661ce6e-1dbc-4fdb-9cc3-de93b1946be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:01.099177 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:01.110493 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-6661ce6e-1dbc-4fdb-9cc3-de93b1946be5 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:01.111634 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-6661ce6e-1dbc-4fdb-9cc3-de93b1946be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:01.169733 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 962/1934] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:49:01.179994 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d734af-c469-487a-8265-17a9ce88289b admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:01.181402 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-d3d734af-c469-487a-8265-17a9ce88289b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:01.256095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d734af-c469-487a-8265-17a9ce88289b admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:01.259948 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6fe0c4-7407-48ed-b69a-95c5a06a1838 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:01.260598 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6fe0c4-7407-48ed-b69a-95c5a06a1838 service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:01.260941 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6fe0c4-7407-48ed-b69a-95c5a06a1838 service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:01.261277 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6fe0c4-7407-48ed-b69a-95c5a06a1838 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:01.273640 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6fe0c4-7407-48ed-b69a-95c5a06a1838 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:01.275112 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6fe0c4-7407-48ed-b69a-95c5a06a1838 service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:01.285665 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 973/1935] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:49:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:49:01.712260 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661ce6e-1dbc-4fdb-9cc3-de93b1946be5 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:01.713671 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-6661ce6e-1dbc-4fdb-9cc3-de93b1946be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:01.727986 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661ce6e-1dbc-4fdb-9cc3-de93b1946be5 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:01.732823 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ec6b8-5e7b-4731-b098-65c5afcfd6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:01.738897 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ec6b8-5e7b-4731-b098-65c5afcfd6cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:01.738897 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ec6b8-5e7b-4731-b098-65c5afcfd6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:01.738897 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ec6b8-5e7b-4731-b098-65c5afcfd6cf admin admin] PATH_INFO: `/v3/projects/db444c608be74bd686a8574ce72d95c4` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:01.738897 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ec6b8-5e7b-4731-b098-65c5afcfd6cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=db444c608be74bd686a8574ce72d95c4)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:01.738897 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ec6b8-5e7b-4731-b098-65c5afcfd6cf admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:01.943616 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-648ec6b8-5e7b-4731-b098-65c5afcfd6cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db444c608be74bd686a8574ce72d95c4', 'request_id': 'req-648ec6b8-5e7b-4731-b098-65c5afcfd6cf'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:02.026297 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-648ec6b8-5e7b-4731-b098-65c5afcfd6cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db444c608be74bd686a8574ce72d95c4', 'request_id': 'req-648ec6b8-5e7b-4731-b098-65c5afcfd6cf'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:02.038020 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-648ec6b8-5e7b-4731-b098-65c5afcfd6cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db444c608be74bd686a8574ce72d95c4', 'request_id': 'req-648ec6b8-5e7b-4731-b098-65c5afcfd6cf'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:02.052095 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-648ec6b8-5e7b-4731-b098-65c5afcfd6cf admin admin] The token cache is being invalidate because project db444c608be74bd686a8574ce72d95c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:49:02.052398 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-648ec6b8-5e7b-4731-b098-65c5afcfd6cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:02.053071 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-648ec6b8-5e7b-4731-b098-65c5afcfd6cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:02.054750 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 963/1936] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:49:01 2022] DELETE /identity/v3/projects/db444c608be74bd686a8574ce72d95c4 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:49:02.060157 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae6545-0d7c-4e8e-8fcd-893e82aa4276 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:02.061540 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae6545-0d7c-4e8e-8fcd-893e82aa4276 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:02.064615 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae6545-0d7c-4e8e-8fcd-893e82aa4276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:02.083128 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-d8ae6545-0d7c-4e8e-8fcd-893e82aa4276 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:02.084619 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-d8ae6545-0d7c-4e8e-8fcd-893e82aa4276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:02.100518 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:02.161621 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 974/1937] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:49:02.169569 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bfa37-1871-4219-aae7-036f4c178b7e None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:02.170039 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bfa37-1871-4219-aae7-036f4c178b7e None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:02.170170 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bfa37-1871-4219-aae7-036f4c178b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:02.191373 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-9c7bfa37-1871-4219-aae7-036f4c178b7e None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:02.192583 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-9c7bfa37-1871-4219-aae7-036f4c178b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:02.202995 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 964/1938] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:49:02.205781 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae6545-0d7c-4e8e-8fcd-893e82aa4276 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:02.219726 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae6545-0d7c-4e8e-8fcd-893e82aa4276 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:02.233684 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45084bdb-e021-4daa-9eca-094c6724d335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:02.234427 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45084bdb-e021-4daa-9eca-094c6724d335 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:02.234783 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45084bdb-e021-4daa-9eca-094c6724d335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:02.235185 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45084bdb-e021-4daa-9eca-094c6724d335 admin admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:02.236116 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45084bdb-e021-4daa-9eca-094c6724d335 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:49:02.236487 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45084bdb-e021-4daa-9eca-094c6724d335 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:02.238556 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45084bdb-e021-4daa-9eca-094c6724d335 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:02.254388 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 975/1939] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:49:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:49:02.258528 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7bfa37-1871-4219-aae7-036f4c178b7e None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:02.268345 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7bfa37-1871-4219-aae7-036f4c178b7e None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:02.273325 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9fc62-fa30-41c8-bd9d-381e4900fd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:02.274577 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9fc62-fa30-41c8-bd9d-381e4900fd80 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:02.275205 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9fc62-fa30-41c8-bd9d-381e4900fd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:02.275713 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9fc62-fa30-41c8-bd9d-381e4900fd80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:02.276714 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9fc62-fa30-41c8-bd9d-381e4900fd80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:02.279024 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9fc62-fa30-41c8-bd9d-381e4900fd80 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:02.359266 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 965/1940] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:49:02 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:49:02.363514 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45084bdb-e021-4daa-9eca-094c6724d335 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:02.374163 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45084bdb-e021-4daa-9eca-094c6724d335 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:02.433342 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f757bf-93d1-4862-8257-8bb1313640b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:02.433897 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f757bf-93d1-4862-8257-8bb1313640b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:02.434181 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f757bf-93d1-4862-8257-8bb1313640b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:02.434460 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f757bf-93d1-4862-8257-8bb1313640b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:02.435150 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f757bf-93d1-4862-8257-8bb1313640b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:02.437699 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f757bf-93d1-4862-8257-8bb1313640b1 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:02.511622 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 976/1941] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:49:02 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:49:02.518894 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9fc62-fa30-41c8-bd9d-381e4900fd80 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:02.531513 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9fc62-fa30-41c8-bd9d-381e4900fd80 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:02.536405 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d640a-04a0-4706-ae8f-39dd328179de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:02.537024 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d640a-04a0-4706-ae8f-39dd328179de admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:02.537311 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d640a-04a0-4706-ae8f-39dd328179de admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:02.537588 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d640a-04a0-4706-ae8f-39dd328179de admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:02.538285 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946d640a-04a0-4706-ae8f-39dd328179de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:02.539935 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946d640a-04a0-4706-ae8f-39dd328179de admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:02.550688 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 966/1942] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:49:02.554878 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f757bf-93d1-4862-8257-8bb1313640b1 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:02.565527 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f757bf-93d1-4862-8257-8bb1313640b1 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:02.570357 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18828cc4-6fe7-4a86-863d-a11ca5b3aad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:02.571094 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18828cc4-6fe7-4a86-863d-a11ca5b3aad5 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:02.571445 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18828cc4-6fe7-4a86-863d-a11ca5b3aad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:02.571791 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18828cc4-6fe7-4a86-863d-a11ca5b3aad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:02.572625 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18828cc4-6fe7-4a86-863d-a11ca5b3aad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:02.574294 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18828cc4-6fe7-4a86-863d-a11ca5b3aad5 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:02.586810 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 977/1943] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:49:02.591655 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d640a-04a0-4706-ae8f-39dd328179de admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:02.604483 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d640a-04a0-4706-ae8f-39dd328179de admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:02.611106 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eea4e1-baa7-4b2b-b967-c3950e50ca26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:02.611904 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eea4e1-baa7-4b2b-b967-c3950e50ca26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:02.612258 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eea4e1-baa7-4b2b-b967-c3950e50ca26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:02.612721 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eea4e1-baa7-4b2b-b967-c3950e50ca26 admin admin] PATH_INFO: `/v3/projects/6636331ab23743878eca0521a172853e/users/8899e781da8d4d05af2ce5a120874d08/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:02.629211 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eea4e1-baa7-4b2b-b967-c3950e50ca26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6636331ab23743878eca0521a172853e, user_id=8899e781da8d4d05af2ce5a120874d08, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:02.634671 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eea4e1-baa7-4b2b-b967-c3950e50ca26 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:02.697848 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 967/1944] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:49:02 2022] PUT /identity/v3/projects/6636331ab23743878eca0521a172853e/users/8899e781da8d4d05af2ce5a120874d08/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:49:02.703921 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18867f-dc82-49a3-90f1-6f52aaa1a35a None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:02.704235 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18867f-dc82-49a3-90f1-6f52aaa1a35a None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:02.704518 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18867f-dc82-49a3-90f1-6f52aaa1a35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:02.724044 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-2d18867f-dc82-49a3-90f1-6f52aaa1a35a None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:02.725262 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-2d18867f-dc82-49a3-90f1-6f52aaa1a35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:02.787739 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 978/1945] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:49:02.798025 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eea4e1-baa7-4b2b-b967-c3950e50ca26 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:02.799806 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-b3eea4e1-baa7-4b2b-b967-c3950e50ca26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:02.827666 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:02.857471 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eea4e1-baa7-4b2b-b967-c3950e50ca26 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:02.861763 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6defb0ca-da47-4de3-86f8-97928790229f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:02.862377 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defb0ca-da47-4de3-86f8-97928790229f service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:02.862660 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defb0ca-da47-4de3-86f8-97928790229f service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:02.862945 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defb0ca-da47-4de3-86f8-97928790229f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:02.871966 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6defb0ca-da47-4de3-86f8-97928790229f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:02.873399 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6defb0ca-da47-4de3-86f8-97928790229f service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:02.882798 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 968/1946] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:49:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:49:04.970982 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d18867f-dc82-49a3-90f1-6f52aaa1a35a None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:04.973225 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-2d18867f-dc82-49a3-90f1-6f52aaa1a35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:04.992244 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d18867f-dc82-49a3-90f1-6f52aaa1a35a None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:04.998134 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ee481-c0e0-4887-b2f6-fa3839b5f6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:04.999407 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ee481-c0e0-4887-b2f6-fa3839b5f6a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:04.999691 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ee481-c0e0-4887-b2f6-fa3839b5f6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:05.000010 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ee481-c0e0-4887-b2f6-fa3839b5f6a9 admin admin] PATH_INFO: `/v3/users/473f1812445b4a81bc14fdbf67763efb` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:05.001299 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ee481-c0e0-4887-b2f6-fa3839b5f6a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=473f1812445b4a81bc14fdbf67763efb)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:05.003316 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ee481-c0e0-4887-b2f6-fa3839b5f6a9 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:05.030582 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:05.205146 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-eb2ee481-c0e0-4887-b2f6-fa3839b5f6a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '473f1812445b4a81bc14fdbf67763efb'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:05.315026 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-eb2ee481-c0e0-4887-b2f6-fa3839b5f6a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '473f1812445b4a81bc14fdbf67763efb'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:05.334385 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-eb2ee481-c0e0-4887-b2f6-fa3839b5f6a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '473f1812445b4a81bc14fdbf67763efb'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:05.373925 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-eb2ee481-c0e0-4887-b2f6-fa3839b5f6a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '473f1812445b4a81bc14fdbf67763efb'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:05.374681 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-eb2ee481-c0e0-4887-b2f6-fa3839b5f6a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '473f1812445b4a81bc14fdbf67763efb'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:05.385665 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 979/1947] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:49:04 2022] DELETE /identity/v3/users/473f1812445b4a81bc14fdbf67763efb => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:49:05.387784 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9134e3f-655c-4289-a137-26bd5f67f92d None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:05.388248 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9134e3f-655c-4289-a137-26bd5f67f92d None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:05.388358 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9134e3f-655c-4289-a137-26bd5f67f92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:05.411003 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-e9134e3f-655c-4289-a137-26bd5f67f92d None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:05.412340 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-e9134e3f-655c-4289-a137-26bd5f67f92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:05.486554 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 969/1948] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:49:05.495323 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ee481-c0e0-4887-b2f6-fa3839b5f6a9 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:05.497314 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-eb2ee481-c0e0-4887-b2f6-fa3839b5f6a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:05.581969 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ee481-c0e0-4887-b2f6-fa3839b5f6a9 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:05.586051 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f7457-16c8-44a1-a4eb-b525e7c5a4c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:05.586624 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f7457-16c8-44a1-a4eb-b525e7c5a4c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:05.586911 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f7457-16c8-44a1-a4eb-b525e7c5a4c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:05.587315 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f7457-16c8-44a1-a4eb-b525e7c5a4c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:05.598649 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25f7457-16c8-44a1-a4eb-b525e7c5a4c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:05.600176 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25f7457-16c8-44a1-a4eb-b525e7c5a4c0 service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:05.617130 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 980/1949] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:49:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:49:06.474592 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9134e3f-655c-4289-a137-26bd5f67f92d None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:06.477180 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-e9134e3f-655c-4289-a137-26bd5f67f92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:06.504771 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9134e3f-655c-4289-a137-26bd5f67f92d None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:06.518732 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c0a58b-7825-423f-af7f-baf3b343b3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:06.519975 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0a58b-7825-423f-af7f-baf3b343b3c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:06.520432 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0a58b-7825-423f-af7f-baf3b343b3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:06.525135 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0a58b-7825-423f-af7f-baf3b343b3c5 admin admin] PATH_INFO: `/v3/projects/3faf9f1ec2f64884bd5283fdd3fe5f74` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:06.525135 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c0a58b-7825-423f-af7f-baf3b343b3c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3faf9f1ec2f64884bd5283fdd3fe5f74)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:06.525135 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c0a58b-7825-423f-af7f-baf3b343b3c5 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:06.672188 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-68c0a58b-7825-423f-af7f-baf3b343b3c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3faf9f1ec2f64884bd5283fdd3fe5f74', 'request_id': 'req-68c0a58b-7825-423f-af7f-baf3b343b3c5'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:06.746664 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-68c0a58b-7825-423f-af7f-baf3b343b3c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3faf9f1ec2f64884bd5283fdd3fe5f74', 'request_id': 'req-68c0a58b-7825-423f-af7f-baf3b343b3c5'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:06.758031 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-68c0a58b-7825-423f-af7f-baf3b343b3c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3faf9f1ec2f64884bd5283fdd3fe5f74', 'request_id': 'req-68c0a58b-7825-423f-af7f-baf3b343b3c5'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:06.780061 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-68c0a58b-7825-423f-af7f-baf3b343b3c5 admin admin] The token cache is being invalidate because project 3faf9f1ec2f64884bd5283fdd3fe5f74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:49:06.780510 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-68c0a58b-7825-423f-af7f-baf3b343b3c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:06.781274 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-68c0a58b-7825-423f-af7f-baf3b343b3c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:06.783477 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 970/1950] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:49:06 2022] DELETE /identity/v3/projects/3faf9f1ec2f64884bd5283fdd3fe5f74 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:49:06.787504 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f7457-16c8-44a1-a4eb-b525e7c5a4c0 service neutron] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:06.797607 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f7457-16c8-44a1-a4eb-b525e7c5a4c0 service neutron] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:06.876082 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1903f9-f2bc-4fb8-bf2c-b0c771274496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:06.876900 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1903f9-f2bc-4fb8-bf2c-b0c771274496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:06.877373 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1903f9-f2bc-4fb8-bf2c-b0c771274496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:06.877833 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1903f9-f2bc-4fb8-bf2c-b0c771274496 admin admin] PATH_INFO: `/v3/users/58a3b8fc72dc46398755600643b28e40` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:06.879628 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1903f9-f2bc-4fb8-bf2c-b0c771274496 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58a3b8fc72dc46398755600643b28e40)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:06.890071 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1903f9-f2bc-4fb8-bf2c-b0c771274496 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:07.117559 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:07.128628 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-2e1903f9-f2bc-4fb8-bf2c-b0c771274496 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58a3b8fc72dc46398755600643b28e40'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:07.197546 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-2e1903f9-f2bc-4fb8-bf2c-b0c771274496 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58a3b8fc72dc46398755600643b28e40'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:07.207508 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-2e1903f9-f2bc-4fb8-bf2c-b0c771274496 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58a3b8fc72dc46398755600643b28e40'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:07.255609 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-2e1903f9-f2bc-4fb8-bf2c-b0c771274496 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58a3b8fc72dc46398755600643b28e40'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:07.263496 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-2e1903f9-f2bc-4fb8-bf2c-b0c771274496 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58a3b8fc72dc46398755600643b28e40'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:07.283720 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 981/1951] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:49:06 2022] DELETE /identity/v3/users/58a3b8fc72dc46398755600643b28e40 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:49:07.998221 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c0a58b-7825-423f-af7f-baf3b343b3c5 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:08.001572 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-68c0a58b-7825-423f-af7f-baf3b343b3c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:08.024405 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c0a58b-7825-423f-af7f-baf3b343b3c5 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:08.138359 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:08.168235 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781ed61-5e2f-4ebf-94be-2d576ba978a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:08.170122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781ed61-5e2f-4ebf-94be-2d576ba978a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:08.170568 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781ed61-5e2f-4ebf-94be-2d576ba978a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:08.171290 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781ed61-5e2f-4ebf-94be-2d576ba978a7 admin admin] PATH_INFO: `/v3/projects/d7b4c0f21f3b4dc69e11c6f8f97cca7d` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:08.177083 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1781ed61-5e2f-4ebf-94be-2d576ba978a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7b4c0f21f3b4dc69e11c6f8f97cca7d)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:08.180494 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1781ed61-5e2f-4ebf-94be-2d576ba978a7 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:08.361280 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-1781ed61-5e2f-4ebf-94be-2d576ba978a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7b4c0f21f3b4dc69e11c6f8f97cca7d', 'request_id': 'req-1781ed61-5e2f-4ebf-94be-2d576ba978a7'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:08.460336 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-1781ed61-5e2f-4ebf-94be-2d576ba978a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7b4c0f21f3b4dc69e11c6f8f97cca7d', 'request_id': 'req-1781ed61-5e2f-4ebf-94be-2d576ba978a7'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:08.468040 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-1781ed61-5e2f-4ebf-94be-2d576ba978a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7b4c0f21f3b4dc69e11c6f8f97cca7d', 'request_id': 'req-1781ed61-5e2f-4ebf-94be-2d576ba978a7'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:08.482036 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-1781ed61-5e2f-4ebf-94be-2d576ba978a7 admin admin] The token cache is being invalidate because project d7b4c0f21f3b4dc69e11c6f8f97cca7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:49:08.482331 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-1781ed61-5e2f-4ebf-94be-2d576ba978a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:08.483013 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-1781ed61-5e2f-4ebf-94be-2d576ba978a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:08.487903 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 971/1952] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:49:07 2022] DELETE /identity/v3/projects/d7b4c0f21f3b4dc69e11c6f8f97cca7d => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:49:08.490234 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad8f10-f7f0-4e12-83a3-5eee5b1d490a None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:08.491247 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad8f10-f7f0-4e12-83a3-5eee5b1d490a None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:08.491954 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad8f10-f7f0-4e12-83a3-5eee5b1d490a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:08.514283 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-03ad8f10-f7f0-4e12-83a3-5eee5b1d490a None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:08.515901 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-03ad8f10-f7f0-4e12-83a3-5eee5b1d490a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:08.585003 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 982/1953] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:49:08.593616 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ae496-8a81-4eef-83b6-05438296f9a2 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:08.593976 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ae496-8a81-4eef-83b6-05438296f9a2 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:08.594356 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ae496-8a81-4eef-83b6-05438296f9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:08.615094 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-9b5ae496-8a81-4eef-83b6-05438296f9a2 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:08.622311 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-9b5ae496-8a81-4eef-83b6-05438296f9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:08.627481 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 972/1954] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:49:08.631571 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad8f10-f7f0-4e12-83a3-5eee5b1d490a None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:08.651329 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad8f10-f7f0-4e12-83a3-5eee5b1d490a None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:08.651329 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366ab18-3930-449e-8aab-713edc86f27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:08.651329 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366ab18-3930-449e-8aab-713edc86f27e admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:08.651329 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366ab18-3930-449e-8aab-713edc86f27e admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:08.651714 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366ab18-3930-449e-8aab-713edc86f27e admin admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:08.651714 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4366ab18-3930-449e-8aab-713edc86f27e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:49:08.651714 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4366ab18-3930-449e-8aab-713edc86f27e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:08.653646 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4366ab18-3930-449e-8aab-713edc86f27e admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:08.666922 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 983/1955] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:49:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:49:08.671539 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ae496-8a81-4eef-83b6-05438296f9a2 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:08.682659 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ae496-8a81-4eef-83b6-05438296f9a2 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:08.689056 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277c488-79c1-4fae-850a-8b5093ae4444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:08.689769 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277c488-79c1-4fae-850a-8b5093ae4444 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:08.690121 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277c488-79c1-4fae-850a-8b5093ae4444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:08.690469 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277c488-79c1-4fae-850a-8b5093ae4444 admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:08.691179 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277c488-79c1-4fae-850a-8b5093ae4444 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:08.693171 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277c488-79c1-4fae-850a-8b5093ae4444 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:08.859367 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 973/1956] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:49:08 2022] POST /identity/v3/projects => generated 387 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:49:08.868868 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366ab18-3930-449e-8aab-713edc86f27e admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:08.880462 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366ab18-3930-449e-8aab-713edc86f27e admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:08.948653 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11928337-3809-4e8a-9a08-0d0fa27283f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:08.949281 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11928337-3809-4e8a-9a08-0d0fa27283f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:08.949568 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11928337-3809-4e8a-9a08-0d0fa27283f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:08.949910 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11928337-3809-4e8a-9a08-0d0fa27283f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:08.950510 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11928337-3809-4e8a-9a08-0d0fa27283f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:08.952579 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11928337-3809-4e8a-9a08-0d0fa27283f0 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:09.043170 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a52e1e-0017-41bc-9c19-5977dced4be5 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:09.043610 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a52e1e-0017-41bc-9c19-5977dced4be5 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:09.043610 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a52e1e-0017-41bc-9c19-5977dced4be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:09.052744 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 984/1957] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:49:08 2022] POST /identity/v3/users => generated 294 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:49:09.057449 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11928337-3809-4e8a-9a08-0d0fa27283f0 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:09.067269 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-a2a52e1e-0017-41bc-9c19-5977dced4be5 None None] MFA Rules not processed for user `6036c9d5cf264f8995735430e1bbb448`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:09.068603 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-a2a52e1e-0017-41bc-9c19-5977dced4be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:09.075163 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11928337-3809-4e8a-9a08-0d0fa27283f0 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:09.081354 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89722cc8-d65d-49e5-940b-99be5c5cfd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:09.082506 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89722cc8-d65d-49e5-940b-99be5c5cfd91 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:09.083196 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89722cc8-d65d-49e5-940b-99be5c5cfd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:09.083654 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89722cc8-d65d-49e5-940b-99be5c5cfd91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:09.084562 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89722cc8-d65d-49e5-940b-99be5c5cfd91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:09.086563 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89722cc8-d65d-49e5-940b-99be5c5cfd91 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:09.108388 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 985/1958] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:49:09.112703 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89722cc8-d65d-49e5-940b-99be5c5cfd91 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:09.125522 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89722cc8-d65d-49e5-940b-99be5c5cfd91 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:09.131328 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f948d61-7549-4fee-9fb8-e6db0a3e2783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:09.132837 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f948d61-7549-4fee-9fb8-e6db0a3e2783 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:09.134011 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f948d61-7549-4fee-9fb8-e6db0a3e2783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:09.134770 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f948d61-7549-4fee-9fb8-e6db0a3e2783 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:09.135272 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f948d61-7549-4fee-9fb8-e6db0a3e2783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:09.138411 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f948d61-7549-4fee-9fb8-e6db0a3e2783 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:09.158798 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 986/1959] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:49:09.163474 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 974/1960] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:49:09.163600 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f948d61-7549-4fee-9fb8-e6db0a3e2783 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:09.174268 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f948d61-7549-4fee-9fb8-e6db0a3e2783 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:09.180513 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd378af-1520-4ca8-a9a7-9aca41452838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:09.181212 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd378af-1520-4ca8-a9a7-9aca41452838 admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:09.181564 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd378af-1520-4ca8-a9a7-9aca41452838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:09.181912 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd378af-1520-4ca8-a9a7-9aca41452838 admin admin] PATH_INFO: `/v3/projects/8378f64f3cb74de4b8457ac53e9851a6/users/cd141386c9d748649b72ee165424c778/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:09.210207 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:09.231495 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd378af-1520-4ca8-a9a7-9aca41452838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8378f64f3cb74de4b8457ac53e9851a6, user_id=cd141386c9d748649b72ee165424c778, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:09.235190 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd378af-1520-4ca8-a9a7-9aca41452838 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:09.344801 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 987/1961] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:49:09 2022] PUT /identity/v3/projects/8378f64f3cb74de4b8457ac53e9851a6/users/cd141386c9d748649b72ee165424c778/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:49:09.355466 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fce021-db79-485f-9599-fca688c7f5fd None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:09.355915 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fce021-db79-485f-9599-fca688c7f5fd None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:09.356031 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fce021-db79-485f-9599-fca688c7f5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:09.409999 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-70fce021-db79-485f-9599-fca688c7f5fd None None] MFA Rules not processed for user `cd141386c9d748649b72ee165424c778`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:09.411849 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-70fce021-db79-485f-9599-fca688c7f5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:09.477912 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:09.538371 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 975/1962] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:49:09.543527 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd378af-1520-4ca8-a9a7-9aca41452838 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:09.637913 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd378af-1520-4ca8-a9a7-9aca41452838 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:09.644026 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8963323-5eff-4a77-a245-918a422f5d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:09.644667 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8963323-5eff-4a77-a245-918a422f5d4e admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:09.644948 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8963323-5eff-4a77-a245-918a422f5d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:09.645222 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8963323-5eff-4a77-a245-918a422f5d4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:09.645895 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8963323-5eff-4a77-a245-918a422f5d4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:09.648499 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8963323-5eff-4a77-a245-918a422f5d4e admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:09.771892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fce021-db79-485f-9599-fca688c7f5fd None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:09.773555 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 988/1963] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:49:09 2022] POST /identity/v3/projects => generated 389 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:49:09.783954 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fce021-db79-485f-9599-fca688c7f5fd None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:09.875343 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70ae4d-042c-4c21-b4cb-093098b13653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:09.876289 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70ae4d-042c-4c21-b4cb-093098b13653 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:09.876903 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70ae4d-042c-4c21-b4cb-093098b13653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:09.877184 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70ae4d-042c-4c21-b4cb-093098b13653 admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:09.878132 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da70ae4d-042c-4c21-b4cb-093098b13653 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:09.880355 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da70ae4d-042c-4c21-b4cb-093098b13653 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:09.979239 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 976/1964] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:49:09 2022] POST /identity/v3/users => generated 301 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:49:09.979429 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8963323-5eff-4a77-a245-918a422f5d4e admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:09.997576 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8963323-5eff-4a77-a245-918a422f5d4e admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:10.003115 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ddf116-a31b-4474-b0c6-b87930fc1e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:10.003797 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ddf116-a31b-4474-b0c6-b87930fc1e32 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:10.004018 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ddf116-a31b-4474-b0c6-b87930fc1e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:10.004319 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ddf116-a31b-4474-b0c6-b87930fc1e32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:10.005173 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ddf116-a31b-4474-b0c6-b87930fc1e32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:10.006681 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ddf116-a31b-4474-b0c6-b87930fc1e32 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:10.021889 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 989/1965] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:49:10.026463 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70ae4d-042c-4c21-b4cb-093098b13653 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:10.039871 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70ae4d-042c-4c21-b4cb-093098b13653 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:10.046864 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcdd5cb-ec1d-4815-b878-19f3030ca024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:10.047725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdd5cb-ec1d-4815-b878-19f3030ca024 admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:10.056694 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdd5cb-ec1d-4815-b878-19f3030ca024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:10.056694 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdd5cb-ec1d-4815-b878-19f3030ca024 admin admin] PATH_INFO: `/v3/projects/6a32b075d0ec4bec990bbeb2ea2b15cf/users/ad54c6fc573e4c71936e101e99250957/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:10.094015 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcdd5cb-ec1d-4815-b878-19f3030ca024 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a32b075d0ec4bec990bbeb2ea2b15cf, user_id=ad54c6fc573e4c71936e101e99250957, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:10.098624 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcdd5cb-ec1d-4815-b878-19f3030ca024 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:10.200363 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 977/1966] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:49:10 2022] PUT /identity/v3/projects/6a32b075d0ec4bec990bbeb2ea2b15cf/users/ad54c6fc573e4c71936e101e99250957/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:49:10.204390 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ddf116-a31b-4474-b0c6-b87930fc1e32 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:10.216003 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ddf116-a31b-4474-b0c6-b87930fc1e32 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:10.277880 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69452ba4-535a-49fb-bb9d-243542b21908 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:10.283093 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69452ba4-535a-49fb-bb9d-243542b21908 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:10.283620 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69452ba4-535a-49fb-bb9d-243542b21908 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:10.286318 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 978/1967] 10.222.0.42 () {54 vars in 921 bytes} [Fri Aug 5 02:49:10 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:49:10.337974 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60300abc-9d55-48bf-a0e5-474104cdd7a8 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:10.338458 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60300abc-9d55-48bf-a0e5-474104cdd7a8 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:10.338736 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ee723-8d70-4394-ab02-41c157355956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:10.339525 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ee723-8d70-4394-ab02-41c157355956 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:10.339721 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ee723-8d70-4394-ab02-41c157355956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:10.340007 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ee723-8d70-4394-ab02-41c157355956 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:10.340182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60300abc-9d55-48bf-a0e5-474104cdd7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:10.341115 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ee723-8d70-4394-ab02-41c157355956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:10.343953 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ee723-8d70-4394-ab02-41c157355956 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:10.367433 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 990/1968] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:49:10 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:49:10.373949 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ee723-8d70-4394-ab02-41c157355956 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:10.375504 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-60300abc-9d55-48bf-a0e5-474104cdd7a8 None None] MFA Rules not processed for user `8b647f2cb18a41d6a9e124e886faa994`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:10.380123 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-60300abc-9d55-48bf-a0e5-474104cdd7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:10.409362 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ee723-8d70-4394-ab02-41c157355956 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:10.414232 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c857816-b25b-496c-b20e-df9e80ee483f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:10.414923 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c857816-b25b-496c-b20e-df9e80ee483f admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:10.415270 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c857816-b25b-496c-b20e-df9e80ee483f admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:10.415554 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c857816-b25b-496c-b20e-df9e80ee483f admin admin] PATH_INFO: `/v3/projects/6a32b075d0ec4bec990bbeb2ea2b15cf/users/ad54c6fc573e4c71936e101e99250957/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:10.424726 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c857816-b25b-496c-b20e-df9e80ee483f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a32b075d0ec4bec990bbeb2ea2b15cf, user_id=ad54c6fc573e4c71936e101e99250957, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:10.427626 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c857816-b25b-496c-b20e-df9e80ee483f admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:10.449461 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 991/1969] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:49:10 2022] PUT /identity/v3/projects/6a32b075d0ec4bec990bbeb2ea2b15cf/users/ad54c6fc573e4c71936e101e99250957/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:49:10.461615 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db111a6e-727e-4f18-ab0c-49dfa3572e9d None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:10.462066 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db111a6e-727e-4f18-ab0c-49dfa3572e9d None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:10.462499 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db111a6e-727e-4f18-ab0c-49dfa3572e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:10.525733 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 979/1970] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Aug 5 02:49:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:49:10.531242 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-db111a6e-727e-4f18-ab0c-49dfa3572e9d None None] MFA Rules not processed for user `ad54c6fc573e4c71936e101e99250957`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:10.532243 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60300abc-9d55-48bf-a0e5-474104cdd7a8 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:10.533465 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-db111a6e-727e-4f18-ab0c-49dfa3572e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:10.535298 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-60300abc-9d55-48bf-a0e5-474104cdd7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:10.576868 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60300abc-9d55-48bf-a0e5-474104cdd7a8 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:10.622009 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:10.662700 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 992/1971] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:10 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:49:10.663659 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db111a6e-727e-4f18-ab0c-49dfa3572e9d None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:10.664997 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-db111a6e-727e-4f18-ab0c-49dfa3572e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:10.670088 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:10.697952 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6857944-15fc-4b76-bb15-5efca2c0ee8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:10.697952 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6857944-15fc-4b76-bb15-5efca2c0ee8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:10.697952 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6857944-15fc-4b76-bb15-5efca2c0ee8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:10.697952 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6857944-15fc-4b76-bb15-5efca2c0ee8f admin admin] PATH_INFO: `/v3/users/ae630508f5284c8296ba67519c59d8b7` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:10.715435 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6857944-15fc-4b76-bb15-5efca2c0ee8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae630508f5284c8296ba67519c59d8b7)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:10.723770 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6857944-15fc-4b76-bb15-5efca2c0ee8f admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:10.790091 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db111a6e-727e-4f18-ab0c-49dfa3572e9d None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:10.796514 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad44f4bd-ea10-4033-8e07-b22c240eb253 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647f2cb18a41d6a9e124e886faa994', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:10.797301 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44f4bd-ea10-4033-8e07-b22c240eb253 service placement] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:10.798833 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44f4bd-ea10-4033-8e07-b22c240eb253 service placement] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:10.799244 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44f4bd-ea10-4033-8e07-b22c240eb253 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:10.809358 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad44f4bd-ea10-4033-8e07-b22c240eb253 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:10.812279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad44f4bd-ea10-4033-8e07-b22c240eb253 service placement] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:10.824362 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 993/1972] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:49:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:49:10.825524 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad44f4bd-ea10-4033-8e07-b22c240eb253 service placement] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:10.828569 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-ad44f4bd-ea10-4033-8e07-b22c240eb253 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:10.917921 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad44f4bd-ea10-4033-8e07-b22c240eb253 service placement] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:10.921925 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22318243-c4a9-41fc-ac57-5dd4b34136a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:10.922626 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22318243-c4a9-41fc-ac57-5dd4b34136a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:10.923033 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22318243-c4a9-41fc-ac57-5dd4b34136a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:10.923381 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22318243-c4a9-41fc-ac57-5dd4b34136a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:10.933287 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22318243-c4a9-41fc-ac57-5dd4b34136a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:10.934836 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22318243-c4a9-41fc-ac57-5dd4b34136a1 service cinder] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:10.946978 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 994/1973] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:49:10 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:49:11.046727 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-c6857944-15fc-4b76-bb15-5efca2c0ee8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae630508f5284c8296ba67519c59d8b7'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:11.125307 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22318243-c4a9-41fc-ac57-5dd4b34136a1 service cinder] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:11.133967 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-c6857944-15fc-4b76-bb15-5efca2c0ee8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae630508f5284c8296ba67519c59d8b7'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:11.137170 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22318243-c4a9-41fc-ac57-5dd4b34136a1 service cinder] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:11.144191 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df362b-820f-4b89-889f-2b427f9b633b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:11.145599 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-c6857944-15fc-4b76-bb15-5efca2c0ee8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae630508f5284c8296ba67519c59d8b7'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:11.145711 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df362b-820f-4b89-889f-2b427f9b633b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:11.145711 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df362b-820f-4b89-889f-2b427f9b633b admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:11.146763 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-c6857944-15fc-4b76-bb15-5efca2c0ee8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae630508f5284c8296ba67519c59d8b7'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:11.147995 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df362b-820f-4b89-889f-2b427f9b633b admin admin] PATH_INFO: `/v3/users/cd141386c9d748649b72ee165424c778` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:11.149546 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df362b-820f-4b89-889f-2b427f9b633b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd141386c9d748649b72ee165424c778)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:11.153067 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df362b-820f-4b89-889f-2b427f9b633b admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:11.162104 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-c6857944-15fc-4b76-bb15-5efca2c0ee8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae630508f5284c8296ba67519c59d8b7'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:11.172511 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 980/1974] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:49:10 2022] DELETE /identity/v3/users/ae630508f5284c8296ba67519c59d8b7 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:49:11.332162 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-08df362b-820f-4b89-889f-2b427f9b633b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd141386c9d748649b72ee165424c778'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:11.404290 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-08df362b-820f-4b89-889f-2b427f9b633b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd141386c9d748649b72ee165424c778'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:11.410638 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:11.417046 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-08df362b-820f-4b89-889f-2b427f9b633b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd141386c9d748649b72ee165424c778'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:11.441536 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-08df362b-820f-4b89-889f-2b427f9b633b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd141386c9d748649b72ee165424c778'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:11.442315 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-08df362b-820f-4b89-889f-2b427f9b633b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd141386c9d748649b72ee165424c778'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:11.454838 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 995/1975] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:49:11 2022] DELETE /identity/v3/users/cd141386c9d748649b72ee165424c778 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:49:11.459541 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5412ce-abf3-441c-b5b6-937fa03da15f None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:11.460125 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5412ce-abf3-441c-b5b6-937fa03da15f None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:11.460633 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5412ce-abf3-441c-b5b6-937fa03da15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:11.486586 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-3c5412ce-abf3-441c-b5b6-937fa03da15f None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:11.488205 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-3c5412ce-abf3-441c-b5b6-937fa03da15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:11.542984 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df362b-820f-4b89-889f-2b427f9b633b admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:11.544881 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-08df362b-820f-4b89-889f-2b427f9b633b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:11.607160 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 981/1976] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:49:11.615216 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5412ce-abf3-441c-b5b6-937fa03da15f None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:11.616602 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-3c5412ce-abf3-441c-b5b6-937fa03da15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:11.664345 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df362b-820f-4b89-889f-2b427f9b633b admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:11.672321 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4427abb-4f09-4341-b023-4ce3bea570ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:11.673111 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4427abb-4f09-4341-b023-4ce3bea570ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:11.673432 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4427abb-4f09-4341-b023-4ce3bea570ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:11.673724 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4427abb-4f09-4341-b023-4ce3bea570ab admin admin] PATH_INFO: `/v3/projects/f4f05d437a8c41b98fdb006367bb74a3` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:11.675003 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4427abb-4f09-4341-b023-4ce3bea570ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4f05d437a8c41b98fdb006367bb74a3)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:11.677156 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4427abb-4f09-4341-b023-4ce3bea570ab admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:11.722982 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5412ce-abf3-441c-b5b6-937fa03da15f None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:11.733722 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2520e4-34ad-4f39-987c-d4488439cf3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:11.733722 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2520e4-34ad-4f39-987c-d4488439cf3f service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:11.733722 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2520e4-34ad-4f39-987c-d4488439cf3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:11.733722 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2520e4-34ad-4f39-987c-d4488439cf3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:11.741271 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2520e4-34ad-4f39-987c-d4488439cf3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:11.742818 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2520e4-34ad-4f39-987c-d4488439cf3f service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:11.754360 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 982/1977] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:49:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:49:11.756425 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39cb16-9af9-4553-a07e-e2eac6337f48 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:11.756725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39cb16-9af9-4553-a07e-e2eac6337f48 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:11.757003 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39cb16-9af9-4553-a07e-e2eac6337f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:11.788066 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:11.804762 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-5c39cb16-9af9-4553-a07e-e2eac6337f48 None None] MFA Rules not processed for user `8899e781da8d4d05af2ce5a120874d08`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:11.806317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-5c39cb16-9af9-4553-a07e-e2eac6337f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:11.823425 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-d4427abb-4f09-4341-b023-4ce3bea570ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4f05d437a8c41b98fdb006367bb74a3', 'request_id': 'req-d4427abb-4f09-4341-b023-4ce3bea570ab'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:11.884795 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 983/1978] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:49:11.890123 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39cb16-9af9-4553-a07e-e2eac6337f48 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:11.891467 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-5c39cb16-9af9-4553-a07e-e2eac6337f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:11.935102 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-d4427abb-4f09-4341-b023-4ce3bea570ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4f05d437a8c41b98fdb006367bb74a3', 'request_id': 'req-d4427abb-4f09-4341-b023-4ce3bea570ab'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:11.944575 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-d4427abb-4f09-4341-b023-4ce3bea570ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4f05d437a8c41b98fdb006367bb74a3', 'request_id': 'req-d4427abb-4f09-4341-b023-4ce3bea570ab'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:11.958884 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-d4427abb-4f09-4341-b023-4ce3bea570ab admin admin] The token cache is being invalidate because project f4f05d437a8c41b98fdb006367bb74a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:49:11.959643 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-d4427abb-4f09-4341-b023-4ce3bea570ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:11.960459 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-d4427abb-4f09-4341-b023-4ce3bea570ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:11.962392 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 996/1979] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:49:11 2022] DELETE /identity/v3/projects/f4f05d437a8c41b98fdb006367bb74a3 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:49:11.970258 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806fa752-5303-4978-8a9a-2e0d5ccbf1f0 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:11.970748 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806fa752-5303-4978-8a9a-2e0d5ccbf1f0 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:11.971384 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806fa752-5303-4978-8a9a-2e0d5ccbf1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:11.997308 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39cb16-9af9-4553-a07e-e2eac6337f48 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:12.002202 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae300d34-a192-4ef4-92bb-39e8bb2c2ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:12.002992 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae300d34-a192-4ef4-92bb-39e8bb2c2ec1 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:12.003386 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae300d34-a192-4ef4-92bb-39e8bb2c2ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:12.003781 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae300d34-a192-4ef4-92bb-39e8bb2c2ec1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:12.004907 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae300d34-a192-4ef4-92bb-39e8bb2c2ec1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:12.009433 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae300d34-a192-4ef4-92bb-39e8bb2c2ec1 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:12.016964 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-806fa752-5303-4978-8a9a-2e0d5ccbf1f0 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:12.018378 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-806fa752-5303-4978-8a9a-2e0d5ccbf1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:12.032008 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 997/1980] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:49:12.040392 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8998f-c2cc-42ea-a1b8-3608fcb2672e None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:12.040784 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8998f-c2cc-42ea-a1b8-3608fcb2672e None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:12.041126 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8998f-c2cc-42ea-a1b8-3608fcb2672e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:12.069402 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-e8a8998f-c2cc-42ea-a1b8-3608fcb2672e None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:12.070677 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-e8a8998f-c2cc-42ea-a1b8-3608fcb2672e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:12.080906 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 998/1981] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:49:12.085372 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a8998f-c2cc-42ea-a1b8-3608fcb2672e None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:12.115795 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a8998f-c2cc-42ea-a1b8-3608fcb2672e None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:12.115795 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e1f91-4203-4d61-a120-044ff4c17717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:12.115956 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e1f91-4203-4d61-a120-044ff4c17717 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:12.116112 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e1f91-4203-4d61-a120-044ff4c17717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:12.116405 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e1f91-4203-4d61-a120-044ff4c17717 admin admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:12.117150 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e1f91-4203-4d61-a120-044ff4c17717 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:49:12.117460 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e1f91-4203-4d61-a120-044ff4c17717 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:12.119165 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e1f91-4203-4d61-a120-044ff4c17717 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:12.137180 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 999/1982] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:49:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:49:12.147327 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 984/1983] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:49:11 2022] POST /identity/v3/projects => generated 383 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:49:12.147961 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e1f91-4203-4d61-a120-044ff4c17717 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:12.148204 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae300d34-a192-4ef4-92bb-39e8bb2c2ec1 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:12.149973 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-ae300d34-a192-4ef4-92bb-39e8bb2c2ec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:12.187146 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e1f91-4203-4d61-a120-044ff4c17717 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:12.241433 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:12.270416 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7d5d0-c98d-4ef8-ba53-8df34a4f3b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:12.271071 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7d5d0-c98d-4ef8-ba53-8df34a4f3b01 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:12.271358 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7d5d0-c98d-4ef8-ba53-8df34a4f3b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:12.271682 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7d5d0-c98d-4ef8-ba53-8df34a4f3b01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:12.272363 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a7d5d0-c98d-4ef8-ba53-8df34a4f3b01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:12.274823 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a7d5d0-c98d-4ef8-ba53-8df34a4f3b01 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:12.323951 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae300d34-a192-4ef4-92bb-39e8bb2c2ec1 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:12.330690 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b5c91-43e3-4923-a66e-c68182a1e93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:12.331422 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b5c91-43e3-4923-a66e-c68182a1e93b admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:12.331705 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b5c91-43e3-4923-a66e-c68182a1e93b admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:12.331981 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b5c91-43e3-4923-a66e-c68182a1e93b admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:12.332891 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b5c91-43e3-4923-a66e-c68182a1e93b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:12.335102 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b5c91-43e3-4923-a66e-c68182a1e93b admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:12.359238 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1000/1984] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:49:12 2022] POST /identity/v3/projects => generated 367 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:49:12.360471 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7d5d0-c98d-4ef8-ba53-8df34a4f3b01 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:12.362385 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-53a7d5d0-c98d-4ef8-ba53-8df34a4f3b01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:12.438602 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 985/1985] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:49:12 2022] POST /identity/v3/users => generated 298 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:49:12.439552 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b5c91-43e3-4923-a66e-c68182a1e93b admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:12.450452 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7d5d0-c98d-4ef8-ba53-8df34a4f3b01 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:12.455520 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b5c91-43e3-4923-a66e-c68182a1e93b admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:12.456599 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eed8c0-34f2-497f-b300-7d9e616a98f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:12.457453 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eed8c0-34f2-497f-b300-7d9e616a98f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:12.457866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eed8c0-34f2-497f-b300-7d9e616a98f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:12.458316 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eed8c0-34f2-497f-b300-7d9e616a98f7 admin admin] PATH_INFO: `/v3/projects/8378f64f3cb74de4b8457ac53e9851a6` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:12.459539 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eed8c0-34f2-497f-b300-7d9e616a98f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8378f64f3cb74de4b8457ac53e9851a6)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:12.461981 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eed8c0-34f2-497f-b300-7d9e616a98f7 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:12.463826 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76abe804-8279-4d0e-b7d5-9e4eebe4da91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:12.464690 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abe804-8279-4d0e-b7d5-9e4eebe4da91 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:12.465571 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abe804-8279-4d0e-b7d5-9e4eebe4da91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:12.469807 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abe804-8279-4d0e-b7d5-9e4eebe4da91 admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:12.469807 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76abe804-8279-4d0e-b7d5-9e4eebe4da91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:12.471335 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76abe804-8279-4d0e-b7d5-9e4eebe4da91 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:12.546821 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:12.553461 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 986/1986] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:49:12 2022] POST /identity/v3/users => generated 284 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:49:12.554222 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76abe804-8279-4d0e-b7d5-9e4eebe4da91 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:12.564166 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76abe804-8279-4d0e-b7d5-9e4eebe4da91 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:12.569116 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a581506-62b0-4858-99ca-bd9fb19f3829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:12.569719 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a581506-62b0-4858-99ca-bd9fb19f3829 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:12.570002 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a581506-62b0-4858-99ca-bd9fb19f3829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:12.570275 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a581506-62b0-4858-99ca-bd9fb19f3829 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:12.570976 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a581506-62b0-4858-99ca-bd9fb19f3829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:12.573598 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a581506-62b0-4858-99ca-bd9fb19f3829 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:12.587949 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-73eed8c0-34f2-497f-b300-7d9e616a98f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8378f64f3cb74de4b8457ac53e9851a6', 'request_id': 'req-73eed8c0-34f2-497f-b300-7d9e616a98f7'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:12.588117 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 987/1987] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:49:12.588569 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a581506-62b0-4858-99ca-bd9fb19f3829 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:12.600397 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a581506-62b0-4858-99ca-bd9fb19f3829 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:12.649096 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-73eed8c0-34f2-497f-b300-7d9e616a98f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8378f64f3cb74de4b8457ac53e9851a6', 'request_id': 'req-73eed8c0-34f2-497f-b300-7d9e616a98f7'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:12.656473 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-73eed8c0-34f2-497f-b300-7d9e616a98f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8378f64f3cb74de4b8457ac53e9851a6', 'request_id': 'req-73eed8c0-34f2-497f-b300-7d9e616a98f7'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:12.669832 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-73eed8c0-34f2-497f-b300-7d9e616a98f7 admin admin] The token cache is being invalidate because project 8378f64f3cb74de4b8457ac53e9851a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:49:12.670482 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-73eed8c0-34f2-497f-b300-7d9e616a98f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:12.670987 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-73eed8c0-34f2-497f-b300-7d9e616a98f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:12.672874 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1001/1988] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:49:12 2022] DELETE /identity/v3/projects/8378f64f3cb74de4b8457ac53e9851a6 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:49:12.672999 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d430f-71d7-422e-a417-de9cf99c6f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:12.673445 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d430f-71d7-422e-a417-de9cf99c6f9b admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:12.673727 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d430f-71d7-422e-a417-de9cf99c6f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:12.674001 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d430f-71d7-422e-a417-de9cf99c6f9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:12.674865 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d430f-71d7-422e-a417-de9cf99c6f9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:12.676642 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eed8c0-34f2-497f-b300-7d9e616a98f7 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:12.676821 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d430f-71d7-422e-a417-de9cf99c6f9b admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:12.678191 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-73eed8c0-34f2-497f-b300-7d9e616a98f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:12.687946 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 988/1989] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:49:12.688817 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d430f-71d7-422e-a417-de9cf99c6f9b admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:12.690570 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-3b7d430f-71d7-422e-a417-de9cf99c6f9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:12.692175 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eed8c0-34f2-497f-b300-7d9e616a98f7 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:12.697283 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d92b0b-a523-46bf-b11c-da9f9bf80298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:12.698025 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d92b0b-a523-46bf-b11c-da9f9bf80298 admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:12.698554 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d92b0b-a523-46bf-b11c-da9f9bf80298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:12.699070 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d92b0b-a523-46bf-b11c-da9f9bf80298 admin admin] PATH_INFO: `/v3/projects/93f154b99ccb4045986f2ad81892e122/users/5546cb42464b4a9085e54eaca89586b7/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:12.704980 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d430f-71d7-422e-a417-de9cf99c6f9b admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:12.711905 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9ed24-6ba3-49d9-9c7d-ed6e8807c5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:12.712831 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9ed24-6ba3-49d9-9c7d-ed6e8807c5ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:12.713377 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9ed24-6ba3-49d9-9c7d-ed6e8807c5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:12.713757 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9ed24-6ba3-49d9-9c7d-ed6e8807c5ee admin admin] PATH_INFO: `/v3/users/ad54c6fc573e4c71936e101e99250957` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:12.715227 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a9ed24-6ba3-49d9-9c7d-ed6e8807c5ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad54c6fc573e4c71936e101e99250957)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:12.716241 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d92b0b-a523-46bf-b11c-da9f9bf80298 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93f154b99ccb4045986f2ad81892e122, user_id=5546cb42464b4a9085e54eaca89586b7, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:12.717869 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a9ed24-6ba3-49d9-9c7d-ed6e8807c5ee admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:12.719701 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d92b0b-a523-46bf-b11c-da9f9bf80298 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:12.826839 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1002/1990] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:49:12 2022] PUT /identity/v3/projects/93f154b99ccb4045986f2ad81892e122/users/5546cb42464b4a9085e54eaca89586b7/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:49:12.828265 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d92b0b-a523-46bf-b11c-da9f9bf80298 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:12.829988 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-d8d92b0b-a523-46bf-b11c-da9f9bf80298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:12.869694 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:12.901870 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d92b0b-a523-46bf-b11c-da9f9bf80298 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:12.907214 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e8770-6ff8-44df-a44a-92bdc2e2f1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:12.907845 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e8770-6ff8-44df-a44a-92bdc2e2f1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:12.908128 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e8770-6ff8-44df-a44a-92bdc2e2f1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:12.908407 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e8770-6ff8-44df-a44a-92bdc2e2f1f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:12.909109 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091e8770-6ff8-44df-a44a-92bdc2e2f1f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:12.910718 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091e8770-6ff8-44df-a44a-92bdc2e2f1f5 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:12.921340 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1003/1991] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:49:12.921786 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-f3a9ed24-6ba3-49d9-9c7d-ed6e8807c5ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad54c6fc573e4c71936e101e99250957'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:12.922367 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e8770-6ff8-44df-a44a-92bdc2e2f1f5 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:12.933839 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e8770-6ff8-44df-a44a-92bdc2e2f1f5 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:12.938506 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251cc797-1aa4-4d42-b888-c792ce43553a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:12.939138 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251cc797-1aa4-4d42-b888-c792ce43553a admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:12.939426 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251cc797-1aa4-4d42-b888-c792ce43553a admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:12.944839 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251cc797-1aa4-4d42-b888-c792ce43553a admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:12.944839 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251cc797-1aa4-4d42-b888-c792ce43553a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:12.944839 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251cc797-1aa4-4d42-b888-c792ce43553a admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:12.952079 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1004/1992] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:49:12.952822 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251cc797-1aa4-4d42-b888-c792ce43553a admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:12.961931 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251cc797-1aa4-4d42-b888-c792ce43553a admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:12.967232 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f933a-9e29-4fca-849a-bcce4586c2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:12.967879 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f933a-9e29-4fca-849a-bcce4586c2d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:12.968197 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f933a-9e29-4fca-849a-bcce4586c2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:12.968479 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f933a-9e29-4fca-849a-bcce4586c2d6 admin admin] PATH_INFO: `/v3/projects/e23b260ffe4b4691b83f291680fe827f/users/0852ab145c8b422db40b94f7dd390ad5/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:12.982706 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f933a-9e29-4fca-849a-bcce4586c2d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e23b260ffe4b4691b83f291680fe827f, user_id=0852ab145c8b422db40b94f7dd390ad5, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:12.985369 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f933a-9e29-4fca-849a-bcce4586c2d6 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:13.037419 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-f3a9ed24-6ba3-49d9-9c7d-ed6e8807c5ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad54c6fc573e4c71936e101e99250957'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:13.045165 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-f3a9ed24-6ba3-49d9-9c7d-ed6e8807c5ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad54c6fc573e4c71936e101e99250957'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:13.045871 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-f3a9ed24-6ba3-49d9-9c7d-ed6e8807c5ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad54c6fc573e4c71936e101e99250957'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:13.058277 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-f3a9ed24-6ba3-49d9-9c7d-ed6e8807c5ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad54c6fc573e4c71936e101e99250957'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:13.065138 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 989/1993] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:49:12 2022] DELETE /identity/v3/users/ad54c6fc573e4c71936e101e99250957 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:49:13.065914 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9ed24-6ba3-49d9-9c7d-ed6e8807c5ee admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:13.067259 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-f3a9ed24-6ba3-49d9-9c7d-ed6e8807c5ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:13.088249 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1005/1994] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:49:12 2022] PUT /identity/v3/projects/e23b260ffe4b4691b83f291680fe827f/users/0852ab145c8b422db40b94f7dd390ad5/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:49:13.101870 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e03ea-5028-42b0-980a-f1ad326446a3 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:13.102772 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e03ea-5028-42b0-980a-f1ad326446a3 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:13.104006 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e03ea-5028-42b0-980a-f1ad326446a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:13.147346 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:13.149302 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-557e03ea-5028-42b0-980a-f1ad326446a3 None None] MFA Rules not processed for user `0852ab145c8b422db40b94f7dd390ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:13.154126 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-557e03ea-5028-42b0-980a-f1ad326446a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:13.154293 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9ed24-6ba3-49d9-9c7d-ed6e8807c5ee admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:13.218608 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6036e17-c31e-439c-8af7-d2ce75ba8050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:13.219337 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6036e17-c31e-439c-8af7-d2ce75ba8050 admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:13.219622 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6036e17-c31e-439c-8af7-d2ce75ba8050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:13.219915 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6036e17-c31e-439c-8af7-d2ce75ba8050 admin admin] PATH_INFO: `/v3/projects/93f154b99ccb4045986f2ad81892e122/users/5546cb42464b4a9085e54eaca89586b7/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:13.221980 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6036e17-c31e-439c-8af7-d2ce75ba8050 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93f154b99ccb4045986f2ad81892e122, user_id=5546cb42464b4a9085e54eaca89586b7, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:13.224845 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6036e17-c31e-439c-8af7-d2ce75ba8050 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:13.241139 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 990/1995] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:49:13 2022] PUT /identity/v3/projects/93f154b99ccb4045986f2ad81892e122/users/5546cb42464b4a9085e54eaca89586b7/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:49:13.245984 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1006/1996] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:49:13.258582 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6036e17-c31e-439c-8af7-d2ce75ba8050 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:13.264410 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-a6036e17-c31e-439c-8af7-d2ce75ba8050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:13.347169 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6036e17-c31e-439c-8af7-d2ce75ba8050 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:13.351036 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a6c01-f784-4d41-abe4-d56585fcbed5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:13.351668 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a6c01-f784-4d41-abe4-d56585fcbed5 service cinder] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:13.352255 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a6c01-f784-4d41-abe4-d56585fcbed5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:13.352255 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a6c01-f784-4d41-abe4-d56585fcbed5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:13.456793 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a6c01-f784-4d41-abe4-d56585fcbed5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:13.458806 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a6c01-f784-4d41-abe4-d56585fcbed5 service cinder] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:13.490764 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 991/1997] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:49:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:49:13.575809 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e03ea-5028-42b0-980a-f1ad326446a3 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:13.577276 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-557e03ea-5028-42b0-980a-f1ad326446a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:13.604625 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e03ea-5028-42b0-980a-f1ad326446a3 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:13.695713 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726320d3-2bf6-48ad-a99a-95b52437e4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:13.697925 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726320d3-2bf6-48ad-a99a-95b52437e4bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:13.698371 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726320d3-2bf6-48ad-a99a-95b52437e4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:13.698796 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726320d3-2bf6-48ad-a99a-95b52437e4bd admin admin] PATH_INFO: `/v3/projects/6a32b075d0ec4bec990bbeb2ea2b15cf` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:13.700789 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726320d3-2bf6-48ad-a99a-95b52437e4bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a32b075d0ec4bec990bbeb2ea2b15cf)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:13.707172 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726320d3-2bf6-48ad-a99a-95b52437e4bd admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:13.768372 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:13.901931 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-726320d3-2bf6-48ad-a99a-95b52437e4bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a32b075d0ec4bec990bbeb2ea2b15cf', 'request_id': 'req-726320d3-2bf6-48ad-a99a-95b52437e4bd'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:13.991577 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-726320d3-2bf6-48ad-a99a-95b52437e4bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a32b075d0ec4bec990bbeb2ea2b15cf', 'request_id': 'req-726320d3-2bf6-48ad-a99a-95b52437e4bd'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:13.998374 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-726320d3-2bf6-48ad-a99a-95b52437e4bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a32b075d0ec4bec990bbeb2ea2b15cf', 'request_id': 'req-726320d3-2bf6-48ad-a99a-95b52437e4bd'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:14.009963 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-726320d3-2bf6-48ad-a99a-95b52437e4bd admin admin] The token cache is being invalidate because project 6a32b075d0ec4bec990bbeb2ea2b15cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:49:14.010295 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-726320d3-2bf6-48ad-a99a-95b52437e4bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:14.010924 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-726320d3-2bf6-48ad-a99a-95b52437e4bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:14.012764 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1007/1998] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:49:13 2022] DELETE /identity/v3/projects/6a32b075d0ec4bec990bbeb2ea2b15cf => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:49:14.017473 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73408fdf-6f10-478c-9282-a43ce9554089 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:14.017772 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73408fdf-6f10-478c-9282-a43ce9554089 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:14.018054 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73408fdf-6f10-478c-9282-a43ce9554089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:14.057935 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-73408fdf-6f10-478c-9282-a43ce9554089 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:14.058065 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-73408fdf-6f10-478c-9282-a43ce9554089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:14.120410 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:14.137102 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 992/1999] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:49:14.145526 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9099b7-ad3e-4780-8341-4afc029a70b1 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:14.145939 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9099b7-ad3e-4780-8341-4afc029a70b1 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:14.146288 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9099b7-ad3e-4780-8341-4afc029a70b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:14.171755 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-4f9099b7-ad3e-4780-8341-4afc029a70b1 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:14.173176 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-4f9099b7-ad3e-4780-8341-4afc029a70b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:14.188446 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1008/2000] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:49:14.193469 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73408fdf-6f10-478c-9282-a43ce9554089 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:14.201645 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73408fdf-6f10-478c-9282-a43ce9554089 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:14.208112 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d15192-7593-4161-bdd5-2e249c21f014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:14.209084 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d15192-7593-4161-bdd5-2e249c21f014 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:14.209797 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d15192-7593-4161-bdd5-2e249c21f014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:14.210602 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d15192-7593-4161-bdd5-2e249c21f014 admin admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:14.211688 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d15192-7593-4161-bdd5-2e249c21f014 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:49:14.212749 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d15192-7593-4161-bdd5-2e249c21f014 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:14.214721 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d15192-7593-4161-bdd5-2e249c21f014 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:14.227683 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 993/2001] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:49:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:49:14.232736 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9099b7-ad3e-4780-8341-4afc029a70b1 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:14.242263 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9099b7-ad3e-4780-8341-4afc029a70b1 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:14.247128 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c003a-819e-4e91-be85-057c1f47e270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:14.248404 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c003a-819e-4e91-be85-057c1f47e270 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:14.248680 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c003a-819e-4e91-be85-057c1f47e270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:14.248952 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c003a-819e-4e91-be85-057c1f47e270 admin admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:14.249630 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c003a-819e-4e91-be85-057c1f47e270 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:14.251735 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c003a-819e-4e91-be85-057c1f47e270 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:14.397748 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1009/2002] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:49:14 2022] POST /identity/v3/projects => generated 375 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:49:14.401754 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d15192-7593-4161-bdd5-2e249c21f014 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:14.419121 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d15192-7593-4161-bdd5-2e249c21f014 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:14.533289 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e5e7a-e90b-416d-935b-d22ef8c12950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:14.534319 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e5e7a-e90b-416d-935b-d22ef8c12950 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:14.534497 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e5e7a-e90b-416d-935b-d22ef8c12950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:14.534834 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e5e7a-e90b-416d-935b-d22ef8c12950 admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:14.535551 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e5e7a-e90b-416d-935b-d22ef8c12950 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:14.541133 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e5e7a-e90b-416d-935b-d22ef8c12950 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:14.667145 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 994/2003] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:49:14 2022] POST /identity/v3/users => generated 288 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:49:14.673628 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c003a-819e-4e91-be85-057c1f47e270 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:14.686566 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c003a-819e-4e91-be85-057c1f47e270 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:14.693558 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc324c-b884-41dc-bcb0-c1ac6b2f0d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:14.694211 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc324c-b884-41dc-bcb0-c1ac6b2f0d77 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:14.694496 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc324c-b884-41dc-bcb0-c1ac6b2f0d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:14.694779 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc324c-b884-41dc-bcb0-c1ac6b2f0d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:14.695588 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc324c-b884-41dc-bcb0-c1ac6b2f0d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:14.700116 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc324c-b884-41dc-bcb0-c1ac6b2f0d77 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:14.715912 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1010/2004] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:49:14.720070 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e5e7a-e90b-416d-935b-d22ef8c12950 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:14.737720 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e5e7a-e90b-416d-935b-d22ef8c12950 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:14.753415 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdfe686-bdb2-482a-89aa-3b00c42165c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:14.754153 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdfe686-bdb2-482a-89aa-3b00c42165c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:14.754496 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdfe686-bdb2-482a-89aa-3b00c42165c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:14.754817 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdfe686-bdb2-482a-89aa-3b00c42165c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:14.755744 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdfe686-bdb2-482a-89aa-3b00c42165c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:14.757775 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdfe686-bdb2-482a-89aa-3b00c42165c1 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:14.779736 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 995/2005] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:49:14.784052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc324c-b884-41dc-bcb0-c1ac6b2f0d77 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:14.796755 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc324c-b884-41dc-bcb0-c1ac6b2f0d77 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:14.804958 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae3b96-c32e-43c1-90e5-c5b02ac7bfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:14.804958 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae3b96-c32e-43c1-90e5-c5b02ac7bfcd admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:14.804958 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae3b96-c32e-43c1-90e5-c5b02ac7bfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:14.804958 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae3b96-c32e-43c1-90e5-c5b02ac7bfcd admin admin] PATH_INFO: `/v3/projects/801f0946ec36403fa62149358ecd1787/users/50d83de1c2714d70bc1209999a5fe866/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:14.819926 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dae3b96-c32e-43c1-90e5-c5b02ac7bfcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=801f0946ec36403fa62149358ecd1787, user_id=50d83de1c2714d70bc1209999a5fe866, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:14.822984 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dae3b96-c32e-43c1-90e5-c5b02ac7bfcd admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:14.889679 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1011/2006] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:49:14 2022] PUT /identity/v3/projects/801f0946ec36403fa62149358ecd1787/users/50d83de1c2714d70bc1209999a5fe866/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:49:14.900358 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06ebca-4895-435a-9380-9dd7ee34da40 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:14.900687 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06ebca-4895-435a-9380-9dd7ee34da40 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:14.900945 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06ebca-4895-435a-9380-9dd7ee34da40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:14.951252 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-1f06ebca-4895-435a-9380-9dd7ee34da40 None None] MFA Rules not processed for user `50d83de1c2714d70bc1209999a5fe866`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:14.952758 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-1f06ebca-4895-435a-9380-9dd7ee34da40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:15.051987 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 996/2007] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:49:15.056115 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae3b96-c32e-43c1-90e5-c5b02ac7bfcd admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:15.155339 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae3b96-c32e-43c1-90e5-c5b02ac7bfcd admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:15.160305 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a85e9-26fa-4111-8494-37651e8cbdaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:15.160941 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a85e9-26fa-4111-8494-37651e8cbdaf admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:15.161326 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a85e9-26fa-4111-8494-37651e8cbdaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:15.161525 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a85e9-26fa-4111-8494-37651e8cbdaf admin admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:15.162206 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a85e9-26fa-4111-8494-37651e8cbdaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:15.164190 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a85e9-26fa-4111-8494-37651e8cbdaf admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:15.304755 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1012/2008] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:49:15 2022] POST /identity/v3/projects => generated 373 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:49:15.309239 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06ebca-4895-435a-9380-9dd7ee34da40 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:15.345975 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06ebca-4895-435a-9380-9dd7ee34da40 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:15.406428 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:15.424314 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc4a65-5a5d-4474-a628-22ad27c327d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:15.425258 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc4a65-5a5d-4474-a628-22ad27c327d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:15.425808 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc4a65-5a5d-4474-a628-22ad27c327d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:15.426265 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc4a65-5a5d-4474-a628-22ad27c327d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:15.427160 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dc4a65-5a5d-4474-a628-22ad27c327d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:15.429188 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dc4a65-5a5d-4474-a628-22ad27c327d4 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:15.516808 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 997/2009] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:49:15 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:49:15.529522 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a85e9-26fa-4111-8494-37651e8cbdaf admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:15.546657 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a85e9-26fa-4111-8494-37651e8cbdaf admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:15.554137 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f5b378-fe7a-4fdc-81ad-5f27db65f404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:15.554840 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5b378-fe7a-4fdc-81ad-5f27db65f404 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:15.555368 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5b378-fe7a-4fdc-81ad-5f27db65f404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:15.559794 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5b378-fe7a-4fdc-81ad-5f27db65f404 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:15.559794 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f5b378-fe7a-4fdc-81ad-5f27db65f404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:15.559794 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f5b378-fe7a-4fdc-81ad-5f27db65f404 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:15.572614 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1013/2010] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:49:15.576577 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc4a65-5a5d-4474-a628-22ad27c327d4 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:15.594404 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc4a65-5a5d-4474-a628-22ad27c327d4 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:15.605400 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab22ca9-d5f8-4fa4-ab13-bf153d88b8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:15.606059 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab22ca9-d5f8-4fa4-ab13-bf153d88b8a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:15.606346 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab22ca9-d5f8-4fa4-ab13-bf153d88b8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:15.606627 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab22ca9-d5f8-4fa4-ab13-bf153d88b8a0 admin admin] PATH_INFO: `/v3/projects/b92b11848184454ea098395faecc4ad7/users/1f18cadb568c46279613cb59eb09bf48/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:15.674558 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab22ca9-d5f8-4fa4-ab13-bf153d88b8a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b92b11848184454ea098395faecc4ad7, user_id=1f18cadb568c46279613cb59eb09bf48, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:15.677296 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab22ca9-d5f8-4fa4-ab13-bf153d88b8a0 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:15.849234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 998/2011] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:49:15 2022] PUT /identity/v3/projects/b92b11848184454ea098395faecc4ad7/users/1f18cadb568c46279613cb59eb09bf48/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:49:15.853579 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f5b378-fe7a-4fdc-81ad-5f27db65f404 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:15.869636 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f5b378-fe7a-4fdc-81ad-5f27db65f404 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:15.920566 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:15.987610 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ff28a-2014-4822-ba77-6594fc0531f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:15.988279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ff28a-2014-4822-ba77-6594fc0531f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:15.988620 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ff28a-2014-4822-ba77-6594fc0531f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:15.988931 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ff28a-2014-4822-ba77-6594fc0531f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:15.989720 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ff28a-2014-4822-ba77-6594fc0531f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:15.991504 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ff28a-2014-4822-ba77-6594fc0531f2 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:16.010852 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1014/2012] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:49:16.012227 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab22ca9-d5f8-4fa4-ab13-bf153d88b8a0 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:16.035588 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab22ca9-d5f8-4fa4-ab13-bf153d88b8a0 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:16.050503 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514980f8-3c74-4956-b9dd-f46539ec782d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:16.050503 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514980f8-3c74-4956-b9dd-f46539ec782d admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:16.050503 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514980f8-3c74-4956-b9dd-f46539ec782d admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:16.050503 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514980f8-3c74-4956-b9dd-f46539ec782d admin admin] PATH_INFO: `/v3/projects/b92b11848184454ea098395faecc4ad7/users/1f18cadb568c46279613cb59eb09bf48/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:16.050835 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514980f8-3c74-4956-b9dd-f46539ec782d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b92b11848184454ea098395faecc4ad7, user_id=1f18cadb568c46279613cb59eb09bf48, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:16.052191 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514980f8-3c74-4956-b9dd-f46539ec782d admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:16.064249 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 999/2013] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:49:16 2022] PUT /identity/v3/projects/b92b11848184454ea098395faecc4ad7/users/1f18cadb568c46279613cb59eb09bf48/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:49:16.083672 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cdf479-51ce-4f38-a43c-a5235e5a9b9a None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:16.084186 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cdf479-51ce-4f38-a43c-a5235e5a9b9a None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:16.084594 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cdf479-51ce-4f38-a43c-a5235e5a9b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:16.149238 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-37cdf479-51ce-4f38-a43c-a5235e5a9b9a None None] MFA Rules not processed for user `1f18cadb568c46279613cb59eb09bf48`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:16.150534 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-37cdf479-51ce-4f38-a43c-a5235e5a9b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:16.328972 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1015/2014] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:16 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:49:16.361949 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514980f8-3c74-4956-b9dd-f46539ec782d admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:16.366106 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-514980f8-3c74-4956-b9dd-f46539ec782d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:16.473869 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514980f8-3c74-4956-b9dd-f46539ec782d admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:16.483248 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb1e22-81d5-4c53-81a7-99ae6e65533b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:16.488246 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb1e22-81d5-4c53-81a7-99ae6e65533b service cinder] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:16.488246 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb1e22-81d5-4c53-81a7-99ae6e65533b service cinder] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:16.488246 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb1e22-81d5-4c53-81a7-99ae6e65533b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:16.591530 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb1e22-81d5-4c53-81a7-99ae6e65533b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:16.593536 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb1e22-81d5-4c53-81a7-99ae6e65533b service cinder] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:16.623825 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1000/2015] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:49:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:49:20.007297 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cdf479-51ce-4f38-a43c-a5235e5a9b9a None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:20.142356 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cdf479-51ce-4f38-a43c-a5235e5a9b9a None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:20.147724 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf000cb1-a205-4d15-a987-a292b9327ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:20.148684 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf000cb1-a205-4d15-a987-a292b9327ef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:20.149071 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf000cb1-a205-4d15-a987-a292b9327ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:20.149472 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf000cb1-a205-4d15-a987-a292b9327ef0 admin admin] PATH_INFO: `/v3/users/50d83de1c2714d70bc1209999a5fe866` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:20.152493 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf000cb1-a205-4d15-a987-a292b9327ef0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50d83de1c2714d70bc1209999a5fe866)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:20.155816 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf000cb1-a205-4d15-a987-a292b9327ef0 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:20.655837 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:20.661056 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-bf000cb1-a205-4d15-a987-a292b9327ef0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50d83de1c2714d70bc1209999a5fe866'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:20.734380 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-bf000cb1-a205-4d15-a987-a292b9327ef0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50d83de1c2714d70bc1209999a5fe866'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:20.762318 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-bf000cb1-a205-4d15-a987-a292b9327ef0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50d83de1c2714d70bc1209999a5fe866'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:20.796042 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-bf000cb1-a205-4d15-a987-a292b9327ef0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50d83de1c2714d70bc1209999a5fe866'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:20.796042 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-bf000cb1-a205-4d15-a987-a292b9327ef0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50d83de1c2714d70bc1209999a5fe866'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:20.810011 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5debd-76b2-4e90-bfd0-54f0e8314f08 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:20.811043 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5debd-76b2-4e90-bfd0-54f0e8314f08 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:20.811488 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5debd-76b2-4e90-bfd0-54f0e8314f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:20.812468 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1016/2016] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:49:20 2022] DELETE /identity/v3/users/50d83de1c2714d70bc1209999a5fe866 => generated 0 bytes in 798 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:49:20.838372 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-c2e5debd-76b2-4e90-bfd0-54f0e8314f08 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:20.840459 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-c2e5debd-76b2-4e90-bfd0-54f0e8314f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:20.926449 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:20.938738 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1001/2017] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:49:20.949236 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf000cb1-a205-4d15-a987-a292b9327ef0 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:20.951355 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-bf000cb1-a205-4d15-a987-a292b9327ef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:21.038133 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf000cb1-a205-4d15-a987-a292b9327ef0 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:21.043198 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38107f9-4ae4-4a3e-8185-81126827a5fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:21.047045 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38107f9-4ae4-4a3e-8185-81126827a5fd service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:21.047045 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38107f9-4ae4-4a3e-8185-81126827a5fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:21.047045 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38107f9-4ae4-4a3e-8185-81126827a5fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:21.058473 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38107f9-4ae4-4a3e-8185-81126827a5fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:21.060277 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38107f9-4ae4-4a3e-8185-81126827a5fd service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:21.085661 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1017/2018] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:49:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:49:21.509411 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb67e0-bc47-4f39-8d1c-c8e7be56014b None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:21.511188 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb67e0-bc47-4f39-8d1c-c8e7be56014b None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:21.511188 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb67e0-bc47-4f39-8d1c-c8e7be56014b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:21.549329 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-c8bb67e0-bc47-4f39-8d1c-c8e7be56014b None None] MFA Rules not processed for user `5546cb42464b4a9085e54eaca89586b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:21.552693 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-c8bb67e0-bc47-4f39-8d1c-c8e7be56014b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:21.596261 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38107f9-4ae4-4a3e-8185-81126827a5fd service neutron] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:21.598075 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-b38107f9-4ae4-4a3e-8185-81126827a5fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:21.616909 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38107f9-4ae4-4a3e-8185-81126827a5fd service neutron] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:21.632040 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e98c7c9-1426-456a-98eb-b188f65b36cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:21.632320 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98c7c9-1426-456a-98eb-b188f65b36cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:21.632608 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98c7c9-1426-456a-98eb-b188f65b36cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:21.632878 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98c7c9-1426-456a-98eb-b188f65b36cf admin admin] PATH_INFO: `/v3/projects/801f0946ec36403fa62149358ecd1787` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:21.634583 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e98c7c9-1426-456a-98eb-b188f65b36cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=801f0946ec36403fa62149358ecd1787)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:21.636772 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e98c7c9-1426-456a-98eb-b188f65b36cf admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:21.651694 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1002/2019] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:21 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:49:21.676275 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb67e0-bc47-4f39-8d1c-c8e7be56014b None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:21.677356 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-c8bb67e0-bc47-4f39-8d1c-c8e7be56014b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:21.763530 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb67e0-bc47-4f39-8d1c-c8e7be56014b None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:21.767427 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa9f53-c1ec-4e5e-8de2-350ec7ec8e9e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '116f66d7dd7b42878f71bd29dc55729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:21.768053 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa9f53-c1ec-4e5e-8de2-350ec7ec8e9e service glance] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:21.771318 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa9f53-c1ec-4e5e-8de2-350ec7ec8e9e service glance] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:21.771318 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa9f53-c1ec-4e5e-8de2-350ec7ec8e9e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:21.771318 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-09fa9f53-c1ec-4e5e-8de2-350ec7ec8e9e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:21.788457 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-1e98c7c9-1426-456a-98eb-b188f65b36cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '801f0946ec36403fa62149358ecd1787', 'request_id': 'req-1e98c7c9-1426-456a-98eb-b188f65b36cf'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:21.830862 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa9f53-c1ec-4e5e-8de2-350ec7ec8e9e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:21.832342 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa9f53-c1ec-4e5e-8de2-350ec7ec8e9e service glance] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:21.842090 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1003/2020] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:49:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:49:21.859763 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-1e98c7c9-1426-456a-98eb-b188f65b36cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '801f0946ec36403fa62149358ecd1787', 'request_id': 'req-1e98c7c9-1426-456a-98eb-b188f65b36cf'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:21.867640 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-1e98c7c9-1426-456a-98eb-b188f65b36cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '801f0946ec36403fa62149358ecd1787', 'request_id': 'req-1e98c7c9-1426-456a-98eb-b188f65b36cf'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:21.881285 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-1e98c7c9-1426-456a-98eb-b188f65b36cf admin admin] The token cache is being invalidate because project 801f0946ec36403fa62149358ecd1787 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:49:21.881590 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-1e98c7c9-1426-456a-98eb-b188f65b36cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:21.882313 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-1e98c7c9-1426-456a-98eb-b188f65b36cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:21.884133 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1018/2021] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:49:21 2022] DELETE /identity/v3/projects/801f0946ec36403fa62149358ecd1787 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:49:21.888649 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa9f53-c1ec-4e5e-8de2-350ec7ec8e9e service glance] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:21.903121 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa9f53-c1ec-4e5e-8de2-350ec7ec8e9e service glance] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:21.960206 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d938a-c375-4978-8f9a-37f3446268ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:21.960770 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d938a-c375-4978-8f9a-37f3446268ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:21.961048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d938a-c375-4978-8f9a-37f3446268ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:21.961323 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d938a-c375-4978-8f9a-37f3446268ed admin admin] PATH_INFO: `/v3/users/1f18cadb568c46279613cb59eb09bf48` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:21.962496 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910d938a-c375-4978-8f9a-37f3446268ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f18cadb568c46279613cb59eb09bf48)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:21.964463 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910d938a-c375-4978-8f9a-37f3446268ed admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:21.998285 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:22.134756 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4baf0-d206-4e88-83a5-4869d017c967 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:22.135378 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4baf0-d206-4e88-83a5-4869d017c967 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:22.135486 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4baf0-d206-4e88-83a5-4869d017c967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:22.154823 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-910d938a-c375-4978-8f9a-37f3446268ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f18cadb568c46279613cb59eb09bf48'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:22.157396 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-20b4baf0-d206-4e88-83a5-4869d017c967 None None] MFA Rules not processed for user `6bea520676244effbbe212aa62b1cc68`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:22.158717 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-20b4baf0-d206-4e88-83a5-4869d017c967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:22.214568 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:22.225989 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1019/2022] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Aug 5 02:49:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:49:22.228069 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-910d938a-c375-4978-8f9a-37f3446268ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f18cadb568c46279613cb59eb09bf48'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:22.248369 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-910d938a-c375-4978-8f9a-37f3446268ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f18cadb568c46279613cb59eb09bf48'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:22.249233 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-910d938a-c375-4978-8f9a-37f3446268ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f18cadb568c46279613cb59eb09bf48'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:22.276497 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-910d938a-c375-4978-8f9a-37f3446268ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f18cadb568c46279613cb59eb09bf48'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:22.286546 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4baf0-d206-4e88-83a5-4869d017c967 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:22.287846 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1004/2023] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:49:21 2022] DELETE /identity/v3/users/1f18cadb568c46279613cb59eb09bf48 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:49:22.289286 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-20b4baf0-d206-4e88-83a5-4869d017c967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:22.380920 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4baf0-d206-4e88-83a5-4869d017c967 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:22.460310 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab7b73-ccad-42a9-8d5d-3e1f8662b05a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40f706f1eb2b4137afd367cb5060ced0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:22.461555 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab7b73-ccad-42a9-8d5d-3e1f8662b05a service swift] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:22.461555 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab7b73-ccad-42a9-8d5d-3e1f8662b05a service swift] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:22.461902 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab7b73-ccad-42a9-8d5d-3e1f8662b05a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:22.464868 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-acab7b73-ccad-42a9-8d5d-3e1f8662b05a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:22.552406 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab7b73-ccad-42a9-8d5d-3e1f8662b05a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:22.553988 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab7b73-ccad-42a9-8d5d-3e1f8662b05a service swift] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:22.564940 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1020/2024] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 5 02:49:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 02:49:22.998705 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d938a-c375-4978-8f9a-37f3446268ed admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:23.006887 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-910d938a-c375-4978-8f9a-37f3446268ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:23.125378 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d938a-c375-4978-8f9a-37f3446268ed admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:23.138374 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7a828-3e15-441b-a69c-a01b04234ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:23.139330 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7a828-3e15-441b-a69c-a01b04234ef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:23.139686 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7a828-3e15-441b-a69c-a01b04234ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:23.140559 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7a828-3e15-441b-a69c-a01b04234ef2 admin admin] PATH_INFO: `/v3/projects/b92b11848184454ea098395faecc4ad7` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:23.144292 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d7a828-3e15-441b-a69c-a01b04234ef2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b92b11848184454ea098395faecc4ad7)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:23.148030 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d7a828-3e15-441b-a69c-a01b04234ef2 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:23.247419 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:23.276539 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-b2d7a828-3e15-441b-a69c-a01b04234ef2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b92b11848184454ea098395faecc4ad7', 'request_id': 'req-b2d7a828-3e15-441b-a69c-a01b04234ef2'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:23.368395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-b2d7a828-3e15-441b-a69c-a01b04234ef2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b92b11848184454ea098395faecc4ad7', 'request_id': 'req-b2d7a828-3e15-441b-a69c-a01b04234ef2'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:23.370788 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-b2d7a828-3e15-441b-a69c-a01b04234ef2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b92b11848184454ea098395faecc4ad7', 'request_id': 'req-b2d7a828-3e15-441b-a69c-a01b04234ef2'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:23.396500 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-b2d7a828-3e15-441b-a69c-a01b04234ef2 admin admin] The token cache is being invalidate because project b92b11848184454ea098395faecc4ad7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:49:23.397067 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-b2d7a828-3e15-441b-a69c-a01b04234ef2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:23.399664 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-b2d7a828-3e15-441b-a69c-a01b04234ef2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:23.402590 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1005/2025] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:49:22 2022] DELETE /identity/v3/projects/b92b11848184454ea098395faecc4ad7 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:49:23.408849 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95d82e-70d7-456f-b9a6-b22b47c4120c None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:23.409419 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95d82e-70d7-456f-b9a6-b22b47c4120c None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:23.409419 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95d82e-70d7-456f-b9a6-b22b47c4120c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:23.434893 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-4e95d82e-70d7-456f-b9a6-b22b47c4120c None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:23.436216 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-4e95d82e-70d7-456f-b9a6-b22b47c4120c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:23.528068 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1021/2026] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:49:23.530493 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b261c-e88f-4f9c-b7bd-b8746113f49f None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:23.530799 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b261c-e88f-4f9c-b7bd-b8746113f49f None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:23.531097 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b261c-e88f-4f9c-b7bd-b8746113f49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:23.558442 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-2e3b261c-e88f-4f9c-b7bd-b8746113f49f None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:23.560318 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-2e3b261c-e88f-4f9c-b7bd-b8746113f49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:23.576096 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1006/2027] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:49:23.577556 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95d82e-70d7-456f-b9a6-b22b47c4120c None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:23.587537 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95d82e-70d7-456f-b9a6-b22b47c4120c None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:23.595459 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac3bd6-7b6b-4e07-9dd5-4b690fa78108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:23.597096 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac3bd6-7b6b-4e07-9dd5-4b690fa78108 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:23.597096 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac3bd6-7b6b-4e07-9dd5-4b690fa78108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:23.597096 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac3bd6-7b6b-4e07-9dd5-4b690fa78108 admin admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:23.597781 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac3bd6-7b6b-4e07-9dd5-4b690fa78108 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:49:23.598173 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac3bd6-7b6b-4e07-9dd5-4b690fa78108 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:23.599883 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac3bd6-7b6b-4e07-9dd5-4b690fa78108 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:23.617416 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1022/2028] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:49:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:49:23.621170 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b261c-e88f-4f9c-b7bd-b8746113f49f None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:23.630562 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b261c-e88f-4f9c-b7bd-b8746113f49f None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:23.636509 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb1edb-37bc-4027-beb9-c6289ef6f90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:23.637319 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb1edb-37bc-4027-beb9-c6289ef6f90a admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:23.638445 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb1edb-37bc-4027-beb9-c6289ef6f90a admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:23.638840 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb1edb-37bc-4027-beb9-c6289ef6f90a admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:23.639685 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb1edb-37bc-4027-beb9-c6289ef6f90a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:23.641828 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb1edb-37bc-4027-beb9-c6289ef6f90a admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:23.689611 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:23.899499 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1007/2029] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:49:23 2022] POST /identity/v3/projects => generated 375 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:49:23.900830 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac3bd6-7b6b-4e07-9dd5-4b690fa78108 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:23.913669 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac3bd6-7b6b-4e07-9dd5-4b690fa78108 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:24.060359 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8833c7-e247-4670-9b32-00457c655cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:24.063493 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8833c7-e247-4670-9b32-00457c655cbf admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:24.064970 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8833c7-e247-4670-9b32-00457c655cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:24.065923 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8833c7-e247-4670-9b32-00457c655cbf admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:24.069579 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8833c7-e247-4670-9b32-00457c655cbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:24.071865 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8833c7-e247-4670-9b32-00457c655cbf admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:24.177003 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1023/2030] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:49:23 2022] POST /identity/v3/users => generated 288 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:49:24.181428 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb1edb-37bc-4027-beb9-c6289ef6f90a admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:24.196194 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb1edb-37bc-4027-beb9-c6289ef6f90a admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:24.201122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99325e8d-2bee-4f5d-a1ab-9bbc0324a383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:24.206132 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99325e8d-2bee-4f5d-a1ab-9bbc0324a383 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:24.206132 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99325e8d-2bee-4f5d-a1ab-9bbc0324a383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:24.206132 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99325e8d-2bee-4f5d-a1ab-9bbc0324a383 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:24.206132 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99325e8d-2bee-4f5d-a1ab-9bbc0324a383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:24.206132 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99325e8d-2bee-4f5d-a1ab-9bbc0324a383 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:24.216748 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1008/2031] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:49:24.220489 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8833c7-e247-4670-9b32-00457c655cbf admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:24.254385 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8833c7-e247-4670-9b32-00457c655cbf admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:24.284020 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2efa46-b05e-40bf-8956-84121f56de4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:24.286462 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2efa46-b05e-40bf-8956-84121f56de4e admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:24.286462 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2efa46-b05e-40bf-8956-84121f56de4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:24.286462 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2efa46-b05e-40bf-8956-84121f56de4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:24.316027 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2efa46-b05e-40bf-8956-84121f56de4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:24.316027 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2efa46-b05e-40bf-8956-84121f56de4e admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:24.342084 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1024/2032] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:49:24.346358 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99325e8d-2bee-4f5d-a1ab-9bbc0324a383 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:24.363739 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99325e8d-2bee-4f5d-a1ab-9bbc0324a383 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:24.389988 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36be1bf-6b63-4832-83eb-877735e5aafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:24.393496 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36be1bf-6b63-4832-83eb-877735e5aafc admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:24.393985 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36be1bf-6b63-4832-83eb-877735e5aafc admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:24.394425 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36be1bf-6b63-4832-83eb-877735e5aafc admin admin] PATH_INFO: `/v3/projects/6497408b87ad47ea8f329b6b64945d61/users/2276f5ba11fe4b158cdaa9f3bb46c0ae/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:24.423598 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36be1bf-6b63-4832-83eb-877735e5aafc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6497408b87ad47ea8f329b6b64945d61, user_id=2276f5ba11fe4b158cdaa9f3bb46c0ae, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:24.427509 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36be1bf-6b63-4832-83eb-877735e5aafc admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:24.507102 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1009/2033] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:49:24 2022] PUT /identity/v3/projects/6497408b87ad47ea8f329b6b64945d61/users/2276f5ba11fe4b158cdaa9f3bb46c0ae/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:49:24.518124 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69781d3-68dd-46aa-b58e-d896fc8f1d90 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:24.518664 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69781d3-68dd-46aa-b58e-d896fc8f1d90 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:24.518664 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69781d3-68dd-46aa-b58e-d896fc8f1d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:24.556676 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-b69781d3-68dd-46aa-b58e-d896fc8f1d90 None None] MFA Rules not processed for user `2276f5ba11fe4b158cdaa9f3bb46c0ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:24.558541 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-b69781d3-68dd-46aa-b58e-d896fc8f1d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:24.644317 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1025/2034] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:49:24.658219 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36be1bf-6b63-4832-83eb-877735e5aafc admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:24.660286 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-a36be1bf-6b63-4832-83eb-877735e5aafc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:24.747585 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36be1bf-6b63-4832-83eb-877735e5aafc admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:24.751815 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995075bb-6507-4859-abb4-f7405ff0ba06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:24.759598 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995075bb-6507-4859-abb4-f7405ff0ba06 service cinder] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:24.759598 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995075bb-6507-4859-abb4-f7405ff0ba06 service cinder] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:24.759598 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995075bb-6507-4859-abb4-f7405ff0ba06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:24.765393 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995075bb-6507-4859-abb4-f7405ff0ba06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:24.767186 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995075bb-6507-4859-abb4-f7405ff0ba06 service cinder] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:24.777964 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1010/2035] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:49:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:49:25.169121 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69781d3-68dd-46aa-b58e-d896fc8f1d90 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:25.170811 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-b69781d3-68dd-46aa-b58e-d896fc8f1d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:25.236061 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:25.319144 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69781d3-68dd-46aa-b58e-d896fc8f1d90 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:25.355660 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3a668-5d2d-44f2-a304-43cf9d98bb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:25.358865 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3a668-5d2d-44f2-a304-43cf9d98bb33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:25.359188 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3a668-5d2d-44f2-a304-43cf9d98bb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:25.359472 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3a668-5d2d-44f2-a304-43cf9d98bb33 admin admin] PATH_INFO: `/v3/users/0852ab145c8b422db40b94f7dd390ad5` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:25.360771 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3a668-5d2d-44f2-a304-43cf9d98bb33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0852ab145c8b422db40b94f7dd390ad5)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:25.367616 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3a668-5d2d-44f2-a304-43cf9d98bb33 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:25.623394 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-90c3a668-5d2d-44f2-a304-43cf9d98bb33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0852ab145c8b422db40b94f7dd390ad5'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:25.716666 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-90c3a668-5d2d-44f2-a304-43cf9d98bb33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0852ab145c8b422db40b94f7dd390ad5'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:25.740640 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-90c3a668-5d2d-44f2-a304-43cf9d98bb33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0852ab145c8b422db40b94f7dd390ad5'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:25.762112 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-90c3a668-5d2d-44f2-a304-43cf9d98bb33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0852ab145c8b422db40b94f7dd390ad5'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:25.763467 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-90c3a668-5d2d-44f2-a304-43cf9d98bb33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0852ab145c8b422db40b94f7dd390ad5'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:25.775427 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1026/2036] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:49:25 2022] DELETE /identity/v3/users/0852ab145c8b422db40b94f7dd390ad5 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:49:25.776806 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe307d1-2b80-4833-9a7b-fc3600480135 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:25.777433 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe307d1-2b80-4833-9a7b-fc3600480135 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:25.777433 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe307d1-2b80-4833-9a7b-fc3600480135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:25.819310 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-4fe307d1-2b80-4833-9a7b-fc3600480135 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:25.820933 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-4fe307d1-2b80-4833-9a7b-fc3600480135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:25.936564 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1011/2037] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:49:25.946342 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3a668-5d2d-44f2-a304-43cf9d98bb33 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:25.948142 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-90c3a668-5d2d-44f2-a304-43cf9d98bb33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:26.094808 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3a668-5d2d-44f2-a304-43cf9d98bb33 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:26.098935 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b07939-7338-4d31-9c40-264b2086b2f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:26.099640 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b07939-7338-4d31-9c40-264b2086b2f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:26.099969 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b07939-7338-4d31-9c40-264b2086b2f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:26.100208 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b07939-7338-4d31-9c40-264b2086b2f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:26.112271 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b07939-7338-4d31-9c40-264b2086b2f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:26.114199 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b07939-7338-4d31-9c40-264b2086b2f7 service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:26.128223 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1027/2038] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:49:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:49:26.896376 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe307d1-2b80-4833-9a7b-fc3600480135 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:26.898467 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-4fe307d1-2b80-4833-9a7b-fc3600480135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:26.905526 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:26.911294 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe307d1-2b80-4833-9a7b-fc3600480135 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:26.916463 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acfde9e-9d4d-404d-9178-c6e58cc29ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:26.917195 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acfde9e-9d4d-404d-9178-c6e58cc29ab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:26.917630 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acfde9e-9d4d-404d-9178-c6e58cc29ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:26.917953 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acfde9e-9d4d-404d-9178-c6e58cc29ab7 admin admin] PATH_INFO: `/v3/projects/e23b260ffe4b4691b83f291680fe827f` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:26.919813 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acfde9e-9d4d-404d-9178-c6e58cc29ab7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e23b260ffe4b4691b83f291680fe827f)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:26.922419 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acfde9e-9d4d-404d-9178-c6e58cc29ab7 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:27.069567 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-3acfde9e-9d4d-404d-9178-c6e58cc29ab7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e23b260ffe4b4691b83f291680fe827f', 'request_id': 'req-3acfde9e-9d4d-404d-9178-c6e58cc29ab7'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:27.139235 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-3acfde9e-9d4d-404d-9178-c6e58cc29ab7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e23b260ffe4b4691b83f291680fe827f', 'request_id': 'req-3acfde9e-9d4d-404d-9178-c6e58cc29ab7'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:27.149210 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-3acfde9e-9d4d-404d-9178-c6e58cc29ab7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e23b260ffe4b4691b83f291680fe827f', 'request_id': 'req-3acfde9e-9d4d-404d-9178-c6e58cc29ab7'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:27.162882 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-3acfde9e-9d4d-404d-9178-c6e58cc29ab7 admin admin] The token cache is being invalidate because project e23b260ffe4b4691b83f291680fe827f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:49:27.163184 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-3acfde9e-9d4d-404d-9178-c6e58cc29ab7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:27.163840 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-3acfde9e-9d4d-404d-9178-c6e58cc29ab7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:27.166988 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1012/2039] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:49:26 2022] DELETE /identity/v3/projects/e23b260ffe4b4691b83f291680fe827f => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:49:27.171067 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e2ba5-8aff-413c-a9c9-b354114b2a63 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:27.174528 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e2ba5-8aff-413c-a9c9-b354114b2a63 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:27.174528 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e2ba5-8aff-413c-a9c9-b354114b2a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:27.194066 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-b32e2ba5-8aff-413c-a9c9-b354114b2a63 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:27.195647 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-b32e2ba5-8aff-413c-a9c9-b354114b2a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:27.257303 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:27.280648 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1028/2040] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:49:27.288926 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd98067-5868-4f5c-b068-c890bd350534 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:27.289215 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd98067-5868-4f5c-b068-c890bd350534 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:27.289496 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd98067-5868-4f5c-b068-c890bd350534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:27.321447 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-fdd98067-5868-4f5c-b068-c890bd350534 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:27.322588 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-fdd98067-5868-4f5c-b068-c890bd350534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:27.344283 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1013/2041] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:49:27.348690 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e2ba5-8aff-413c-a9c9-b354114b2a63 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:27.363665 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e2ba5-8aff-413c-a9c9-b354114b2a63 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:27.376131 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbcbeb3-6ee9-4213-bbc1-5bcca5db4889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:27.380571 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbcbeb3-6ee9-4213-bbc1-5bcca5db4889 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:27.380571 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbcbeb3-6ee9-4213-bbc1-5bcca5db4889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:27.380571 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbcbeb3-6ee9-4213-bbc1-5bcca5db4889 admin admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:27.382693 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbcbeb3-6ee9-4213-bbc1-5bcca5db4889 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:49:27.383162 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbcbeb3-6ee9-4213-bbc1-5bcca5db4889 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:27.388820 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbcbeb3-6ee9-4213-bbc1-5bcca5db4889 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:27.410992 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1029/2042] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:49:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:49:27.413256 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd98067-5868-4f5c-b068-c890bd350534 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:27.426481 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd98067-5868-4f5c-b068-c890bd350534 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:27.432069 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d8156-f731-4427-afbc-6a15240c3e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:27.433332 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d8156-f731-4427-afbc-6a15240c3e9c admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:27.433613 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d8156-f731-4427-afbc-6a15240c3e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:27.433879 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d8156-f731-4427-afbc-6a15240c3e9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:27.434640 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d8156-f731-4427-afbc-6a15240c3e9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:27.437217 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d8156-f731-4427-afbc-6a15240c3e9c admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:27.538751 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1014/2043] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:49:27 2022] POST /identity/v3/projects => generated 405 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:49:27.542994 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbcbeb3-6ee9-4213-bbc1-5bcca5db4889 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:27.557398 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbcbeb3-6ee9-4213-bbc1-5bcca5db4889 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:27.655917 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c5463-b7e5-4d7f-a229-60e2f8cc48e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:27.656814 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c5463-b7e5-4d7f-a229-60e2f8cc48e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:27.657101 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c5463-b7e5-4d7f-a229-60e2f8cc48e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:27.657381 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c5463-b7e5-4d7f-a229-60e2f8cc48e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:27.658057 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0c5463-b7e5-4d7f-a229-60e2f8cc48e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:27.660071 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0c5463-b7e5-4d7f-a229-60e2f8cc48e1 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:27.778839 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1030/2044] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:49:27 2022] POST /identity/v3/users => generated 303 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:49:27.780073 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d8156-f731-4427-afbc-6a15240c3e9c admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:27.793647 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d8156-f731-4427-afbc-6a15240c3e9c admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:27.799077 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33feaae8-a586-4b23-88ff-462b2c5faf15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:27.799608 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33feaae8-a586-4b23-88ff-462b2c5faf15 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:27.799893 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33feaae8-a586-4b23-88ff-462b2c5faf15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:27.800169 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33feaae8-a586-4b23-88ff-462b2c5faf15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:27.800872 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33feaae8-a586-4b23-88ff-462b2c5faf15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:27.802473 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33feaae8-a586-4b23-88ff-462b2c5faf15 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:27.817205 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1015/2045] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:49:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:49:27.819719 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c5463-b7e5-4d7f-a229-60e2f8cc48e1 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:27.839232 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c5463-b7e5-4d7f-a229-60e2f8cc48e1 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:27.848863 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b94404-7d13-4bfc-b783-dfbff46f2ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:27.849580 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b94404-7d13-4bfc-b783-dfbff46f2ebb admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:27.850156 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b94404-7d13-4bfc-b783-dfbff46f2ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:27.866712 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b94404-7d13-4bfc-b783-dfbff46f2ebb admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:27.866712 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b94404-7d13-4bfc-b783-dfbff46f2ebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:27.866712 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b94404-7d13-4bfc-b783-dfbff46f2ebb admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:27.891063 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1031/2046] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:49:27 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:49:27.895454 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33feaae8-a586-4b23-88ff-462b2c5faf15 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:27.908285 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33feaae8-a586-4b23-88ff-462b2c5faf15 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:27.915699 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f4274-8676-4d59-848b-acfb308b7d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:27.916460 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f4274-8676-4d59-848b-acfb308b7d85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:27.916817 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f4274-8676-4d59-848b-acfb308b7d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:27.917174 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f4274-8676-4d59-848b-acfb308b7d85 admin admin] PATH_INFO: `/v3/projects/f44eb1651166460f8e0222b313081192/users/9c23986019be4e8887ef174e4253860a/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:27.941011 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f4274-8676-4d59-848b-acfb308b7d85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f44eb1651166460f8e0222b313081192, user_id=9c23986019be4e8887ef174e4253860a, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:27.941011 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f4274-8676-4d59-848b-acfb308b7d85 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:28.063470 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1016/2047] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:49:27 2022] PUT /identity/v3/projects/f44eb1651166460f8e0222b313081192/users/9c23986019be4e8887ef174e4253860a/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:49:28.068734 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41c51b-be1a-422c-b77f-3df360aa4e54 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:28.069030 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41c51b-be1a-422c-b77f-3df360aa4e54 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:28.069312 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41c51b-be1a-422c-b77f-3df360aa4e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:28.088868 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-4a41c51b-be1a-422c-b77f-3df360aa4e54 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:28.094058 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-4a41c51b-be1a-422c-b77f-3df360aa4e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:28.161858 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1032/2048] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:49:28.173213 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f4274-8676-4d59-848b-acfb308b7d85 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:28.175168 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-eb3f4274-8676-4d59-848b-acfb308b7d85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:28.260244 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f4274-8676-4d59-848b-acfb308b7d85 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:28.265440 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97be124-a10d-4149-bf35-9e87bca58d9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:28.266128 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97be124-a10d-4149-bf35-9e87bca58d9f service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:28.266707 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97be124-a10d-4149-bf35-9e87bca58d9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:28.266835 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97be124-a10d-4149-bf35-9e87bca58d9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:28.291587 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97be124-a10d-4149-bf35-9e87bca58d9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:28.292510 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97be124-a10d-4149-bf35-9e87bca58d9f service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:28.307306 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1017/2049] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:49:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:49:29.833497 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70944e3f-9cb2-4e8c-b477-a5216165f597 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:29.834124 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70944e3f-9cb2-4e8c-b477-a5216165f597 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:29.834254 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70944e3f-9cb2-4e8c-b477-a5216165f597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:29.877183 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-70944e3f-9cb2-4e8c-b477-a5216165f597 None None] MFA Rules not processed for user `9c23986019be4e8887ef174e4253860a`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:29.878302 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-70944e3f-9cb2-4e8c-b477-a5216165f597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:29.959629 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:30.005749 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97be124-a10d-4149-bf35-9e87bca58d9f service neutron] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:30.010108 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1033/2050] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:29 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:49:30.024715 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97be124-a10d-4149-bf35-9e87bca58d9f service neutron] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:30.024715 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4d2c6-1b33-4a01-a3f5-167d238e7509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:30.024715 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4d2c6-1b33-4a01-a3f5-167d238e7509 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:30.024715 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4d2c6-1b33-4a01-a3f5-167d238e7509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:30.025174 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4d2c6-1b33-4a01-a3f5-167d238e7509 admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:30.025174 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c4d2c6-1b33-4a01-a3f5-167d238e7509 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:30.025174 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c4d2c6-1b33-4a01-a3f5-167d238e7509 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:30.552703 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1018/2051] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:49:30 2022] POST /identity/v3/projects => generated 405 bytes in 550 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:49:30.559534 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70944e3f-9cb2-4e8c-b477-a5216165f597 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:30.570176 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70944e3f-9cb2-4e8c-b477-a5216165f597 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:30.632900 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70ec01-8a37-4322-8f80-5fa551107f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:30.633537 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70ec01-8a37-4322-8f80-5fa551107f90 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:30.633819 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70ec01-8a37-4322-8f80-5fa551107f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:30.635296 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70ec01-8a37-4322-8f80-5fa551107f90 admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:30.636123 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af70ec01-8a37-4322-8f80-5fa551107f90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:30.638575 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af70ec01-8a37-4322-8f80-5fa551107f90 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:30.726026 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1034/2052] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:49:30 2022] POST /identity/v3/users => generated 309 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:49:30.729929 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4d2c6-1b33-4a01-a3f5-167d238e7509 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:30.736384 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:30.744498 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4d2c6-1b33-4a01-a3f5-167d238e7509 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:30.749634 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606c62a-c7d4-416a-928f-8db5b72cfa48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:30.750317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606c62a-c7d4-416a-928f-8db5b72cfa48 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:30.750598 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606c62a-c7d4-416a-928f-8db5b72cfa48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:30.750869 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606c62a-c7d4-416a-928f-8db5b72cfa48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:30.751610 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4606c62a-c7d4-416a-928f-8db5b72cfa48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:30.753197 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4606c62a-c7d4-416a-928f-8db5b72cfa48 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:30.766808 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1019/2053] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:49:30.770891 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70ec01-8a37-4322-8f80-5fa551107f90 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:30.784682 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70ec01-8a37-4322-8f80-5fa551107f90 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:30.789673 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79689289-1a9d-42b7-91e1-5137073906fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:30.790348 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79689289-1a9d-42b7-91e1-5137073906fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:30.790626 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79689289-1a9d-42b7-91e1-5137073906fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:30.790901 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79689289-1a9d-42b7-91e1-5137073906fb admin admin] PATH_INFO: `/v3/projects/14c078d7aa8a484a9132c16aa3c3bf73/users/d97b7a7f5b0942a48452139af4a240df/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:30.811165 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79689289-1a9d-42b7-91e1-5137073906fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=14c078d7aa8a484a9132c16aa3c3bf73, user_id=d97b7a7f5b0942a48452139af4a240df, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:30.815175 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79689289-1a9d-42b7-91e1-5137073906fb admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:30.904625 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1035/2054] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:49:30 2022] PUT /identity/v3/projects/14c078d7aa8a484a9132c16aa3c3bf73/users/d97b7a7f5b0942a48452139af4a240df/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:49:30.908510 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606c62a-c7d4-416a-928f-8db5b72cfa48 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:30.920889 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606c62a-c7d4-416a-928f-8db5b72cfa48 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:30.990925 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a188bcd-ee15-4151-9139-38f7b45a69ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:30.991728 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a188bcd-ee15-4151-9139-38f7b45a69ad admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:30.992013 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a188bcd-ee15-4151-9139-38f7b45a69ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:30.992293 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a188bcd-ee15-4151-9139-38f7b45a69ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:30.993586 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a188bcd-ee15-4151-9139-38f7b45a69ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:30.995271 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a188bcd-ee15-4151-9139-38f7b45a69ad admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:31.006790 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1020/2055] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:49:31.012139 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79689289-1a9d-42b7-91e1-5137073906fb admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:31.023839 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79689289-1a9d-42b7-91e1-5137073906fb admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:31.033235 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a6848-009d-4624-8e20-7ba1ccaedf35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:31.034229 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a6848-009d-4624-8e20-7ba1ccaedf35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:31.034566 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a6848-009d-4624-8e20-7ba1ccaedf35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:31.035021 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a6848-009d-4624-8e20-7ba1ccaedf35 admin admin] PATH_INFO: `/v3/projects/14c078d7aa8a484a9132c16aa3c3bf73/users/d97b7a7f5b0942a48452139af4a240df/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:31.037242 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a6848-009d-4624-8e20-7ba1ccaedf35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14c078d7aa8a484a9132c16aa3c3bf73, user_id=d97b7a7f5b0942a48452139af4a240df, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:31.040126 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a6848-009d-4624-8e20-7ba1ccaedf35 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:31.054252 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1036/2056] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:49:31 2022] PUT /identity/v3/projects/14c078d7aa8a484a9132c16aa3c3bf73/users/d97b7a7f5b0942a48452139af4a240df/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:49:32.645295 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3cce4-6261-49f3-b0f9-121cdf49e186 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:32.651158 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3cce4-6261-49f3-b0f9-121cdf49e186 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:32.651158 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3cce4-6261-49f3-b0f9-121cdf49e186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:32.686410 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-efe3cce4-6261-49f3-b0f9-121cdf49e186 None None] MFA Rules not processed for user `d97b7a7f5b0942a48452139af4a240df`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:32.687710 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-efe3cce4-6261-49f3-b0f9-121cdf49e186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:32.781970 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1021/2057] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:32 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:49:33.530920 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba20df-a243-43d9-84b6-0a6ed360ee7a None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:33.531552 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba20df-a243-43d9-84b6-0a6ed360ee7a None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:33.531552 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba20df-a243-43d9-84b6-0a6ed360ee7a None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:33.532894 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1037/2058] 10.222.0.42 () {54 vars in 921 bytes} [Fri Aug 5 02:49:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:49:33.551152 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb131e1-f1ab-4eba-8242-2ee57b10c2e0 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:33.551437 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb131e1-f1ab-4eba-8242-2ee57b10c2e0 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:33.551884 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb131e1-f1ab-4eba-8242-2ee57b10c2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:33.583451 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-4bb131e1-f1ab-4eba-8242-2ee57b10c2e0 None None] MFA Rules not processed for user `8b647f2cb18a41d6a9e124e886faa994`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:33.583451 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-4bb131e1-f1ab-4eba-8242-2ee57b10c2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:33.702229 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba20df-a243-43d9-84b6-0a6ed360ee7a None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:33.703835 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1022/2059] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Aug 5 02:49:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:49:33.705096 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-7cba20df-a243-43d9-84b6-0a6ed360ee7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:33.746277 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba20df-a243-43d9-84b6-0a6ed360ee7a None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:33.752227 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68553d48-e851-48c4-af1e-a97f65e6fcd3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647f2cb18a41d6a9e124e886faa994', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:33.752854 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68553d48-e851-48c4-af1e-a97f65e6fcd3 service placement] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:33.753143 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68553d48-e851-48c4-af1e-a97f65e6fcd3 service placement] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:33.777543 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68553d48-e851-48c4-af1e-a97f65e6fcd3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:33.777543 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68553d48-e851-48c4-af1e-a97f65e6fcd3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:33.777543 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68553d48-e851-48c4-af1e-a97f65e6fcd3 service placement] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:33.779044 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1038/2060] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:49:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:49:35.055308 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb131e1-f1ab-4eba-8242-2ee57b10c2e0 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:35.072554 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:35.130941 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb131e1-f1ab-4eba-8242-2ee57b10c2e0 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:35.135833 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed525405-5042-4c96-a911-32df72100061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:35.136542 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed525405-5042-4c96-a911-32df72100061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:35.136827 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed525405-5042-4c96-a911-32df72100061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:35.137099 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed525405-5042-4c96-a911-32df72100061 admin admin] PATH_INFO: `/v3/users/9c23986019be4e8887ef174e4253860a` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:35.138320 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed525405-5042-4c96-a911-32df72100061 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c23986019be4e8887ef174e4253860a)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:35.140279 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed525405-5042-4c96-a911-32df72100061 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:35.331253 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-ed525405-5042-4c96-a911-32df72100061 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c23986019be4e8887ef174e4253860a'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:35.400718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-ed525405-5042-4c96-a911-32df72100061 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c23986019be4e8887ef174e4253860a'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:35.416723 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9aae1-0237-404f-b727-906ba3545e15 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:35.417351 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9aae1-0237-404f-b727-906ba3545e15 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:35.417896 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9aae1-0237-404f-b727-906ba3545e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:35.433246 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-ed525405-5042-4c96-a911-32df72100061 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c23986019be4e8887ef174e4253860a'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:35.433246 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-ed525405-5042-4c96-a911-32df72100061 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c23986019be4e8887ef174e4253860a'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:35.445750 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-48e9aae1-0237-404f-b727-906ba3545e15 None None] MFA Rules not processed for user `8899e781da8d4d05af2ce5a120874d08`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:35.447404 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-48e9aae1-0237-404f-b727-906ba3545e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:35.465788 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-ed525405-5042-4c96-a911-32df72100061 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c23986019be4e8887ef174e4253860a'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:35.474443 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1023/2061] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:49:35 2022] DELETE /identity/v3/users/9c23986019be4e8887ef174e4253860a => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:49:35.523589 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1039/2062] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:49:35.863881 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed525405-5042-4c96-a911-32df72100061 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:35.865394 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-ed525405-5042-4c96-a911-32df72100061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:35.942710 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed525405-5042-4c96-a911-32df72100061 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:35.947488 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8959ce-842a-474c-87a9-67c81185e103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:35.948136 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8959ce-842a-474c-87a9-67c81185e103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:35.948420 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8959ce-842a-474c-87a9-67c81185e103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:35.948697 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8959ce-842a-474c-87a9-67c81185e103 admin admin] PATH_INFO: `/v3/projects/f44eb1651166460f8e0222b313081192` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:35.949902 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8959ce-842a-474c-87a9-67c81185e103 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f44eb1651166460f8e0222b313081192)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:35.953443 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8959ce-842a-474c-87a9-67c81185e103 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:36.077106 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:36.108477 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-7c8959ce-842a-474c-87a9-67c81185e103 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f44eb1651166460f8e0222b313081192', 'request_id': 'req-7c8959ce-842a-474c-87a9-67c81185e103'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:36.178739 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-7c8959ce-842a-474c-87a9-67c81185e103 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f44eb1651166460f8e0222b313081192', 'request_id': 'req-7c8959ce-842a-474c-87a9-67c81185e103'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:36.186298 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-7c8959ce-842a-474c-87a9-67c81185e103 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f44eb1651166460f8e0222b313081192', 'request_id': 'req-7c8959ce-842a-474c-87a9-67c81185e103'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:36.198187 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-7c8959ce-842a-474c-87a9-67c81185e103 admin admin] The token cache is being invalidate because project f44eb1651166460f8e0222b313081192 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:49:36.198479 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-7c8959ce-842a-474c-87a9-67c81185e103 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:36.199167 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-7c8959ce-842a-474c-87a9-67c81185e103 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:36.201312 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1024/2063] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:49:35 2022] DELETE /identity/v3/projects/f44eb1651166460f8e0222b313081192 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:49:36.205293 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e9aae1-0237-404f-b727-906ba3545e15 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:36.216943 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e9aae1-0237-404f-b727-906ba3545e15 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:36.250205 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:36.281338 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c7835-ad18-4e13-84ef-3c6af96e6da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:36.282000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c7835-ad18-4e13-84ef-3c6af96e6da4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:36.285062 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c7835-ad18-4e13-84ef-3c6af96e6da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:36.285062 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c7835-ad18-4e13-84ef-3c6af96e6da4 admin admin] PATH_INFO: `/v3/users/d97b7a7f5b0942a48452139af4a240df` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:36.285062 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1c7835-ad18-4e13-84ef-3c6af96e6da4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d97b7a7f5b0942a48452139af4a240df)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:36.286181 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1c7835-ad18-4e13-84ef-3c6af96e6da4 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:36.475622 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654a15f-8d00-4a01-9bff-db3b49544436 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:36.480247 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654a15f-8d00-4a01-9bff-db3b49544436 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:36.480247 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654a15f-8d00-4a01-9bff-db3b49544436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:36.511926 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-3654a15f-8d00-4a01-9bff-db3b49544436 None None] MFA Rules not processed for user `6bea520676244effbbe212aa62b1cc68`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:36.513696 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-3654a15f-8d00-4a01-9bff-db3b49544436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:36.540905 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-8e1c7835-ad18-4e13-84ef-3c6af96e6da4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd97b7a7f5b0942a48452139af4a240df'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:36.567835 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1025/2064] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Aug 5 02:49:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:49:36.581033 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654a15f-8d00-4a01-9bff-db3b49544436 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:36.582681 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-3654a15f-8d00-4a01-9bff-db3b49544436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:36.613028 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-8e1c7835-ad18-4e13-84ef-3c6af96e6da4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd97b7a7f5b0942a48452139af4a240df'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:36.621049 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-8e1c7835-ad18-4e13-84ef-3c6af96e6da4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd97b7a7f5b0942a48452139af4a240df'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:36.634724 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-8e1c7835-ad18-4e13-84ef-3c6af96e6da4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd97b7a7f5b0942a48452139af4a240df'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:36.636526 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-8e1c7835-ad18-4e13-84ef-3c6af96e6da4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd97b7a7f5b0942a48452139af4a240df'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:36.641956 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1040/2065] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:49:36 2022] DELETE /identity/v3/users/d97b7a7f5b0942a48452139af4a240df => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:49:36.659120 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654a15f-8d00-4a01-9bff-db3b49544436 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:36.730925 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970bd8d9-d29b-4901-92de-482f8b8f2e61 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40f706f1eb2b4137afd367cb5060ced0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:36.731614 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bd8d9-d29b-4901-92de-482f8b8f2e61 service swift] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:36.732426 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bd8d9-d29b-4901-92de-482f8b8f2e61 service swift] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:36.732699 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bd8d9-d29b-4901-92de-482f8b8f2e61 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:36.734511 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-970bd8d9-d29b-4901-92de-482f8b8f2e61 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:36.740392 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:36.793595 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970bd8d9-d29b-4901-92de-482f8b8f2e61 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:36.795782 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970bd8d9-d29b-4901-92de-482f8b8f2e61 service swift] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:36.804276 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1026/2066] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 5 02:49:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 05 02:49:36.941564 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c7835-ad18-4e13-84ef-3c6af96e6da4 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:36.943406 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-8e1c7835-ad18-4e13-84ef-3c6af96e6da4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:37.022389 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c7835-ad18-4e13-84ef-3c6af96e6da4 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:37.027281 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ab6d7-073b-4ddb-b949-47d2aa3b4bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:37.027978 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ab6d7-073b-4ddb-b949-47d2aa3b4bd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:37.028264 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ab6d7-073b-4ddb-b949-47d2aa3b4bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:37.029073 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ab6d7-073b-4ddb-b949-47d2aa3b4bd2 admin admin] PATH_INFO: `/v3/projects/14c078d7aa8a484a9132c16aa3c3bf73` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:37.030497 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ab6d7-073b-4ddb-b949-47d2aa3b4bd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14c078d7aa8a484a9132c16aa3c3bf73)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:37.032644 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ab6d7-073b-4ddb-b949-47d2aa3b4bd2 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:37.165851 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-f99ab6d7-073b-4ddb-b949-47d2aa3b4bd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14c078d7aa8a484a9132c16aa3c3bf73', 'request_id': 'req-f99ab6d7-073b-4ddb-b949-47d2aa3b4bd2'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:37.253947 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-f99ab6d7-073b-4ddb-b949-47d2aa3b4bd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14c078d7aa8a484a9132c16aa3c3bf73', 'request_id': 'req-f99ab6d7-073b-4ddb-b949-47d2aa3b4bd2'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:37.255624 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:37.263919 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-f99ab6d7-073b-4ddb-b949-47d2aa3b4bd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14c078d7aa8a484a9132c16aa3c3bf73', 'request_id': 'req-f99ab6d7-073b-4ddb-b949-47d2aa3b4bd2'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:37.286806 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-f99ab6d7-073b-4ddb-b949-47d2aa3b4bd2 admin admin] The token cache is being invalidate because project 14c078d7aa8a484a9132c16aa3c3bf73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:49:37.288128 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-f99ab6d7-073b-4ddb-b949-47d2aa3b4bd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:37.302111 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-f99ab6d7-073b-4ddb-b949-47d2aa3b4bd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:37.305796 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1041/2067] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:49:36 2022] DELETE /identity/v3/projects/14c078d7aa8a484a9132c16aa3c3bf73 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:49:37.310631 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44752325-7b62-4c4c-aca6-e1a6eb7f9441 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:37.311491 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44752325-7b62-4c4c-aca6-e1a6eb7f9441 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:37.311920 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44752325-7b62-4c4c-aca6-e1a6eb7f9441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:37.352125 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-44752325-7b62-4c4c-aca6-e1a6eb7f9441 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:37.353386 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-44752325-7b62-4c4c-aca6-e1a6eb7f9441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:37.472407 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1027/2068] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:49:37.481489 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa43eb-e8de-4f6a-99b2-f8220084bf8e None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:37.481929 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa43eb-e8de-4f6a-99b2-f8220084bf8e None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:37.482330 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa43eb-e8de-4f6a-99b2-f8220084bf8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:37.518148 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-40fa43eb-e8de-4f6a-99b2-f8220084bf8e None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:37.520202 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-40fa43eb-e8de-4f6a-99b2-f8220084bf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:37.540649 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1042/2069] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:49:37.545087 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44752325-7b62-4c4c-aca6-e1a6eb7f9441 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:37.555955 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44752325-7b62-4c4c-aca6-e1a6eb7f9441 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:37.562057 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216730a6-3279-47be-97d8-7b83e62731cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:37.562780 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216730a6-3279-47be-97d8-7b83e62731cd admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:37.563171 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216730a6-3279-47be-97d8-7b83e62731cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:37.563520 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216730a6-3279-47be-97d8-7b83e62731cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:37.564642 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216730a6-3279-47be-97d8-7b83e62731cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:49:37.565107 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216730a6-3279-47be-97d8-7b83e62731cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:37.566920 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216730a6-3279-47be-97d8-7b83e62731cd admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:37.586330 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1028/2070] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:49:37.593415 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa43eb-e8de-4f6a-99b2-f8220084bf8e None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:37.605569 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa43eb-e8de-4f6a-99b2-f8220084bf8e None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:37.613852 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030916d3-5687-4eab-84e5-c7722e05cec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:37.614582 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030916d3-5687-4eab-84e5-c7722e05cec4 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:37.615000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030916d3-5687-4eab-84e5-c7722e05cec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:37.615603 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030916d3-5687-4eab-84e5-c7722e05cec4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:37.616301 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030916d3-5687-4eab-84e5-c7722e05cec4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:37.618254 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030916d3-5687-4eab-84e5-c7722e05cec4 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:37.735747 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1043/2071] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:49:37 2022] POST /identity/v3/projects => generated 361 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:49:37.740663 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216730a6-3279-47be-97d8-7b83e62731cd admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:37.753451 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216730a6-3279-47be-97d8-7b83e62731cd admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:37.832139 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dbb328-bce3-4a8d-8e1c-970ebc4daced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:37.833436 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbb328-bce3-4a8d-8e1c-970ebc4daced admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:37.833721 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbb328-bce3-4a8d-8e1c-970ebc4daced admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:37.834123 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbb328-bce3-4a8d-8e1c-970ebc4daced admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:37.834731 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dbb328-bce3-4a8d-8e1c-970ebc4daced admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:37.836804 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dbb328-bce3-4a8d-8e1c-970ebc4daced admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:37.951937 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1029/2072] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:49:37 2022] POST /identity/v3/users => generated 281 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:49:37.957003 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030916d3-5687-4eab-84e5-c7722e05cec4 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:37.986673 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030916d3-5687-4eab-84e5-c7722e05cec4 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:37.996880 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f5db5-14df-4545-b86c-cdad02e21bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:37.997922 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f5db5-14df-4545-b86c-cdad02e21bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:37.998304 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f5db5-14df-4545-b86c-cdad02e21bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:37.998678 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f5db5-14df-4545-b86c-cdad02e21bc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:37.999481 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f5db5-14df-4545-b86c-cdad02e21bc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:38.001326 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f5db5-14df-4545-b86c-cdad02e21bc1 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:38.015743 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1044/2073] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:49:38.020424 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dbb328-bce3-4a8d-8e1c-970ebc4daced admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:38.034981 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dbb328-bce3-4a8d-8e1c-970ebc4daced admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:38.041414 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03969d-7cea-477e-aca0-7a5837252ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:38.042823 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03969d-7cea-477e-aca0-7a5837252ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:38.043272 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03969d-7cea-477e-aca0-7a5837252ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:38.043787 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03969d-7cea-477e-aca0-7a5837252ff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:38.045132 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03969d-7cea-477e-aca0-7a5837252ff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:38.052222 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03969d-7cea-477e-aca0-7a5837252ff4 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:38.077551 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f5db5-14df-4545-b86c-cdad02e21bc1 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:38.082600 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1030/2074] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:49:38.088997 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f5db5-14df-4545-b86c-cdad02e21bc1 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:38.094259 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13984e21-3adb-4e19-a4ac-265251fcac7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:38.094943 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13984e21-3adb-4e19-a4ac-265251fcac7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:38.095257 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13984e21-3adb-4e19-a4ac-265251fcac7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:38.095538 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13984e21-3adb-4e19-a4ac-265251fcac7f admin admin] PATH_INFO: `/v3/projects/b85f33448d27468da2adab2a7a69fd47/users/a72ac828d1fa471099ef1302de83a170/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:38.116667 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13984e21-3adb-4e19-a4ac-265251fcac7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b85f33448d27468da2adab2a7a69fd47, user_id=a72ac828d1fa471099ef1302de83a170, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:38.119527 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13984e21-3adb-4e19-a4ac-265251fcac7f admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:38.185564 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1045/2075] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:49:38 2022] PUT /identity/v3/projects/b85f33448d27468da2adab2a7a69fd47/users/a72ac828d1fa471099ef1302de83a170/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:49:38.196821 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81606c4-4ad3-47a5-9343-ebb8e20b5100 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:38.197163 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81606c4-4ad3-47a5-9343-ebb8e20b5100 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:38.197467 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81606c4-4ad3-47a5-9343-ebb8e20b5100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:38.229421 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:38.233243 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-a81606c4-4ad3-47a5-9343-ebb8e20b5100 None None] MFA Rules not processed for user `a72ac828d1fa471099ef1302de83a170`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:38.234625 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-a81606c4-4ad3-47a5-9343-ebb8e20b5100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:38.333382 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1031/2076] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:49:38.338054 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13984e21-3adb-4e19-a4ac-265251fcac7f admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:38.427765 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13984e21-3adb-4e19-a4ac-265251fcac7f admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:38.435647 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5906c7c-3eed-4074-8fcb-db64e594cdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:38.436557 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5906c7c-3eed-4074-8fcb-db64e594cdd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:38.436936 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5906c7c-3eed-4074-8fcb-db64e594cdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:38.437312 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5906c7c-3eed-4074-8fcb-db64e594cdd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:38.438090 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5906c7c-3eed-4074-8fcb-db64e594cdd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:38.440171 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5906c7c-3eed-4074-8fcb-db64e594cdd4 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:38.519285 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1046/2077] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:49:38 2022] POST /identity/v3/projects => generated 365 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:49:38.524247 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81606c4-4ad3-47a5-9343-ebb8e20b5100 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:38.553048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81606c4-4ad3-47a5-9343-ebb8e20b5100 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:38.661590 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc055c-63f1-4e5e-9362-9c89ef8307de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:38.663185 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc055c-63f1-4e5e-9362-9c89ef8307de admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:38.663185 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc055c-63f1-4e5e-9362-9c89ef8307de admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:38.663185 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc055c-63f1-4e5e-9362-9c89ef8307de admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:38.663640 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc055c-63f1-4e5e-9362-9c89ef8307de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:38.666266 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc055c-63f1-4e5e-9362-9c89ef8307de admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:38.779813 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1032/2078] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:49:38 2022] POST /identity/v3/users => generated 289 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:49:38.784710 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5906c7c-3eed-4074-8fcb-db64e594cdd4 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:38.797001 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5906c7c-3eed-4074-8fcb-db64e594cdd4 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:38.802773 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6466cb9-7b5d-4f6c-8bba-355f76f41e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:38.803428 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6466cb9-7b5d-4f6c-8bba-355f76f41e6b admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:38.807979 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6466cb9-7b5d-4f6c-8bba-355f76f41e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:38.807979 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6466cb9-7b5d-4f6c-8bba-355f76f41e6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:38.807979 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6466cb9-7b5d-4f6c-8bba-355f76f41e6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:38.807979 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6466cb9-7b5d-4f6c-8bba-355f76f41e6b admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:38.818394 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1047/2079] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:49:38.823405 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc055c-63f1-4e5e-9362-9c89ef8307de admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:38.834557 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc055c-63f1-4e5e-9362-9c89ef8307de admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:38.839873 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4970d-5bca-480f-81e9-bf2e7660f358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:38.841617 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4970d-5bca-480f-81e9-bf2e7660f358 admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:38.842031 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4970d-5bca-480f-81e9-bf2e7660f358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:38.842179 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4970d-5bca-480f-81e9-bf2e7660f358 admin admin] PATH_INFO: `/v3/projects/558a4a331aa1458d929c85e55b1d05e4/users/726489e52db14a7a8930d942ad89789b/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:38.860735 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc4970d-5bca-480f-81e9-bf2e7660f358 admin admin] RBAC: Authorizing `identity:create_grant(project_id=558a4a331aa1458d929c85e55b1d05e4, user_id=726489e52db14a7a8930d942ad89789b, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:38.863435 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc4970d-5bca-480f-81e9-bf2e7660f358 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:38.945396 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1033/2080] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:49:38 2022] PUT /identity/v3/projects/558a4a331aa1458d929c85e55b1d05e4/users/726489e52db14a7a8930d942ad89789b/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:49:38.949342 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6466cb9-7b5d-4f6c-8bba-355f76f41e6b admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:38.965016 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6466cb9-7b5d-4f6c-8bba-355f76f41e6b admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:39.065646 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:39.073539 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec75f6-7267-401f-8f29-69f2d6a6faef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:39.074417 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec75f6-7267-401f-8f29-69f2d6a6faef admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:39.075011 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec75f6-7267-401f-8f29-69f2d6a6faef admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:39.076028 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec75f6-7267-401f-8f29-69f2d6a6faef admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:39.076951 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ec75f6-7267-401f-8f29-69f2d6a6faef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:39.078768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ec75f6-7267-401f-8f29-69f2d6a6faef admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:39.090472 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1048/2081] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:49:39.096153 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4970d-5bca-480f-81e9-bf2e7660f358 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:39.112037 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4970d-5bca-480f-81e9-bf2e7660f358 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:39.121882 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8466e-78ee-47cb-bc52-605661439890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:39.122634 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8466e-78ee-47cb-bc52-605661439890 admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:39.124804 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8466e-78ee-47cb-bc52-605661439890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:39.124804 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8466e-78ee-47cb-bc52-605661439890 admin admin] PATH_INFO: `/v3/projects/558a4a331aa1458d929c85e55b1d05e4/users/726489e52db14a7a8930d942ad89789b/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:39.127690 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf8466e-78ee-47cb-bc52-605661439890 admin admin] RBAC: Authorizing `identity:create_grant(project_id=558a4a331aa1458d929c85e55b1d05e4, user_id=726489e52db14a7a8930d942ad89789b, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:39.132582 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf8466e-78ee-47cb-bc52-605661439890 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:39.148313 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1034/2082] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:49:39 2022] PUT /identity/v3/projects/558a4a331aa1458d929c85e55b1d05e4/users/726489e52db14a7a8930d942ad89789b/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:49:39.161559 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d415a-37e8-4d18-984a-a43c5dee777f None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:39.163069 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d415a-37e8-4d18-984a-a43c5dee777f None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:39.163883 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d415a-37e8-4d18-984a-a43c5dee777f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:39.204469 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-570d415a-37e8-4d18-984a-a43c5dee777f None None] MFA Rules not processed for user `726489e52db14a7a8930d942ad89789b`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:39.206620 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-570d415a-37e8-4d18-984a-a43c5dee777f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:39.328965 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1049/2083] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:39 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:49:39.341639 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8466e-78ee-47cb-bc52-605661439890 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:39.344263 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-dbf8466e-78ee-47cb-bc52-605661439890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:39.449276 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8466e-78ee-47cb-bc52-605661439890 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:39.453994 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b8147-cd5c-480a-b215-d29a8789233c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:39.454688 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b8147-cd5c-480a-b215-d29a8789233c service cinder] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:39.455108 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b8147-cd5c-480a-b215-d29a8789233c service cinder] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:39.455560 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b8147-cd5c-480a-b215-d29a8789233c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:39.465703 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b8147-cd5c-480a-b215-d29a8789233c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:39.467643 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b8147-cd5c-480a-b215-d29a8789233c service cinder] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:39.472005 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:39.481921 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1035/2084] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:49:39 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:49:39.686329 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d415a-37e8-4d18-984a-a43c5dee777f None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:39.702601 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d415a-37e8-4d18-984a-a43c5dee777f None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:39.708044 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091c26c5-da9c-4a39-9061-cb6cbfa97556 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:39.708722 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c26c5-da9c-4a39-9061-cb6cbfa97556 service cinder] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:39.709209 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c26c5-da9c-4a39-9061-cb6cbfa97556 service cinder] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:39.709503 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c26c5-da9c-4a39-9061-cb6cbfa97556 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:39.790496 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091c26c5-da9c-4a39-9061-cb6cbfa97556 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:39.792605 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091c26c5-da9c-4a39-9061-cb6cbfa97556 service cinder] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:39.811087 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1050/2085] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:49:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:49:40.850738 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9703031-7b75-47cb-857f-80bf43bf8392 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:40.851718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9703031-7b75-47cb-857f-80bf43bf8392 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:40.852151 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9703031-7b75-47cb-857f-80bf43bf8392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:40.901929 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-d9703031-7b75-47cb-857f-80bf43bf8392 None None] MFA Rules not processed for user `6bea520676244effbbe212aa62b1cc68`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:40.907117 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-d9703031-7b75-47cb-857f-80bf43bf8392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:41.029070 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1036/2086] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Aug 5 02:49:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:49:41.072130 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091c26c5-da9c-4a39-9061-cb6cbfa97556 service cinder] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:41.075000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-091c26c5-da9c-4a39-9061-cb6cbfa97556 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:41.249049 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091c26c5-da9c-4a39-9061-cb6cbfa97556 service cinder] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:41.255786 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422ef0e-9c85-438a-908b-2fcaad969be2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40f706f1eb2b4137afd367cb5060ced0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:41.256840 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422ef0e-9c85-438a-908b-2fcaad969be2 service swift] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:41.257460 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422ef0e-9c85-438a-908b-2fcaad969be2 service swift] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:41.258186 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422ef0e-9c85-438a-908b-2fcaad969be2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:41.275289 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422ef0e-9c85-438a-908b-2fcaad969be2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:41.279260 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422ef0e-9c85-438a-908b-2fcaad969be2 service swift] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:41.303058 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1051/2087] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 5 02:49:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 02:49:44.027490 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9703031-7b75-47cb-857f-80bf43bf8392 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:44.029390 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-d9703031-7b75-47cb-857f-80bf43bf8392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:44.244690 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9703031-7b75-47cb-857f-80bf43bf8392 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:44.254659 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8aa144-c082-4c82-ace0-d251e08134c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:44.255656 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8aa144-c082-4c82-ace0-d251e08134c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:44.256910 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8aa144-c082-4c82-ace0-d251e08134c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:44.261315 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8aa144-c082-4c82-ace0-d251e08134c0 admin admin] PATH_INFO: `/v3/users/2276f5ba11fe4b158cdaa9f3bb46c0ae` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:44.263096 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8aa144-c082-4c82-ace0-d251e08134c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2276f5ba11fe4b158cdaa9f3bb46c0ae)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:44.265214 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8aa144-c082-4c82-ace0-d251e08134c0 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:44.568909 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-7f8aa144-c082-4c82-ace0-d251e08134c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2276f5ba11fe4b158cdaa9f3bb46c0ae'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:44.673798 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-7f8aa144-c082-4c82-ace0-d251e08134c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2276f5ba11fe4b158cdaa9f3bb46c0ae'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:44.683919 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-7f8aa144-c082-4c82-ace0-d251e08134c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2276f5ba11fe4b158cdaa9f3bb46c0ae'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:44.684676 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-7f8aa144-c082-4c82-ace0-d251e08134c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2276f5ba11fe4b158cdaa9f3bb46c0ae'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:44.725872 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-7f8aa144-c082-4c82-ace0-d251e08134c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2276f5ba11fe4b158cdaa9f3bb46c0ae'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:44.735747 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1037/2088] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:49:44 2022] DELETE /identity/v3/users/2276f5ba11fe4b158cdaa9f3bb46c0ae => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:49:44.740372 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cbd2b-4806-4881-8e67-b78ab15686f5 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:44.740890 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cbd2b-4806-4881-8e67-b78ab15686f5 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:44.741087 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cbd2b-4806-4881-8e67-b78ab15686f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:44.750490 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:44.761833 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-500cbd2b-4806-4881-8e67-b78ab15686f5 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:44.763597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-500cbd2b-4806-4881-8e67-b78ab15686f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:44.925361 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1052/2089] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:49:44.928870 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8aa144-c082-4c82-ace0-d251e08134c0 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:44.930777 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-7f8aa144-c082-4c82-ace0-d251e08134c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:44.983358 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:45.083490 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8aa144-c082-4c82-ace0-d251e08134c0 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:45.096144 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69e3b8-1e27-460d-bbef-0e91291cd185 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:45.097678 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69e3b8-1e27-460d-bbef-0e91291cd185 service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:45.097902 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69e3b8-1e27-460d-bbef-0e91291cd185 service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:45.098393 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69e3b8-1e27-460d-bbef-0e91291cd185 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:45.123208 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e69e3b8-1e27-460d-bbef-0e91291cd185 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:45.127980 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e69e3b8-1e27-460d-bbef-0e91291cd185 service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:45.148623 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1038/2090] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:49:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:49:45.228618 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500cbd2b-4806-4881-8e67-b78ab15686f5 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:45.230528 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-500cbd2b-4806-4881-8e67-b78ab15686f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:45.266919 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500cbd2b-4806-4881-8e67-b78ab15686f5 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:45.287462 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0cb39-9f42-4149-b640-78d1bb727bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:45.288445 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0cb39-9f42-4149-b640-78d1bb727bfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:45.288897 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0cb39-9f42-4149-b640-78d1bb727bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:45.289426 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0cb39-9f42-4149-b640-78d1bb727bfd admin admin] PATH_INFO: `/v3/users/a72ac828d1fa471099ef1302de83a170` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:45.294304 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f0cb39-9f42-4149-b640-78d1bb727bfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a72ac828d1fa471099ef1302de83a170)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:45.300017 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f0cb39-9f42-4149-b640-78d1bb727bfd admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:45.575289 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-c1f0cb39-9f42-4149-b640-78d1bb727bfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a72ac828d1fa471099ef1302de83a170'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:45.670524 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-c1f0cb39-9f42-4149-b640-78d1bb727bfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a72ac828d1fa471099ef1302de83a170'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:45.680816 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-c1f0cb39-9f42-4149-b640-78d1bb727bfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a72ac828d1fa471099ef1302de83a170'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:45.706559 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-c1f0cb39-9f42-4149-b640-78d1bb727bfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a72ac828d1fa471099ef1302de83a170'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:45.707921 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-c1f0cb39-9f42-4149-b640-78d1bb727bfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a72ac828d1fa471099ef1302de83a170'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:45.716879 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1053/2091] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:49:45 2022] DELETE /identity/v3/users/a72ac828d1fa471099ef1302de83a170 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:49:45.721182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b0a79-51bc-4c8a-919c-31a0627927df None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:45.721683 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b0a79-51bc-4c8a-919c-31a0627927df None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:45.722073 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b0a79-51bc-4c8a-919c-31a0627927df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:45.752052 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-e17b0a79-51bc-4c8a-919c-31a0627927df None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:45.756236 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-e17b0a79-51bc-4c8a-919c-31a0627927df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:45.885929 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1039/2092] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:49:45.894523 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0cb39-9f42-4149-b640-78d1bb727bfd admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:45.896806 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-c1f0cb39-9f42-4149-b640-78d1bb727bfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:46.045465 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0cb39-9f42-4149-b640-78d1bb727bfd admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:46.062002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733c6c8-85e8-4538-a5f7-1cdee709e8b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:46.062452 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733c6c8-85e8-4538-a5f7-1cdee709e8b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:46.062735 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733c6c8-85e8-4538-a5f7-1cdee709e8b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:46.063035 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733c6c8-85e8-4538-a5f7-1cdee709e8b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:46.087497 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a733c6c8-85e8-4538-a5f7-1cdee709e8b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:46.088628 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a733c6c8-85e8-4538-a5f7-1cdee709e8b1 service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:46.110928 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1054/2093] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:49:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:49:46.545069 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b0a79-51bc-4c8a-919c-31a0627927df None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:46.548441 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-e17b0a79-51bc-4c8a-919c-31a0627927df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:46.578344 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b0a79-51bc-4c8a-919c-31a0627927df None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:46.600099 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46443f1e-3d6a-45f9-afca-b6e869659d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:46.601967 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46443f1e-3d6a-45f9-afca-b6e869659d68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:46.604923 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46443f1e-3d6a-45f9-afca-b6e869659d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:46.611389 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46443f1e-3d6a-45f9-afca-b6e869659d68 admin admin] PATH_INFO: `/v3/projects/6497408b87ad47ea8f329b6b64945d61` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:46.611389 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46443f1e-3d6a-45f9-afca-b6e869659d68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6497408b87ad47ea8f329b6b64945d61)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:46.625904 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46443f1e-3d6a-45f9-afca-b6e869659d68 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:46.836092 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-46443f1e-3d6a-45f9-afca-b6e869659d68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6497408b87ad47ea8f329b6b64945d61', 'request_id': 'req-46443f1e-3d6a-45f9-afca-b6e869659d68'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:46.908368 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-46443f1e-3d6a-45f9-afca-b6e869659d68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6497408b87ad47ea8f329b6b64945d61', 'request_id': 'req-46443f1e-3d6a-45f9-afca-b6e869659d68'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:46.918074 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-46443f1e-3d6a-45f9-afca-b6e869659d68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6497408b87ad47ea8f329b6b64945d61', 'request_id': 'req-46443f1e-3d6a-45f9-afca-b6e869659d68'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:46.945919 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-46443f1e-3d6a-45f9-afca-b6e869659d68 admin admin] The token cache is being invalidate because project 6497408b87ad47ea8f329b6b64945d61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:49:46.947165 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-46443f1e-3d6a-45f9-afca-b6e869659d68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:46.951443 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-46443f1e-3d6a-45f9-afca-b6e869659d68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:46.953931 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1040/2094] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:49:46 2022] DELETE /identity/v3/projects/6497408b87ad47ea8f329b6b64945d61 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:49:46.959261 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc617862-1bb1-4e4f-84a0-09132785de09 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:46.959769 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc617862-1bb1-4e4f-84a0-09132785de09 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:46.959769 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc617862-1bb1-4e4f-84a0-09132785de09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:47.000200 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-cc617862-1bb1-4e4f-84a0-09132785de09 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:47.001458 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-cc617862-1bb1-4e4f-84a0-09132785de09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:47.033179 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:47.160190 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d72ae-9b31-44b2-ad31-5b5d88329bf5 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:47.160522 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d72ae-9b31-44b2-ad31-5b5d88329bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:47.160845 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d72ae-9b31-44b2-ad31-5b5d88329bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:47.163777 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1055/2095] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:49:47.203189 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-ab2d72ae-9b31-44b2-ad31-5b5d88329bf5 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:47.205492 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-ab2d72ae-9b31-44b2-ad31-5b5d88329bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:47.225118 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1041/2096] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:49:47.228851 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc617862-1bb1-4e4f-84a0-09132785de09 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:47.248289 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc617862-1bb1-4e4f-84a0-09132785de09 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:47.263834 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9200b-06ce-49cc-8a14-67f1c25bee1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:47.264472 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9200b-06ce-49cc-8a14-67f1c25bee1b admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:47.264753 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9200b-06ce-49cc-8a14-67f1c25bee1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:47.265026 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9200b-06ce-49cc-8a14-67f1c25bee1b admin admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:47.265735 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a9200b-06ce-49cc-8a14-67f1c25bee1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:49:47.266092 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a9200b-06ce-49cc-8a14-67f1c25bee1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:47.287127 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a9200b-06ce-49cc-8a14-67f1c25bee1b admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:47.299921 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d72ae-9b31-44b2-ad31-5b5d88329bf5 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:47.327253 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1056/2097] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:49:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:49:47.385708 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d72ae-9b31-44b2-ad31-5b5d88329bf5 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:47.410403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc26711-b103-425a-9208-9610db3c7e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:47.444399 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc26711-b103-425a-9208-9610db3c7e57 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:47.444399 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc26711-b103-425a-9208-9610db3c7e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:47.444399 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc26711-b103-425a-9208-9610db3c7e57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:47.444399 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc26711-b103-425a-9208-9610db3c7e57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:47.444399 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc26711-b103-425a-9208-9610db3c7e57 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:47.445391 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9200b-06ce-49cc-8a14-67f1c25bee1b admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:47.454025 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-87a9200b-06ce-49cc-8a14-67f1c25bee1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:47.513665 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9200b-06ce-49cc-8a14-67f1c25bee1b admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:47.539880 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3eda6f-b667-48ba-9477-ce6ec0bf54e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:47.540977 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3eda6f-b667-48ba-9477-ce6ec0bf54e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:47.541555 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3eda6f-b667-48ba-9477-ce6ec0bf54e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:47.542066 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3eda6f-b667-48ba-9477-ce6ec0bf54e9 admin admin] PATH_INFO: `/v3/projects/b85f33448d27468da2adab2a7a69fd47` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:47.545391 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3eda6f-b667-48ba-9477-ce6ec0bf54e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b85f33448d27468da2adab2a7a69fd47)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:47.547931 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3eda6f-b667-48ba-9477-ce6ec0bf54e9 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:47.747432 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1042/2098] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:49:47 2022] POST /identity/v3/projects => generated 371 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:49:47.752120 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc26711-b103-425a-9208-9610db3c7e57 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:47.807158 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:47.816858 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-5c3eda6f-b667-48ba-9477-ce6ec0bf54e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b85f33448d27468da2adab2a7a69fd47', 'request_id': 'req-5c3eda6f-b667-48ba-9477-ce6ec0bf54e9'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:47.938884 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-5c3eda6f-b667-48ba-9477-ce6ec0bf54e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b85f33448d27468da2adab2a7a69fd47', 'request_id': 'req-5c3eda6f-b667-48ba-9477-ce6ec0bf54e9'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:47.949940 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-5c3eda6f-b667-48ba-9477-ce6ec0bf54e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b85f33448d27468da2adab2a7a69fd47', 'request_id': 'req-5c3eda6f-b667-48ba-9477-ce6ec0bf54e9'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:47.963995 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc26711-b103-425a-9208-9610db3c7e57 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:47.988343 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-5c3eda6f-b667-48ba-9477-ce6ec0bf54e9 admin admin] The token cache is being invalidate because project b85f33448d27468da2adab2a7a69fd47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:49:47.988343 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-5c3eda6f-b667-48ba-9477-ce6ec0bf54e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:47.988343 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-5c3eda6f-b667-48ba-9477-ce6ec0bf54e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:47.989687 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e237f-1f90-4cee-900e-8862c7863d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:47.990775 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e237f-1f90-4cee-900e-8862c7863d6c admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:47.993868 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e237f-1f90-4cee-900e-8862c7863d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:47.994306 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e237f-1f90-4cee-900e-8862c7863d6c admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:47.999753 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431e237f-1f90-4cee-900e-8862c7863d6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:48.001724 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431e237f-1f90-4cee-900e-8862c7863d6c admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:48.003439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1057/2099] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:49:47 2022] DELETE /identity/v3/projects/b85f33448d27468da2adab2a7a69fd47 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:49:48.007649 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3eda6f-b667-48ba-9477-ce6ec0bf54e9 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:48.017271 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-5c3eda6f-b667-48ba-9477-ce6ec0bf54e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:48.158438 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1043/2100] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:49:47 2022] POST /identity/v3/users => generated 286 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:49:48.162822 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e237f-1f90-4cee-900e-8862c7863d6c admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:48.168991 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-431e237f-1f90-4cee-900e-8862c7863d6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:48.207709 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e237f-1f90-4cee-900e-8862c7863d6c admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:48.212276 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53115e66-0746-434c-9333-62409e0ad74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:48.212949 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3eda6f-b667-48ba-9477-ce6ec0bf54e9 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:48.213215 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53115e66-0746-434c-9333-62409e0ad74b admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:48.213508 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53115e66-0746-434c-9333-62409e0ad74b admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:48.213788 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53115e66-0746-434c-9333-62409e0ad74b admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:48.214866 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53115e66-0746-434c-9333-62409e0ad74b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:48.218283 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53115e66-0746-434c-9333-62409e0ad74b admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:48.234548 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3cd88-62e5-4050-80e6-5ba2b4594a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:48.235696 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3cd88-62e5-4050-80e6-5ba2b4594a91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:48.236146 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3cd88-62e5-4050-80e6-5ba2b4594a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:48.236577 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3cd88-62e5-4050-80e6-5ba2b4594a91 admin admin] PATH_INFO: `/v3/users/726489e52db14a7a8930d942ad89789b` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:48.237768 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1044/2101] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:49:48.238769 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c3cd88-62e5-4050-80e6-5ba2b4594a91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=726489e52db14a7a8930d942ad89789b)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:48.242517 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53115e66-0746-434c-9333-62409e0ad74b admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:48.243736 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c3cd88-62e5-4050-80e6-5ba2b4594a91 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:48.304134 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53115e66-0746-434c-9333-62409e0ad74b admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:48.320645 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1779b61-6323-4a96-a1f4-a0bf4b28f94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:48.338850 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1779b61-6323-4a96-a1f4-a0bf4b28f94f admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:48.339349 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1779b61-6323-4a96-a1f4-a0bf4b28f94f admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:48.341323 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1779b61-6323-4a96-a1f4-a0bf4b28f94f admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:48.346079 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1779b61-6323-4a96-a1f4-a0bf4b28f94f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:48.355857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1779b61-6323-4a96-a1f4-a0bf4b28f94f admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:48.407824 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1045/2102] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:49:48.417685 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891df9b-5031-4e82-8070-9acd435dd3b5 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:48.418201 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891df9b-5031-4e82-8070-9acd435dd3b5 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:48.421584 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891df9b-5031-4e82-8070-9acd435dd3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:48.472017 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-6891df9b-5031-4e82-8070-9acd435dd3b5 None None] MFA Rules not processed for user `8f8ed7d12ca44a058ed8b888ca723b57`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:48.473283 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-6891df9b-5031-4e82-8070-9acd435dd3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:48.521837 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:48.559070 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-b9c3cd88-62e5-4050-80e6-5ba2b4594a91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '726489e52db14a7a8930d942ad89789b'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:48.620886 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1046/2103] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:48 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:49:48.623303 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891df9b-5031-4e82-8070-9acd435dd3b5 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:48.642414 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-b9c3cd88-62e5-4050-80e6-5ba2b4594a91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '726489e52db14a7a8930d942ad89789b'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:48.643970 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891df9b-5031-4e82-8070-9acd435dd3b5 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:48.656599 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd853ed-ac5a-4c75-a63f-91037245e4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:48.657288 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd853ed-ac5a-4c75-a63f-91037245e4d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:48.657570 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd853ed-ac5a-4c75-a63f-91037245e4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:48.657882 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd853ed-ac5a-4c75-a63f-91037245e4d6 admin admin] PATH_INFO: `/v3/projects/863ebecb92fb404aa300505952fcc44c/users/343e5ae005fd4194a3a04a14384ae7e1/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:48.660453 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-b9c3cd88-62e5-4050-80e6-5ba2b4594a91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '726489e52db14a7a8930d942ad89789b'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:48.687916 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd853ed-ac5a-4c75-a63f-91037245e4d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=863ebecb92fb404aa300505952fcc44c, user_id=343e5ae005fd4194a3a04a14384ae7e1, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:48.690749 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd853ed-ac5a-4c75-a63f-91037245e4d6 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:48.699752 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-b9c3cd88-62e5-4050-80e6-5ba2b4594a91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '726489e52db14a7a8930d942ad89789b'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:48.700759 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-b9c3cd88-62e5-4050-80e6-5ba2b4594a91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '726489e52db14a7a8930d942ad89789b'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:48.709049 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1058/2104] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:49:48 2022] DELETE /identity/v3/users/726489e52db14a7a8930d942ad89789b => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:49:48.808358 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1047/2105] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:49:48 2022] PUT /identity/v3/projects/863ebecb92fb404aa300505952fcc44c/users/343e5ae005fd4194a3a04a14384ae7e1/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:49:48.809233 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c73e50-1fca-460e-b044-0692dfd23bbd None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:48.809880 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c73e50-1fca-460e-b044-0692dfd23bbd None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:48.810734 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c73e50-1fca-460e-b044-0692dfd23bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:48.882609 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-92c73e50-1fca-460e-b044-0692dfd23bbd None None] MFA Rules not processed for user `343e5ae005fd4194a3a04a14384ae7e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:48.883936 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-92c73e50-1fca-460e-b044-0692dfd23bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:49.046036 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1059/2106] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:49:49.057737 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd853ed-ac5a-4c75-a63f-91037245e4d6 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:49.060930 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-0dd853ed-ac5a-4c75-a63f-91037245e4d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:49.231831 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd853ed-ac5a-4c75-a63f-91037245e4d6 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:49.240590 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea4a997-ec72-4687-a941-d75d3e86af8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:49.240590 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4a997-ec72-4687-a941-d75d3e86af8d service cinder] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:49.240590 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4a997-ec72-4687-a941-d75d3e86af8d service cinder] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:49.240590 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4a997-ec72-4687-a941-d75d3e86af8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:49.282481 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea4a997-ec72-4687-a941-d75d3e86af8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:49.284881 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea4a997-ec72-4687-a941-d75d3e86af8d service cinder] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:49.304812 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1048/2107] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:49:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:49:49.342388 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c73e50-1fca-460e-b044-0692dfd23bbd None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:49.346770 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-92c73e50-1fca-460e-b044-0692dfd23bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:49.471467 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea4a997-ec72-4687-a941-d75d3e86af8d service cinder] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:49.472790 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c73e50-1fca-460e-b044-0692dfd23bbd None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:49.473225 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-1ea4a997-ec72-4687-a941-d75d3e86af8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:49.478930 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38b358-03ba-4968-8b53-bfdceb779768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:49.479675 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38b358-03ba-4968-8b53-bfdceb779768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:49.479960 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38b358-03ba-4968-8b53-bfdceb779768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:49.480339 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38b358-03ba-4968-8b53-bfdceb779768 admin admin] PATH_INFO: `/v3/users/343e5ae005fd4194a3a04a14384ae7e1` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:49.482508 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d38b358-03ba-4968-8b53-bfdceb779768 admin admin] RBAC: Authorizing `identity:delete_user(user_id=343e5ae005fd4194a3a04a14384ae7e1)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:49.486581 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d38b358-03ba-4968-8b53-bfdceb779768 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:49.517097 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea4a997-ec72-4687-a941-d75d3e86af8d service cinder] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:49.536727 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c7669-9ee3-4a84-bad4-7c5126f264b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:49.537498 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c7669-9ee3-4a84-bad4-7c5126f264b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:49.537709 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c7669-9ee3-4a84-bad4-7c5126f264b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:49.538060 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c7669-9ee3-4a84-bad4-7c5126f264b4 admin admin] PATH_INFO: `/v3/projects/558a4a331aa1458d929c85e55b1d05e4` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:49.547871 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006c7669-9ee3-4a84-bad4-7c5126f264b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=558a4a331aa1458d929c85e55b1d05e4)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:49.549853 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006c7669-9ee3-4a84-bad4-7c5126f264b4 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:49.556944 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:49.737839 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-3d38b358-03ba-4968-8b53-bfdceb779768 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '343e5ae005fd4194a3a04a14384ae7e1'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:49.742610 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-006c7669-9ee3-4a84-bad4-7c5126f264b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '558a4a331aa1458d929c85e55b1d05e4', 'request_id': 'req-006c7669-9ee3-4a84-bad4-7c5126f264b4'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:49.881508 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-3d38b358-03ba-4968-8b53-bfdceb779768 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '343e5ae005fd4194a3a04a14384ae7e1'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:49.893877 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-3d38b358-03ba-4968-8b53-bfdceb779768 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '343e5ae005fd4194a3a04a14384ae7e1'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:49.928424 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-3d38b358-03ba-4968-8b53-bfdceb779768 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '343e5ae005fd4194a3a04a14384ae7e1'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:49.930800 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-3d38b358-03ba-4968-8b53-bfdceb779768 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '343e5ae005fd4194a3a04a14384ae7e1'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:49.939204 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-006c7669-9ee3-4a84-bad4-7c5126f264b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '558a4a331aa1458d929c85e55b1d05e4', 'request_id': 'req-006c7669-9ee3-4a84-bad4-7c5126f264b4'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:49.946529 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1060/2108] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:49:49 2022] DELETE /identity/v3/users/343e5ae005fd4194a3a04a14384ae7e1 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:49:49.954317 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cbe4d0-5abd-4bc8-b5a1-d6638002b61b None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:49.954651 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-006c7669-9ee3-4a84-bad4-7c5126f264b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '558a4a331aa1458d929c85e55b1d05e4', 'request_id': 'req-006c7669-9ee3-4a84-bad4-7c5126f264b4'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:49.956164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cbe4d0-5abd-4bc8-b5a1-d6638002b61b None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:49.957802 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cbe4d0-5abd-4bc8-b5a1-d6638002b61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:49.973636 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-006c7669-9ee3-4a84-bad4-7c5126f264b4 admin admin] The token cache is being invalidate because project 558a4a331aa1458d929c85e55b1d05e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:49:49.974234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-006c7669-9ee3-4a84-bad4-7c5126f264b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:49.975196 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-006c7669-9ee3-4a84-bad4-7c5126f264b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:49.977031 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1049/2109] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:49:49 2022] DELETE /identity/v3/projects/558a4a331aa1458d929c85e55b1d05e4 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:49:49.982124 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8b4bd-7ffc-4b98-8d2e-9bf622b57606 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:49.982734 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8b4bd-7ffc-4b98-8d2e-9bf622b57606 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:49.983250 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8b4bd-7ffc-4b98-8d2e-9bf622b57606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:50.004351 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-39cbe4d0-5abd-4bc8-b5a1-d6638002b61b None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:50.005612 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-39cbe4d0-5abd-4bc8-b5a1-d6638002b61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:50.016940 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-73a8b4bd-7ffc-4b98-8d2e-9bf622b57606 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:50.018329 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-73a8b4bd-7ffc-4b98-8d2e-9bf622b57606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:50.060497 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:50.139296 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1050/2110] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:49:50.149532 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd73c5-1f80-45b1-a3e0-ef4cdf4c78a2 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:50.150131 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd73c5-1f80-45b1-a3e0-ef4cdf4c78a2 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:50.155502 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd73c5-1f80-45b1-a3e0-ef4cdf4c78a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:50.191816 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-1fdd73c5-1f80-45b1-a3e0-ef4cdf4c78a2 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:50.193314 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-1fdd73c5-1f80-45b1-a3e0-ef4cdf4c78a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:50.205247 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1051/2111] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:49:50.209866 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd73c5-1f80-45b1-a3e0-ef4cdf4c78a2 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:50.224611 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1061/2112] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:49:50.227546 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd73c5-1f80-45b1-a3e0-ef4cdf4c78a2 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:50.231472 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cbe4d0-5abd-4bc8-b5a1-d6638002b61b None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:50.234046 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41bc8e2-4045-4370-b3ed-d57522e58612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:50.234808 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41bc8e2-4045-4370-b3ed-d57522e58612 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:50.235168 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41bc8e2-4045-4370-b3ed-d57522e58612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:50.235673 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41bc8e2-4045-4370-b3ed-d57522e58612 admin admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:50.236407 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-39cbe4d0-5abd-4bc8-b5a1-d6638002b61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:50.236529 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41bc8e2-4045-4370-b3ed-d57522e58612 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:49:50.236898 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41bc8e2-4045-4370-b3ed-d57522e58612 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:50.239610 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41bc8e2-4045-4370-b3ed-d57522e58612 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:50.260674 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1052/2113] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:49:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:49:50.267011 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41bc8e2-4045-4370-b3ed-d57522e58612 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:50.299694 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41bc8e2-4045-4370-b3ed-d57522e58612 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:50.314248 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37427773-2ec0-4249-b00f-ad458383c78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:50.314248 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37427773-2ec0-4249-b00f-ad458383c78b admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:50.314248 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37427773-2ec0-4249-b00f-ad458383c78b admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:50.314248 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37427773-2ec0-4249-b00f-ad458383c78b admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:50.314668 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37427773-2ec0-4249-b00f-ad458383c78b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:50.314668 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37427773-2ec0-4249-b00f-ad458383c78b admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:50.406377 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cbe4d0-5abd-4bc8-b5a1-d6638002b61b None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:50.423941 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1053/2114] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:49:50 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:49:50.424763 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234f802-2cca-4b55-8855-36c0a61931f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:50.425613 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234f802-2cca-4b55-8855-36c0a61931f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:50.425981 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234f802-2cca-4b55-8855-36c0a61931f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:50.426480 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234f802-2cca-4b55-8855-36c0a61931f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:50.428114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37427773-2ec0-4249-b00f-ad458383c78b admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:50.460566 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b234f802-2cca-4b55-8855-36c0a61931f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:50.466733 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b234f802-2cca-4b55-8855-36c0a61931f3 service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:50.506575 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1062/2115] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:49:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:49:50.538686 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:50.553775 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37427773-2ec0-4249-b00f-ad458383c78b admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:50.562356 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa721b-16b2-4914-975e-e5f0a2771348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:50.562356 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa721b-16b2-4914-975e-e5f0a2771348 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:50.562356 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa721b-16b2-4914-975e-e5f0a2771348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:50.562356 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa721b-16b2-4914-975e-e5f0a2771348 admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:50.563373 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aa721b-16b2-4914-975e-e5f0a2771348 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:50.565584 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aa721b-16b2-4914-975e-e5f0a2771348 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:50.652671 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1054/2116] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:49:50 2022] POST /identity/v3/users => generated 293 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:49:50.669568 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234f802-2cca-4b55-8855-36c0a61931f3 service neutron] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:50.682666 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234f802-2cca-4b55-8855-36c0a61931f3 service neutron] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:50.688965 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef1685-1d02-4ff7-b3a2-1a00ae95a699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:50.689926 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef1685-1d02-4ff7-b3a2-1a00ae95a699 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:50.690334 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef1685-1d02-4ff7-b3a2-1a00ae95a699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:50.690927 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef1685-1d02-4ff7-b3a2-1a00ae95a699 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:50.691811 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ef1685-1d02-4ff7-b3a2-1a00ae95a699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:50.694011 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ef1685-1d02-4ff7-b3a2-1a00ae95a699 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:50.709448 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1063/2117] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:49:50.720738 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa721b-16b2-4914-975e-e5f0a2771348 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:50.729077 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa721b-16b2-4914-975e-e5f0a2771348 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:50.744520 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5fe2c-a0f2-4ddc-89cd-fe125761939b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:50.745323 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5fe2c-a0f2-4ddc-89cd-fe125761939b admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:50.745708 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5fe2c-a0f2-4ddc-89cd-fe125761939b admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:50.746086 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5fe2c-a0f2-4ddc-89cd-fe125761939b admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:50.747567 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5fe2c-a0f2-4ddc-89cd-fe125761939b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:50.749479 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5fe2c-a0f2-4ddc-89cd-fe125761939b admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:50.778868 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1055/2118] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:49:50.781232 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef1685-1d02-4ff7-b3a2-1a00ae95a699 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:50.796061 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef1685-1d02-4ff7-b3a2-1a00ae95a699 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:50.805458 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f579c-b72f-4d50-9989-44d738704e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:50.806196 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f579c-b72f-4d50-9989-44d738704e73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:50.806484 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f579c-b72f-4d50-9989-44d738704e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:50.806768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f579c-b72f-4d50-9989-44d738704e73 admin admin] PATH_INFO: `/v3/projects/b5ca38d1e6f24c2b8fe3f1d2254b57ec/users/5ee1d27a3b6c4d45b8548736ead3f55e/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:50.833352 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099f579c-b72f-4d50-9989-44d738704e73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5ca38d1e6f24c2b8fe3f1d2254b57ec, user_id=5ee1d27a3b6c4d45b8548736ead3f55e, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:50.833352 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099f579c-b72f-4d50-9989-44d738704e73 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:50.948188 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1064/2119] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:49:50 2022] PUT /identity/v3/projects/b5ca38d1e6f24c2b8fe3f1d2254b57ec/users/5ee1d27a3b6c4d45b8548736ead3f55e/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:49:50.949583 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2018d81-409c-41c1-ab0e-9808689758b0 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:50.950061 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2018d81-409c-41c1-ab0e-9808689758b0 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:50.950332 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2018d81-409c-41c1-ab0e-9808689758b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:51.007480 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-e2018d81-409c-41c1-ab0e-9808689758b0 None None] MFA Rules not processed for user `5ee1d27a3b6c4d45b8548736ead3f55e`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:51.010549 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-e2018d81-409c-41c1-ab0e-9808689758b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:51.115775 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1056/2120] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:49:51.120807 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f579c-b72f-4d50-9989-44d738704e73 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:51.183096 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:51.213937 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2018d81-409c-41c1-ab0e-9808689758b0 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:51.216449 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-e2018d81-409c-41c1-ab0e-9808689758b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:51.275839 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f579c-b72f-4d50-9989-44d738704e73 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:51.287180 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf554869-2f05-41c6-aeb9-a46e3947783b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:51.287979 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf554869-2f05-41c6-aeb9-a46e3947783b admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:51.288104 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf554869-2f05-41c6-aeb9-a46e3947783b admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:51.291909 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf554869-2f05-41c6-aeb9-a46e3947783b admin admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:51.297764 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf554869-2f05-41c6-aeb9-a46e3947783b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:51.305754 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf554869-2f05-41c6-aeb9-a46e3947783b admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:51.397265 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2018d81-409c-41c1-ab0e-9808689758b0 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:51.431030 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62d249-419e-4582-9284-4b6fba6c70bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:51.431030 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62d249-419e-4582-9284-4b6fba6c70bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:51.431030 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62d249-419e-4582-9284-4b6fba6c70bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:51.431030 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62d249-419e-4582-9284-4b6fba6c70bf admin admin] PATH_INFO: `/v3/projects/863ebecb92fb404aa300505952fcc44c` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:51.431514 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62d249-419e-4582-9284-4b6fba6c70bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=863ebecb92fb404aa300505952fcc44c)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:51.431514 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62d249-419e-4582-9284-4b6fba6c70bf admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:51.972397 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1065/2121] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:49:51 2022] POST /identity/v3/projects => generated 385 bytes in 852 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:49:51.975085 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf554869-2f05-41c6-aeb9-a46e3947783b admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:52.012672 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-9e62d249-419e-4582-9284-4b6fba6c70bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '863ebecb92fb404aa300505952fcc44c', 'request_id': 'req-9e62d249-419e-4582-9284-4b6fba6c70bf'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:52.057356 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf554869-2f05-41c6-aeb9-a46e3947783b admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:52.114684 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-9e62d249-419e-4582-9284-4b6fba6c70bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '863ebecb92fb404aa300505952fcc44c', 'request_id': 'req-9e62d249-419e-4582-9284-4b6fba6c70bf'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:52.121563 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:52.123682 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-9e62d249-419e-4582-9284-4b6fba6c70bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '863ebecb92fb404aa300505952fcc44c', 'request_id': 'req-9e62d249-419e-4582-9284-4b6fba6c70bf'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:52.157272 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7fee32-3cfb-467a-8036-d3104a9a044e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:52.158180 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fee32-3cfb-467a-8036-d3104a9a044e admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:52.158652 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fee32-3cfb-467a-8036-d3104a9a044e admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:52.158989 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fee32-3cfb-467a-8036-d3104a9a044e admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:52.159740 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7fee32-3cfb-467a-8036-d3104a9a044e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:52.161790 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7fee32-3cfb-467a-8036-d3104a9a044e admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:52.167085 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-9e62d249-419e-4582-9284-4b6fba6c70bf admin admin] The token cache is being invalidate because project 863ebecb92fb404aa300505952fcc44c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:49:52.167440 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-9e62d249-419e-4582-9284-4b6fba6c70bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:52.168304 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-9e62d249-419e-4582-9284-4b6fba6c70bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:52.173607 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1057/2122] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:49:51 2022] DELETE /identity/v3/projects/863ebecb92fb404aa300505952fcc44c => generated 0 bytes in 957 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:49:52.175668 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4046b8-a033-43cb-b0be-336f661ccb2f None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:52.176008 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4046b8-a033-43cb-b0be-336f661ccb2f None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:52.176335 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4046b8-a033-43cb-b0be-336f661ccb2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:52.215099 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-8c4046b8-a033-43cb-b0be-336f661ccb2f None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:52.219911 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-8c4046b8-a033-43cb-b0be-336f661ccb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:52.242676 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1058/2123] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:49:52.251697 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6352e-3238-4c9b-85d1-b992fb015bfa None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:52.252212 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6352e-3238-4c9b-85d1-b992fb015bfa None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:52.252616 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6352e-3238-4c9b-85d1-b992fb015bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:52.299500 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-36d6352e-3238-4c9b-85d1-b992fb015bfa None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:52.307088 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1066/2124] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:49:51 2022] POST /identity/v3/users => generated 299 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:49:52.310695 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7fee32-3cfb-467a-8036-d3104a9a044e admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:52.313101 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-7d7fee32-3cfb-467a-8036-d3104a9a044e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:52.315420 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-36d6352e-3238-4c9b-85d1-b992fb015bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:52.333998 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1059/2125] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:49:52.342440 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7fee32-3cfb-467a-8036-d3104a9a044e admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:52.348530 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6352e-3238-4c9b-85d1-b992fb015bfa None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:52.358731 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501365f-8541-4d12-9835-dc27e6977273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:52.359389 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501365f-8541-4d12-9835-dc27e6977273 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:52.359666 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501365f-8541-4d12-9835-dc27e6977273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:52.359947 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501365f-8541-4d12-9835-dc27e6977273 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:52.360654 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4501365f-8541-4d12-9835-dc27e6977273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:52.362282 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4501365f-8541-4d12-9835-dc27e6977273 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:52.365929 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6352e-3238-4c9b-85d1-b992fb015bfa None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:52.372440 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9550a2c-c278-406e-8948-904932db784b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:52.375107 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9550a2c-c278-406e-8948-904932db784b admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:52.375107 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9550a2c-c278-406e-8948-904932db784b admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:52.375107 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9550a2c-c278-406e-8948-904932db784b admin admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:52.375107 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9550a2c-c278-406e-8948-904932db784b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:49:52.375107 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9550a2c-c278-406e-8948-904932db784b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:52.377371 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9550a2c-c278-406e-8948-904932db784b admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:52.392796 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1067/2126] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:49:52.393729 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501365f-8541-4d12-9835-dc27e6977273 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:52.403004 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1060/2127] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:49:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:49:52.411166 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9550a2c-c278-406e-8948-904932db784b admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:52.415118 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501365f-8541-4d12-9835-dc27e6977273 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:52.421544 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9550a2c-c278-406e-8948-904932db784b admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:52.426629 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018417bd-6380-4e87-8b1b-4902ea1ca353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:52.427301 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018417bd-6380-4e87-8b1b-4902ea1ca353 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:52.428045 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018417bd-6380-4e87-8b1b-4902ea1ca353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:52.428342 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018417bd-6380-4e87-8b1b-4902ea1ca353 admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:52.429497 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018417bd-6380-4e87-8b1b-4902ea1ca353 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:52.431547 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018417bd-6380-4e87-8b1b-4902ea1ca353 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:52.432649 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715896ab-3908-48a5-9172-3ca4304bee6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:52.433562 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715896ab-3908-48a5-9172-3ca4304bee6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:52.434457 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715896ab-3908-48a5-9172-3ca4304bee6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:52.434668 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715896ab-3908-48a5-9172-3ca4304bee6b admin admin] PATH_INFO: `/v3/projects/4d9d26ecccdc4ec4b76b8193cfc100f4/users/137ceb11e7164b9486c0b56566c79138/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:52.471819 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715896ab-3908-48a5-9172-3ca4304bee6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d9d26ecccdc4ec4b76b8193cfc100f4, user_id=137ceb11e7164b9486c0b56566c79138, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:52.474684 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715896ab-3908-48a5-9172-3ca4304bee6b admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:52.543897 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1061/2128] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:49:52 2022] POST /identity/v3/projects => generated 373 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:49:52.548266 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018417bd-6380-4e87-8b1b-4902ea1ca353 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:52.570277 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1068/2129] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:49:52 2022] PUT /identity/v3/projects/4d9d26ecccdc4ec4b76b8193cfc100f4/users/137ceb11e7164b9486c0b56566c79138/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:49:52.576478 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715896ab-3908-48a5-9172-3ca4304bee6b admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:52.601956 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:52.744210 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715896ab-3908-48a5-9172-3ca4304bee6b admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:52.753503 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018417bd-6380-4e87-8b1b-4902ea1ca353 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:52.768878 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9f8ce-47e2-4364-8e5b-2dcb9bb58214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:52.771960 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9f8ce-47e2-4364-8e5b-2dcb9bb58214 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:52.772995 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9f8ce-47e2-4364-8e5b-2dcb9bb58214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:52.774407 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9f8ce-47e2-4364-8e5b-2dcb9bb58214 admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:52.775392 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a267e-efd4-4e1b-aa48-ea096065bf61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:52.776390 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d9f8ce-47e2-4364-8e5b-2dcb9bb58214 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:52.778373 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a267e-efd4-4e1b-aa48-ea096065bf61 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:52.779964 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a267e-efd4-4e1b-aa48-ea096065bf61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:52.781186 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a267e-efd4-4e1b-aa48-ea096065bf61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:52.782628 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d9f8ce-47e2-4364-8e5b-2dcb9bb58214 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:52.783897 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a267e-efd4-4e1b-aa48-ea096065bf61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:52.786445 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a267e-efd4-4e1b-aa48-ea096065bf61 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:52.821683 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1069/2130] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:49:52.829954 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a267e-efd4-4e1b-aa48-ea096065bf61 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:52.854608 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a267e-efd4-4e1b-aa48-ea096065bf61 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:52.877351 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c19d2c2-f646-4642-a168-acb3faa9faf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:52.878518 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19d2c2-f646-4642-a168-acb3faa9faf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:52.879030 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19d2c2-f646-4642-a168-acb3faa9faf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:52.879603 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19d2c2-f646-4642-a168-acb3faa9faf1 admin admin] PATH_INFO: `/v3/projects/4d9d26ecccdc4ec4b76b8193cfc100f4/users/137ceb11e7164b9486c0b56566c79138/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:52.882480 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c19d2c2-f646-4642-a168-acb3faa9faf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d9d26ecccdc4ec4b76b8193cfc100f4, user_id=137ceb11e7164b9486c0b56566c79138, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:52.886788 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c19d2c2-f646-4642-a168-acb3faa9faf1 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:52.905305 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1070/2131] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:49:52 2022] PUT /identity/v3/projects/4d9d26ecccdc4ec4b76b8193cfc100f4/users/137ceb11e7164b9486c0b56566c79138/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:49:52.929334 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df3982-b8ba-4aca-a0aa-1d5844f94a0f None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:52.930570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df3982-b8ba-4aca-a0aa-1d5844f94a0f None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:52.931715 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df3982-b8ba-4aca-a0aa-1d5844f94a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:52.977370 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1062/2132] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:49:52 2022] POST /identity/v3/users => generated 287 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:49:52.978493 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9f8ce-47e2-4364-8e5b-2dcb9bb58214 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:52.998837 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-98df3982-b8ba-4aca-a0aa-1d5844f94a0f None None] MFA Rules not processed for user `137ceb11e7164b9486c0b56566c79138`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:53.000540 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-98df3982-b8ba-4aca-a0aa-1d5844f94a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:53.000937 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9f8ce-47e2-4364-8e5b-2dcb9bb58214 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:53.110194 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc48040-6bc4-44ae-a657-6e62373f829d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:53.110194 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc48040-6bc4-44ae-a657-6e62373f829d admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:53.110194 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc48040-6bc4-44ae-a657-6e62373f829d admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:53.110194 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc48040-6bc4-44ae-a657-6e62373f829d admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:53.111182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc48040-6bc4-44ae-a657-6e62373f829d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:53.111182 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc48040-6bc4-44ae-a657-6e62373f829d admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:53.122842 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1063/2133] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:49:53.124144 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc48040-6bc4-44ae-a657-6e62373f829d admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:53.135264 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc48040-6bc4-44ae-a657-6e62373f829d admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:53.145063 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ae87d-6b85-4ced-b40c-89b80e8cc58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:53.145944 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ae87d-6b85-4ced-b40c-89b80e8cc58b admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:53.146468 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ae87d-6b85-4ced-b40c-89b80e8cc58b admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:53.146915 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ae87d-6b85-4ced-b40c-89b80e8cc58b admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:53.148371 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5ae87d-6b85-4ced-b40c-89b80e8cc58b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:53.150188 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1071/2134] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:52 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:49:53.156811 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5ae87d-6b85-4ced-b40c-89b80e8cc58b admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:53.164936 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df3982-b8ba-4aca-a0aa-1d5844f94a0f None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:53.167486 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-98df3982-b8ba-4aca-a0aa-1d5844f94a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:53.172116 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1064/2135] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:49:53.176721 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ae87d-6b85-4ced-b40c-89b80e8cc58b admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:53.194757 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ae87d-6b85-4ced-b40c-89b80e8cc58b admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:53.202875 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7634cef-6a60-4fe6-b4db-0e407d8a51b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:53.203789 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7634cef-6a60-4fe6-b4db-0e407d8a51b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:53.204220 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7634cef-6a60-4fe6-b4db-0e407d8a51b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:53.204630 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7634cef-6a60-4fe6-b4db-0e407d8a51b6 admin admin] PATH_INFO: `/v3/projects/6cfd082bbc6e4283abd5e4abfbbc25aa/users/effd1c41a02140088a4713a7647b516e/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:53.229302 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7634cef-6a60-4fe6-b4db-0e407d8a51b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cfd082bbc6e4283abd5e4abfbbc25aa, user_id=effd1c41a02140088a4713a7647b516e, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:53.232879 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7634cef-6a60-4fe6-b4db-0e407d8a51b6 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:53.237637 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:53.283505 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df3982-b8ba-4aca-a0aa-1d5844f94a0f None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:53.289131 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cbad30-ce58-4261-a6f8-095bf2c4f8ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:53.291109 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbad30-ce58-4261-a6f8-095bf2c4f8ce service cinder] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:53.292655 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbad30-ce58-4261-a6f8-095bf2c4f8ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:53.294189 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbad30-ce58-4261-a6f8-095bf2c4f8ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:53.303523 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1065/2136] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:49:53 2022] PUT /identity/v3/projects/6cfd082bbc6e4283abd5e4abfbbc25aa/users/effd1c41a02140088a4713a7647b516e/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:49:53.325287 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee518524-f910-418a-bbb2-c4b5178c9941 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:53.325287 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee518524-f910-418a-bbb2-c4b5178c9941 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:53.325287 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee518524-f910-418a-bbb2-c4b5178c9941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:53.331182 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cbad30-ce58-4261-a6f8-095bf2c4f8ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:53.333609 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cbad30-ce58-4261-a6f8-095bf2c4f8ce service cinder] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:53.354115 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1072/2137] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:49:53 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:49:53.390463 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-ee518524-f910-418a-bbb2-c4b5178c9941 None None] MFA Rules not processed for user `effd1c41a02140088a4713a7647b516e`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:53.393739 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-ee518524-f910-418a-bbb2-c4b5178c9941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:53.448722 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cbad30-ce58-4261-a6f8-095bf2c4f8ce service cinder] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:53.469406 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cbad30-ce58-4261-a6f8-095bf2c4f8ce service cinder] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:53.515662 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:53.543017 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1066/2138] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:49:53.553525 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee518524-f910-418a-bbb2-c4b5178c9941 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:53.590806 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acd0438-c6e1-4229-a6b4-8f03ad47b5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:53.591953 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd0438-c6e1-4229-a6b4-8f03ad47b5e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:53.592788 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd0438-c6e1-4229-a6b4-8f03ad47b5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:53.593723 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd0438-c6e1-4229-a6b4-8f03ad47b5e6 admin admin] PATH_INFO: `/v3/users/5ee1d27a3b6c4d45b8548736ead3f55e` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:53.601530 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acd0438-c6e1-4229-a6b4-8f03ad47b5e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ee1d27a3b6c4d45b8548736ead3f55e)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:53.607445 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acd0438-c6e1-4229-a6b4-8f03ad47b5e6 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:53.630080 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee518524-f910-418a-bbb2-c4b5178c9941 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:53.635657 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a8dc1-5231-44ad-8123-5a47c7453763 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:53.636294 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a8dc1-5231-44ad-8123-5a47c7453763 service cinder] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:53.636578 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a8dc1-5231-44ad-8123-5a47c7453763 service cinder] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:53.637395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a8dc1-5231-44ad-8123-5a47c7453763 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:53.654391 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a8dc1-5231-44ad-8123-5a47c7453763 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:53.656174 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a8dc1-5231-44ad-8123-5a47c7453763 service cinder] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:53.670105 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1067/2139] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:49:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:49:53.866671 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-1acd0438-c6e1-4229-a6b4-8f03ad47b5e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ee1d27a3b6c4d45b8548736ead3f55e'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:53.972147 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-1acd0438-c6e1-4229-a6b4-8f03ad47b5e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ee1d27a3b6c4d45b8548736ead3f55e'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:53.981937 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-1acd0438-c6e1-4229-a6b4-8f03ad47b5e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ee1d27a3b6c4d45b8548736ead3f55e'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:54.001289 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-1acd0438-c6e1-4229-a6b4-8f03ad47b5e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ee1d27a3b6c4d45b8548736ead3f55e'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:54.002823 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-1acd0438-c6e1-4229-a6b4-8f03ad47b5e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ee1d27a3b6c4d45b8548736ead3f55e'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:54.012985 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1073/2140] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:49:53 2022] DELETE /identity/v3/users/5ee1d27a3b6c4d45b8548736ead3f55e => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:49:54.021012 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5aff07-3dcd-4834-8dbf-fc179622a1d6 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:54.021012 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5aff07-3dcd-4834-8dbf-fc179622a1d6 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:54.021012 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5aff07-3dcd-4834-8dbf-fc179622a1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:54.044711 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-bc5aff07-3dcd-4834-8dbf-fc179622a1d6 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:54.046374 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-bc5aff07-3dcd-4834-8dbf-fc179622a1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:54.189858 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1068/2141] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:49:54.200439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acd0438-c6e1-4229-a6b4-8f03ad47b5e6 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:54.203199 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-1acd0438-c6e1-4229-a6b4-8f03ad47b5e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:54.367430 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acd0438-c6e1-4229-a6b4-8f03ad47b5e6 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:54.373066 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816feec-2de2-40f8-b7a1-aacf27ae12a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:54.373958 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816feec-2de2-40f8-b7a1-aacf27ae12a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:54.374404 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816feec-2de2-40f8-b7a1-aacf27ae12a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:54.374901 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816feec-2de2-40f8-b7a1-aacf27ae12a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:54.400238 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816feec-2de2-40f8-b7a1-aacf27ae12a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:54.402538 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816feec-2de2-40f8-b7a1-aacf27ae12a2 service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:54.417373 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1074/2142] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:49:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:49:55.100928 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5aff07-3dcd-4834-8dbf-fc179622a1d6 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:55.103090 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-bc5aff07-3dcd-4834-8dbf-fc179622a1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:55.126303 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5aff07-3dcd-4834-8dbf-fc179622a1d6 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:55.130614 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820cf88a-b8f2-4cc6-acd9-61451b22c16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:55.131473 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820cf88a-b8f2-4cc6-acd9-61451b22c16f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:55.131781 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820cf88a-b8f2-4cc6-acd9-61451b22c16f admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:55.132505 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820cf88a-b8f2-4cc6-acd9-61451b22c16f admin admin] PATH_INFO: `/v3/projects/b5ca38d1e6f24c2b8fe3f1d2254b57ec` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:55.134016 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820cf88a-b8f2-4cc6-acd9-61451b22c16f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5ca38d1e6f24c2b8fe3f1d2254b57ec)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:55.148080 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820cf88a-b8f2-4cc6-acd9-61451b22c16f admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:55.183643 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:55.303126 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-820cf88a-b8f2-4cc6-acd9-61451b22c16f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5ca38d1e6f24c2b8fe3f1d2254b57ec', 'request_id': 'req-820cf88a-b8f2-4cc6-acd9-61451b22c16f'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:55.389000 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-820cf88a-b8f2-4cc6-acd9-61451b22c16f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5ca38d1e6f24c2b8fe3f1d2254b57ec', 'request_id': 'req-820cf88a-b8f2-4cc6-acd9-61451b22c16f'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:55.397117 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-820cf88a-b8f2-4cc6-acd9-61451b22c16f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5ca38d1e6f24c2b8fe3f1d2254b57ec', 'request_id': 'req-820cf88a-b8f2-4cc6-acd9-61451b22c16f'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:55.415523 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-820cf88a-b8f2-4cc6-acd9-61451b22c16f admin admin] The token cache is being invalidate because project b5ca38d1e6f24c2b8fe3f1d2254b57ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:49:55.419714 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-820cf88a-b8f2-4cc6-acd9-61451b22c16f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:55.439165 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-820cf88a-b8f2-4cc6-acd9-61451b22c16f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:55.448905 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1069/2143] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:49:55 2022] DELETE /identity/v3/projects/b5ca38d1e6f24c2b8fe3f1d2254b57ec => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:49:55.453717 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816feec-2de2-40f8-b7a1-aacf27ae12a2 service neutron] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:55.470469 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816feec-2de2-40f8-b7a1-aacf27ae12a2 service neutron] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:55.531731 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:55.570907 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5732779-0d60-410e-98f7-a81a5eece1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:55.571340 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5732779-0d60-410e-98f7-a81a5eece1c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:55.571646 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5732779-0d60-410e-98f7-a81a5eece1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:55.571927 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5732779-0d60-410e-98f7-a81a5eece1c0 admin admin] PATH_INFO: `/v3/users/137ceb11e7164b9486c0b56566c79138` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:55.575745 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5732779-0d60-410e-98f7-a81a5eece1c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=137ceb11e7164b9486c0b56566c79138)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:55.577793 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5732779-0d60-410e-98f7-a81a5eece1c0 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:55.887277 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-b5732779-0d60-410e-98f7-a81a5eece1c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '137ceb11e7164b9486c0b56566c79138'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:55.989167 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-b5732779-0d60-410e-98f7-a81a5eece1c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '137ceb11e7164b9486c0b56566c79138'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:56.000028 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-b5732779-0d60-410e-98f7-a81a5eece1c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '137ceb11e7164b9486c0b56566c79138'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:56.038761 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-b5732779-0d60-410e-98f7-a81a5eece1c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '137ceb11e7164b9486c0b56566c79138'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:56.041277 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-b5732779-0d60-410e-98f7-a81a5eece1c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '137ceb11e7164b9486c0b56566c79138'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:56.060353 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1075/2144] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:49:55 2022] DELETE /identity/v3/users/137ceb11e7164b9486c0b56566c79138 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:49:57.600939 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820cf88a-b8f2-4cc6-acd9-61451b22c16f admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:57.602404 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-820cf88a-b8f2-4cc6-acd9-61451b22c16f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:57.620525 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820cf88a-b8f2-4cc6-acd9-61451b22c16f admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:57.724705 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d893b-e4d9-41d7-947b-666cc09f631b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:57.725666 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d893b-e4d9-41d7-947b-666cc09f631b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:57.726118 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d893b-e4d9-41d7-947b-666cc09f631b admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:57.726676 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d893b-e4d9-41d7-947b-666cc09f631b admin admin] PATH_INFO: `/v3/projects/4d9d26ecccdc4ec4b76b8193cfc100f4` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:57.728166 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69d893b-e4d9-41d7-947b-666cc09f631b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d9d26ecccdc4ec4b76b8193cfc100f4)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:57.730345 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69d893b-e4d9-41d7-947b-666cc09f631b admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:57.973994 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-e69d893b-e4d9-41d7-947b-666cc09f631b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d9d26ecccdc4ec4b76b8193cfc100f4', 'request_id': 'req-e69d893b-e4d9-41d7-947b-666cc09f631b'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:58.074133 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-e69d893b-e4d9-41d7-947b-666cc09f631b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d9d26ecccdc4ec4b76b8193cfc100f4', 'request_id': 'req-e69d893b-e4d9-41d7-947b-666cc09f631b'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:58.084710 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-e69d893b-e4d9-41d7-947b-666cc09f631b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d9d26ecccdc4ec4b76b8193cfc100f4', 'request_id': 'req-e69d893b-e4d9-41d7-947b-666cc09f631b'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:58.136600 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-e69d893b-e4d9-41d7-947b-666cc09f631b admin admin] The token cache is being invalidate because project 4d9d26ecccdc4ec4b76b8193cfc100f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:49:58.136984 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-e69d893b-e4d9-41d7-947b-666cc09f631b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:58.137771 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-e69d893b-e4d9-41d7-947b-666cc09f631b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:49:58.145141 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1070/2145] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:49:57 2022] DELETE /identity/v3/projects/4d9d26ecccdc4ec4b76b8193cfc100f4 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:49:58.145334 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c0561-9f89-4a75-8761-8f07457d7a47 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:58.149649 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c0561-9f89-4a75-8761-8f07457d7a47 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:58.149649 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c0561-9f89-4a75-8761-8f07457d7a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:58.177450 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-811c0561-9f89-4a75-8761-8f07457d7a47 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:58.179186 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-811c0561-9f89-4a75-8761-8f07457d7a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:58.337871 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1076/2146] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:49:58.347753 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9d336-d2b6-41d8-8848-35dae1159a7c None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:58.348174 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9d336-d2b6-41d8-8848-35dae1159a7c None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:58.348556 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9d336-d2b6-41d8-8848-35dae1159a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:58.387743 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-44d9d336-d2b6-41d8-8848-35dae1159a7c None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:58.389083 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-44d9d336-d2b6-41d8-8848-35dae1159a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:58.399222 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1071/2147] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:49:58.404533 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c0561-9f89-4a75-8761-8f07457d7a47 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:58.420625 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c0561-9f89-4a75-8761-8f07457d7a47 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:58.428080 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88506f69-fea4-4158-99a6-40cb0d410ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:58.429004 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88506f69-fea4-4158-99a6-40cb0d410ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:58.429451 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88506f69-fea4-4158-99a6-40cb0d410ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:58.429897 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88506f69-fea4-4158-99a6-40cb0d410ea5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:58.430841 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88506f69-fea4-4158-99a6-40cb0d410ea5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:49:58.431346 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88506f69-fea4-4158-99a6-40cb0d410ea5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:58.433208 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88506f69-fea4-4158-99a6-40cb0d410ea5 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:58.466251 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1077/2148] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:49:58.470690 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9d336-d2b6-41d8-8848-35dae1159a7c None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:58.497497 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9d336-d2b6-41d8-8848-35dae1159a7c None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:58.508339 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4340f96d-7ab0-42f5-bec2-c3aa4401ab41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:58.509030 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340f96d-7ab0-42f5-bec2-c3aa4401ab41 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:58.509322 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340f96d-7ab0-42f5-bec2-c3aa4401ab41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:58.509582 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340f96d-7ab0-42f5-bec2-c3aa4401ab41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:58.510721 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4340f96d-7ab0-42f5-bec2-c3aa4401ab41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:58.513156 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4340f96d-7ab0-42f5-bec2-c3aa4401ab41 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:58.637519 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1072/2149] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:49:58 2022] POST /identity/v3/projects => generated 391 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:49:58.638796 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88506f69-fea4-4158-99a6-40cb0d410ea5 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:58.653848 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88506f69-fea4-4158-99a6-40cb0d410ea5 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:58.808626 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:58.853859 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e29c5c-7a77-426d-8e4c-4db93a210ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:58.853859 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e29c5c-7a77-426d-8e4c-4db93a210ec0 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:58.853859 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e29c5c-7a77-426d-8e4c-4db93a210ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:58.853859 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e29c5c-7a77-426d-8e4c-4db93a210ec0 admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:58.854287 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e29c5c-7a77-426d-8e4c-4db93a210ec0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:58.854287 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e29c5c-7a77-426d-8e4c-4db93a210ec0 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:58.982295 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1078/2150] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:49:58 2022] POST /identity/v3/users => generated 296 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:49:58.983630 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4340f96d-7ab0-42f5-bec2-c3aa4401ab41 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:58.999083 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4340f96d-7ab0-42f5-bec2-c3aa4401ab41 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:59.013476 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514676c-5acc-45c2-bf3f-0d8eb26f22f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:59.015803 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514676c-5acc-45c2-bf3f-0d8eb26f22f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:59.016313 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514676c-5acc-45c2-bf3f-0d8eb26f22f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:59.017909 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514676c-5acc-45c2-bf3f-0d8eb26f22f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:59.019214 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3514676c-5acc-45c2-bf3f-0d8eb26f22f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:59.022615 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3514676c-5acc-45c2-bf3f-0d8eb26f22f0 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:59.046346 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:49:59.054518 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1073/2151] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:49:59.058416 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e29c5c-7a77-426d-8e4c-4db93a210ec0 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:59.071822 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e29c5c-7a77-426d-8e4c-4db93a210ec0 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:59.082311 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a946db90-8a9a-48cb-94ab-f68bbc450ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:59.082943 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946db90-8a9a-48cb-94ab-f68bbc450ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:59.083474 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946db90-8a9a-48cb-94ab-f68bbc450ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:59.085540 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946db90-8a9a-48cb-94ab-f68bbc450ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:59.086324 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a946db90-8a9a-48cb-94ab-f68bbc450ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:59.093383 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a946db90-8a9a-48cb-94ab-f68bbc450ed5 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:59.118904 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1079/2152] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:49:59.122987 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514676c-5acc-45c2-bf3f-0d8eb26f22f0 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:59.133661 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514676c-5acc-45c2-bf3f-0d8eb26f22f0 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:59.140280 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb291d2-cee3-4483-8b04-e76b80f43096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:59.141150 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb291d2-cee3-4483-8b04-e76b80f43096 admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:59.141593 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb291d2-cee3-4483-8b04-e76b80f43096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:59.142033 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb291d2-cee3-4483-8b04-e76b80f43096 admin admin] PATH_INFO: `/v3/projects/08d8989d3c4046c6a74727af242ee3f0/users/d08227b3e43f4c699f177abde62c4313/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:59.166483 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb291d2-cee3-4483-8b04-e76b80f43096 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08d8989d3c4046c6a74727af242ee3f0, user_id=d08227b3e43f4c699f177abde62c4313, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:59.173395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb291d2-cee3-4483-8b04-e76b80f43096 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:59.260346 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1074/2153] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:49:59 2022] PUT /identity/v3/projects/08d8989d3c4046c6a74727af242ee3f0/users/d08227b3e43f4c699f177abde62c4313/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:49:59.270466 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47822b76-3c41-4cc5-9fa4-062a38cb9059 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:59.270941 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47822b76-3c41-4cc5-9fa4-062a38cb9059 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:59.271223 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47822b76-3c41-4cc5-9fa4-062a38cb9059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:59.307958 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-47822b76-3c41-4cc5-9fa4-062a38cb9059 None None] MFA Rules not processed for user `d08227b3e43f4c699f177abde62c4313`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:59.310002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-47822b76-3c41-4cc5-9fa4-062a38cb9059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:59.427670 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1080/2154] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:59 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:49:59.432415 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb291d2-cee3-4483-8b04-e76b80f43096 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:59.603230 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb291d2-cee3-4483-8b04-e76b80f43096 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:59.610720 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f21235-00ca-4484-87e7-9c2a0953d566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:59.612236 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f21235-00ca-4484-87e7-9c2a0953d566 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:59.612515 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f21235-00ca-4484-87e7-9c2a0953d566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:59.612802 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f21235-00ca-4484-87e7-9c2a0953d566 admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:59.613986 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f21235-00ca-4484-87e7-9c2a0953d566 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:59.616738 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f21235-00ca-4484-87e7-9c2a0953d566 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:59.721919 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce34ff-10b2-4a86-a07b-b6633932f53e None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:59.722469 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce34ff-10b2-4a86-a07b-b6633932f53e None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:59.722928 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce34ff-10b2-4a86-a07b-b6633932f53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:59.747430 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-97ce34ff-10b2-4a86-a07b-b6633932f53e None None] MFA Rules not processed for user `4033953c81e5494ea03a7031df9ddcc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:49:59.749003 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-97ce34ff-10b2-4a86-a07b-b6633932f53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:49:59.813254 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1075/2155] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:49:59 2022] POST /identity/v3/projects => generated 391 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:49:59.817264 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f21235-00ca-4484-87e7-9c2a0953d566 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:59.821737 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1081/2156] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:49:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:49:59.891900 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f21235-00ca-4484-87e7-9c2a0953d566 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:49:59.896904 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a63b8-5547-47b5-8795-5369c4e8b08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:49:59.902763 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a63b8-5547-47b5-8795-5369c4e8b08e admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:49:59.902763 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a63b8-5547-47b5-8795-5369c4e8b08e admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:49:59.902763 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a63b8-5547-47b5-8795-5369c4e8b08e admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:49:59.902763 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a63b8-5547-47b5-8795-5369c4e8b08e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:49:59.902763 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a63b8-5547-47b5-8795-5369c4e8b08e admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:49:59.979389 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1076/2157] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:49:59 2022] POST /identity/v3/users => generated 302 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:49:59.983879 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce34ff-10b2-4a86-a07b-b6633932f53e None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:49:59.995207 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce34ff-10b2-4a86-a07b-b6633932f53e None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:00.010850 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5011ef3-ce54-4299-88c3-0794db69e90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:00.011571 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5011ef3-ce54-4299-88c3-0794db69e90c admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:00.011859 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5011ef3-ce54-4299-88c3-0794db69e90c admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:00.012140 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5011ef3-ce54-4299-88c3-0794db69e90c admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:00.012851 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5011ef3-ce54-4299-88c3-0794db69e90c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:00.014557 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5011ef3-ce54-4299-88c3-0794db69e90c admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:00.025278 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1082/2158] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:50:00.030147 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a63b8-5547-47b5-8795-5369c4e8b08e admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:00.045144 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a63b8-5547-47b5-8795-5369c4e8b08e admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:00.054228 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288e987-8e57-42b6-967c-22797f149cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:00.055041 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288e987-8e57-42b6-967c-22797f149cc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:00.055375 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288e987-8e57-42b6-967c-22797f149cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:00.055665 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288e987-8e57-42b6-967c-22797f149cc8 admin admin] PATH_INFO: `/v3/projects/ef6341ab7e4d492297ff7cfd81e8f52b/users/8c6bd1dd30ca48f0a8d0ed5803c6b539/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:00.088484 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8288e987-8e57-42b6-967c-22797f149cc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef6341ab7e4d492297ff7cfd81e8f52b, user_id=8c6bd1dd30ca48f0a8d0ed5803c6b539, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:00.093504 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8288e987-8e57-42b6-967c-22797f149cc8 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:00.219870 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1077/2159] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:50:00 2022] PUT /identity/v3/projects/ef6341ab7e4d492297ff7cfd81e8f52b/users/8c6bd1dd30ca48f0a8d0ed5803c6b539/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:50:00.220365 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5011ef3-ce54-4299-88c3-0794db69e90c admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:00.233528 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5011ef3-ce54-4299-88c3-0794db69e90c admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:00.369171 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:50:00.421489 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7fda1f-0af1-4e6d-a3d6-b6e4da8dca47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:00.422144 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fda1f-0af1-4e6d-a3d6-b6e4da8dca47 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:00.422426 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fda1f-0af1-4e6d-a3d6-b6e4da8dca47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:00.422700 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fda1f-0af1-4e6d-a3d6-b6e4da8dca47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:00.423451 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7fda1f-0af1-4e6d-a3d6-b6e4da8dca47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:00.428565 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7fda1f-0af1-4e6d-a3d6-b6e4da8dca47 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:00.450401 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1083/2160] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:50:00.455024 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288e987-8e57-42b6-967c-22797f149cc8 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:00.468786 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288e987-8e57-42b6-967c-22797f149cc8 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:00.473824 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6fdc2-6817-4128-ae40-035f2ad38b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:00.474658 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6fdc2-6817-4128-ae40-035f2ad38b22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:00.474976 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6fdc2-6817-4128-ae40-035f2ad38b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:00.475254 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6fdc2-6817-4128-ae40-035f2ad38b22 admin admin] PATH_INFO: `/v3/projects/ef6341ab7e4d492297ff7cfd81e8f52b/users/8c6bd1dd30ca48f0a8d0ed5803c6b539/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:00.477870 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc6fdc2-6817-4128-ae40-035f2ad38b22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef6341ab7e4d492297ff7cfd81e8f52b, user_id=8c6bd1dd30ca48f0a8d0ed5803c6b539, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:00.480847 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc6fdc2-6817-4128-ae40-035f2ad38b22 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:00.493317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1078/2161] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:50:00 2022] PUT /identity/v3/projects/ef6341ab7e4d492297ff7cfd81e8f52b/users/8c6bd1dd30ca48f0a8d0ed5803c6b539/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:50:00.504542 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d01d65-e081-4a26-a2d3-03b65314d889 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:00.504692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d01d65-e081-4a26-a2d3-03b65314d889 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:00.505002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d01d65-e081-4a26-a2d3-03b65314d889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:00.539720 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-e4d01d65-e081-4a26-a2d3-03b65314d889 None None] MFA Rules not processed for user `8c6bd1dd30ca48f0a8d0ed5803c6b539`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:50:00.543010 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-e4d01d65-e081-4a26-a2d3-03b65314d889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:00.675254 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1084/2162] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:50:00 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:50:00.695040 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6fdc2-6817-4128-ae40-035f2ad38b22 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:00.698145 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-adc6fdc2-6817-4128-ae40-035f2ad38b22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:00.730356 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:50:00.871778 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6fdc2-6817-4128-ae40-035f2ad38b22 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:00.894521 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4e602-438a-4537-a327-c8f94c9a79c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:00.896019 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4e602-438a-4537-a327-c8f94c9a79c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:00.896314 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4e602-438a-4537-a327-c8f94c9a79c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:00.896597 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4e602-438a-4537-a327-c8f94c9a79c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:00.964475 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e4e602-438a-4537-a327-c8f94c9a79c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:00.966478 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e4e602-438a-4537-a327-c8f94c9a79c3 service cinder] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:00.987412 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1079/2163] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:50:00 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:50:01.124158 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d01d65-e081-4a26-a2d3-03b65314d889 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:01.126347 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-e4d01d65-e081-4a26-a2d3-03b65314d889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:01.141844 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d01d65-e081-4a26-a2d3-03b65314d889 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:01.152389 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f4dfd5-f5f3-4e13-8ff0-7453e24f704b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:01.158908 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4dfd5-f5f3-4e13-8ff0-7453e24f704b service cinder] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:01.160890 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4dfd5-f5f3-4e13-8ff0-7453e24f704b service cinder] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:01.161193 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4dfd5-f5f3-4e13-8ff0-7453e24f704b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:01.254472 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f4dfd5-f5f3-4e13-8ff0-7453e24f704b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:01.256015 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f4dfd5-f5f3-4e13-8ff0-7453e24f704b service cinder] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:01.266438 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1085/2164] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:50:01 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:50:01.635994 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd98f1b-c0b9-4847-83f2-92a6e396d0bc None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:01.636566 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd98f1b-c0b9-4847-83f2-92a6e396d0bc None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:01.638347 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd98f1b-c0b9-4847-83f2-92a6e396d0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:01.662527 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-0bd98f1b-c0b9-4847-83f2-92a6e396d0bc None None] MFA Rules not processed for user `6bea520676244effbbe212aa62b1cc68`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:50:01.663778 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-0bd98f1b-c0b9-4847-83f2-92a6e396d0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:01.760535 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1080/2165] 10.222.0.42 () {58 vars in 967 bytes} [Fri Aug 5 02:50:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:50:01.814866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f4dfd5-f5f3-4e13-8ff0-7453e24f704b service cinder] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:01.818085 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-47f4dfd5-f5f3-4e13-8ff0-7453e24f704b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:01.905513 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f4dfd5-f5f3-4e13-8ff0-7453e24f704b service cinder] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:01.910998 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc8865-5a54-4f03-800e-0599d2657675 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40f706f1eb2b4137afd367cb5060ced0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:01.911736 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc8865-5a54-4f03-800e-0599d2657675 service swift] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:01.912016 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc8865-5a54-4f03-800e-0599d2657675 service swift] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:01.912291 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc8865-5a54-4f03-800e-0599d2657675 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:01.928768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc8865-5a54-4f03-800e-0599d2657675 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:01.931038 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc8865-5a54-4f03-800e-0599d2657675 service swift] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:01.942003 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1086/2166] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 5 02:50:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 02:50:05.830986 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd98f1b-c0b9-4847-83f2-92a6e396d0bc None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:05.832956 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-0bd98f1b-c0b9-4847-83f2-92a6e396d0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:05.926099 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd98f1b-c0b9-4847-83f2-92a6e396d0bc None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:05.932569 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d1e9c-b33d-4e59-a5b1-0a3db44315e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:05.934122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d1e9c-b33d-4e59-a5b1-0a3db44315e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:05.934410 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d1e9c-b33d-4e59-a5b1-0a3db44315e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:05.934686 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d1e9c-b33d-4e59-a5b1-0a3db44315e0 admin admin] PATH_INFO: `/v3/users/6036c9d5cf264f8995735430e1bbb448` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:05.935982 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5d1e9c-b33d-4e59-a5b1-0a3db44315e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6036c9d5cf264f8995735430e1bbb448)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:05.938117 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5d1e9c-b33d-4e59-a5b1-0a3db44315e0 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:06.211627 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-cd5d1e9c-b33d-4e59-a5b1-0a3db44315e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6036c9d5cf264f8995735430e1bbb448'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:06.302547 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-cd5d1e9c-b33d-4e59-a5b1-0a3db44315e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6036c9d5cf264f8995735430e1bbb448'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:06.311043 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-cd5d1e9c-b33d-4e59-a5b1-0a3db44315e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6036c9d5cf264f8995735430e1bbb448'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:06.311715 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-cd5d1e9c-b33d-4e59-a5b1-0a3db44315e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6036c9d5cf264f8995735430e1bbb448'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:06.312903 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:50:06.324781 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-cd5d1e9c-b33d-4e59-a5b1-0a3db44315e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6036c9d5cf264f8995735430e1bbb448'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:06.334103 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1081/2167] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:50:05 2022] DELETE /identity/v3/users/6036c9d5cf264f8995735430e1bbb448 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:50:06.641714 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc8865-5a54-4f03-800e-0599d2657675 service swift] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:06.651169 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:50:06.656474 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc8865-5a54-4f03-800e-0599d2657675 service swift] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:06.727912 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569efe4-9bd3-4b30-ac70-51ea61a94538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:06.729692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569efe4-9bd3-4b30-ac70-51ea61a94538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:06.730805 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569efe4-9bd3-4b30-ac70-51ea61a94538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:06.731127 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569efe4-9bd3-4b30-ac70-51ea61a94538 admin admin] PATH_INFO: `/v3/projects/1521ef85c5ab4422a5c0f2436d1128d7` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:06.732391 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f569efe4-9bd3-4b30-ac70-51ea61a94538 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1521ef85c5ab4422a5c0f2436d1128d7)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:06.734347 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f569efe4-9bd3-4b30-ac70-51ea61a94538 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:06.850643 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-f569efe4-9bd3-4b30-ac70-51ea61a94538 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1521ef85c5ab4422a5c0f2436d1128d7', 'request_id': 'req-f569efe4-9bd3-4b30-ac70-51ea61a94538'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:06.931182 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-f569efe4-9bd3-4b30-ac70-51ea61a94538 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1521ef85c5ab4422a5c0f2436d1128d7', 'request_id': 'req-f569efe4-9bd3-4b30-ac70-51ea61a94538'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:06.937823 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-f569efe4-9bd3-4b30-ac70-51ea61a94538 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1521ef85c5ab4422a5c0f2436d1128d7', 'request_id': 'req-f569efe4-9bd3-4b30-ac70-51ea61a94538'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:06.949005 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-f569efe4-9bd3-4b30-ac70-51ea61a94538 admin admin] The token cache is being invalidate because project 1521ef85c5ab4422a5c0f2436d1128d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:50:06.949267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-f569efe4-9bd3-4b30-ac70-51ea61a94538 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:06.949903 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-f569efe4-9bd3-4b30-ac70-51ea61a94538 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:06.951454 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1087/2168] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:50:06 2022] DELETE /identity/v3/projects/1521ef85c5ab4422a5c0f2436d1128d7 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:50:06.957095 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1b3e9-0374-420a-bafe-c4a061ea60b9 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:06.957552 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1b3e9-0374-420a-bafe-c4a061ea60b9 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:06.957642 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1b3e9-0374-420a-bafe-c4a061ea60b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:06.978250 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-18a1b3e9-0374-420a-bafe-c4a061ea60b9 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:50:06.979494 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-18a1b3e9-0374-420a-bafe-c4a061ea60b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:07.012691 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569efe4-9bd3-4b30-ac70-51ea61a94538 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:07.014493 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-f569efe4-9bd3-4b30-ac70-51ea61a94538 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:07.076671 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1082/2169] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:50:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:50:07.078501 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58ee50-0b6b-49aa-a664-ab46727f3e6c None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:07.079033 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58ee50-0b6b-49aa-a664-ab46727f3e6c None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:07.079361 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58ee50-0b6b-49aa-a664-ab46727f3e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:07.103822 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-ff58ee50-0b6b-49aa-a664-ab46727f3e6c None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:50:07.104737 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569efe4-9bd3-4b30-ac70-51ea61a94538 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:07.105049 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-ff58ee50-0b6b-49aa-a664-ab46727f3e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:07.121295 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1083/2170] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:50:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:50:07.121295 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff58ee50-0b6b-49aa-a664-ab46727f3e6c None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:07.127706 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ccef1-584f-4e66-8499-245cea5a7661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:07.128745 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ccef1-584f-4e66-8499-245cea5a7661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:07.129197 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ccef1-584f-4e66-8499-245cea5a7661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:07.129854 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ccef1-584f-4e66-8499-245cea5a7661 admin admin] PATH_INFO: `/v3/users/d08227b3e43f4c699f177abde62c4313` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:07.132135 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3ccef1-584f-4e66-8499-245cea5a7661 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d08227b3e43f4c699f177abde62c4313)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:07.134407 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3ccef1-584f-4e66-8499-245cea5a7661 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:07.150975 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff58ee50-0b6b-49aa-a664-ab46727f3e6c None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:07.163593 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd182c52-d20e-443b-aac5-2d8289036a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:07.164232 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd182c52-d20e-443b-aac5-2d8289036a1f admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:07.164514 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd182c52-d20e-443b-aac5-2d8289036a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:07.164908 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd182c52-d20e-443b-aac5-2d8289036a1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:07.165614 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd182c52-d20e-443b-aac5-2d8289036a1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:50:07.165924 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd182c52-d20e-443b-aac5-2d8289036a1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:07.167585 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd182c52-d20e-443b-aac5-2d8289036a1f admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:07.193361 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1084/2171] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:50:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:50:07.200654 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd182c52-d20e-443b-aac5-2d8289036a1f admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:07.212027 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd182c52-d20e-443b-aac5-2d8289036a1f admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:07.217811 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f63dd9-227b-4aaa-8e3f-f1d9183ac925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:07.218454 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f63dd9-227b-4aaa-8e3f-f1d9183ac925 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:07.223228 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f63dd9-227b-4aaa-8e3f-f1d9183ac925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:07.223228 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f63dd9-227b-4aaa-8e3f-f1d9183ac925 admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:07.223228 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f63dd9-227b-4aaa-8e3f-f1d9183ac925 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:07.223228 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f63dd9-227b-4aaa-8e3f-f1d9183ac925 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:07.290564 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:50:07.300265 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-ff3ccef1-584f-4e66-8499-245cea5a7661 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd08227b3e43f4c699f177abde62c4313'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:07.316426 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1085/2172] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:50:07 2022] POST /identity/v3/projects => generated 363 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:50:07.320770 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f63dd9-227b-4aaa-8e3f-f1d9183ac925 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:07.382486 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-ff3ccef1-584f-4e66-8499-245cea5a7661 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd08227b3e43f4c699f177abde62c4313'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:07.397292 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f63dd9-227b-4aaa-8e3f-f1d9183ac925 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:07.400262 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-ff3ccef1-584f-4e66-8499-245cea5a7661 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd08227b3e43f4c699f177abde62c4313'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:07.401989 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794fbc02-39eb-48fb-8e71-22e63c872da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:07.402629 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794fbc02-39eb-48fb-8e71-22e63c872da4 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:07.402902 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794fbc02-39eb-48fb-8e71-22e63c872da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:07.403224 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794fbc02-39eb-48fb-8e71-22e63c872da4 admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:07.404017 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794fbc02-39eb-48fb-8e71-22e63c872da4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:07.405996 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794fbc02-39eb-48fb-8e71-22e63c872da4 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:07.429707 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-ff3ccef1-584f-4e66-8499-245cea5a7661 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd08227b3e43f4c699f177abde62c4313'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:07.430522 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-ff3ccef1-584f-4e66-8499-245cea5a7661 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd08227b3e43f4c699f177abde62c4313'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:07.438487 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1088/2173] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:50:07 2022] DELETE /identity/v3/users/d08227b3e43f4c699f177abde62c4313 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:50:07.445398 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320e27d-c213-434f-8f70-01db911c943d None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:07.445878 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320e27d-c213-434f-8f70-01db911c943d None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:07.446335 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320e27d-c213-434f-8f70-01db911c943d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:07.469445 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-1320e27d-c213-434f-8f70-01db911c943d None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:50:07.470639 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-1320e27d-c213-434f-8f70-01db911c943d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:07.509302 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1086/2174] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:50:07 2022] POST /identity/v3/users => generated 282 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:50:07.514207 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794fbc02-39eb-48fb-8e71-22e63c872da4 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:07.530645 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-794fbc02-39eb-48fb-8e71-22e63c872da4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:07.543544 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1089/2175] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:50:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:50:07.552879 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320e27d-c213-434f-8f70-01db911c943d None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:07.553056 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794fbc02-39eb-48fb-8e71-22e63c872da4 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:07.555747 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-1320e27d-c213-434f-8f70-01db911c943d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:07.558880 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd82a8c-d876-456e-954a-3d81592eb7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:07.559533 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd82a8c-d876-456e-954a-3d81592eb7cd admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:07.559812 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd82a8c-d876-456e-954a-3d81592eb7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:07.560088 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd82a8c-d876-456e-954a-3d81592eb7cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:07.560787 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd82a8c-d876-456e-954a-3d81592eb7cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:07.562464 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd82a8c-d876-456e-954a-3d81592eb7cd admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:07.578118 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1087/2176] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:50:07.581987 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd82a8c-d876-456e-954a-3d81592eb7cd admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:07.596265 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd82a8c-d876-456e-954a-3d81592eb7cd admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:07.601870 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe13c8-2aa5-470b-b033-e3b8184846b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:07.603699 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe13c8-2aa5-470b-b033-e3b8184846b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:07.603699 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe13c8-2aa5-470b-b033-e3b8184846b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:07.603699 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe13c8-2aa5-470b-b033-e3b8184846b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:07.604078 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe13c8-2aa5-470b-b033-e3b8184846b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:07.605798 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe13c8-2aa5-470b-b033-e3b8184846b9 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:07.617496 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1088/2177] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:50:07.622166 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe13c8-2aa5-470b-b033-e3b8184846b9 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:07.631979 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320e27d-c213-434f-8f70-01db911c943d None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:07.634102 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe13c8-2aa5-470b-b033-e3b8184846b9 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:07.637128 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87580d0c-a89a-4ae3-9026-b2b6caf4e9d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:07.638086 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87580d0c-a89a-4ae3-9026-b2b6caf4e9d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:07.638614 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87580d0c-a89a-4ae3-9026-b2b6caf4e9d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:07.638899 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87580d0c-a89a-4ae3-9026-b2b6caf4e9d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:07.641893 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58a13d-ea10-49dc-ae2b-04d5df6df70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:07.642646 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58a13d-ea10-49dc-ae2b-04d5df6df70f admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:07.643061 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58a13d-ea10-49dc-ae2b-04d5df6df70f admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:07.643417 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58a13d-ea10-49dc-ae2b-04d5df6df70f admin admin] PATH_INFO: `/v3/projects/208458e15ee341faa2dca5d6b366b198/users/5e36da26fd4a491dbf8d03f6e8d6a96e/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:07.646447 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:50:07.651591 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87580d0c-a89a-4ae3-9026-b2b6caf4e9d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:07.653267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87580d0c-a89a-4ae3-9026-b2b6caf4e9d7 service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:07.666400 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1090/2178] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:50:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:50:07.675206 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58a13d-ea10-49dc-ae2b-04d5df6df70f admin admin] RBAC: Authorizing `identity:create_grant(project_id=208458e15ee341faa2dca5d6b366b198, user_id=5e36da26fd4a491dbf8d03f6e8d6a96e, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:07.678405 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58a13d-ea10-49dc-ae2b-04d5df6df70f admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:07.775081 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1089/2179] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:50:07 2022] PUT /identity/v3/projects/208458e15ee341faa2dca5d6b366b198/users/5e36da26fd4a491dbf8d03f6e8d6a96e/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:50:07.785570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c034bfa-7416-4ef3-80e3-6398aaf58ba4 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:07.785865 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c034bfa-7416-4ef3-80e3-6398aaf58ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:07.786177 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c034bfa-7416-4ef3-80e3-6398aaf58ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:07.831765 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-7c034bfa-7416-4ef3-80e3-6398aaf58ba4 None None] MFA Rules not processed for user `5e36da26fd4a491dbf8d03f6e8d6a96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:50:07.833013 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-7c034bfa-7416-4ef3-80e3-6398aaf58ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:07.888103 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:50:07.910446 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1091/2180] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:50:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:50:07.923282 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58a13d-ea10-49dc-ae2b-04d5df6df70f admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:07.926214 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-2d58a13d-ea10-49dc-ae2b-04d5df6df70f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:08.034180 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58a13d-ea10-49dc-ae2b-04d5df6df70f admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:08.043013 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d12a4e-c6bd-4222-8808-a364bf44a3ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:08.044094 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d12a4e-c6bd-4222-8808-a364bf44a3ca service cinder] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:08.044523 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d12a4e-c6bd-4222-8808-a364bf44a3ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:08.045077 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d12a4e-c6bd-4222-8808-a364bf44a3ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:08.058823 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d12a4e-c6bd-4222-8808-a364bf44a3ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:08.061712 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d12a4e-c6bd-4222-8808-a364bf44a3ca service cinder] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:08.078658 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1090/2181] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:50:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:50:08.256040 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c034bfa-7416-4ef3-80e3-6398aaf58ba4 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:08.257534 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-7c034bfa-7416-4ef3-80e3-6398aaf58ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:08.344852 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c034bfa-7416-4ef3-80e3-6398aaf58ba4 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:08.349955 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9a250-ed80-421e-b20d-a064350bd323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:08.350580 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9a250-ed80-421e-b20d-a064350bd323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:08.350923 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9a250-ed80-421e-b20d-a064350bd323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:08.351617 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9a250-ed80-421e-b20d-a064350bd323 admin admin] PATH_INFO: `/v3/projects/08d8989d3c4046c6a74727af242ee3f0` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:08.352413 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b9a250-ed80-421e-b20d-a064350bd323 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08d8989d3c4046c6a74727af242ee3f0)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:08.355296 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b9a250-ed80-421e-b20d-a064350bd323 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:08.475065 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-a4b9a250-ed80-421e-b20d-a064350bd323 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08d8989d3c4046c6a74727af242ee3f0', 'request_id': 'req-a4b9a250-ed80-421e-b20d-a064350bd323'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:08.541201 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-a4b9a250-ed80-421e-b20d-a064350bd323 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08d8989d3c4046c6a74727af242ee3f0', 'request_id': 'req-a4b9a250-ed80-421e-b20d-a064350bd323'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:08.548065 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-a4b9a250-ed80-421e-b20d-a064350bd323 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08d8989d3c4046c6a74727af242ee3f0', 'request_id': 'req-a4b9a250-ed80-421e-b20d-a064350bd323'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:08.562023 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-a4b9a250-ed80-421e-b20d-a064350bd323 admin admin] The token cache is being invalidate because project 08d8989d3c4046c6a74727af242ee3f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:50:08.562348 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-a4b9a250-ed80-421e-b20d-a064350bd323 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:08.563013 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-a4b9a250-ed80-421e-b20d-a064350bd323 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:08.564910 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1092/2182] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:50:08 2022] DELETE /identity/v3/projects/08d8989d3c4046c6a74727af242ee3f0 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:50:08.568638 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d12a4e-c6bd-4222-8808-a364bf44a3ca service cinder] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:08.580191 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d12a4e-c6bd-4222-8808-a364bf44a3ca service cinder] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:08.635741 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9baedc-b7eb-4bc1-82f7-47cc5a9cce9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:08.636897 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9baedc-b7eb-4bc1-82f7-47cc5a9cce9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:08.637176 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9baedc-b7eb-4bc1-82f7-47cc5a9cce9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:08.637454 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9baedc-b7eb-4bc1-82f7-47cc5a9cce9f admin admin] PATH_INFO: `/v3/users/8c6bd1dd30ca48f0a8d0ed5803c6b539` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:08.638672 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9baedc-b7eb-4bc1-82f7-47cc5a9cce9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c6bd1dd30ca48f0a8d0ed5803c6b539)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:08.640629 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9baedc-b7eb-4bc1-82f7-47cc5a9cce9f admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:08.720665 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9a250-ed80-421e-b20d-a064350bd323 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:08.722099 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-a4b9a250-ed80-421e-b20d-a064350bd323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:08.736250 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9a250-ed80-421e-b20d-a064350bd323 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:08.741034 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e62141-96d6-4ef0-8598-ecd091afff25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:08.741675 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e62141-96d6-4ef0-8598-ecd091afff25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:08.741956 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e62141-96d6-4ef0-8598-ecd091afff25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:08.742434 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e62141-96d6-4ef0-8598-ecd091afff25 admin admin] PATH_INFO: `/v3/users/effd1c41a02140088a4713a7647b516e` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:08.743835 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e62141-96d6-4ef0-8598-ecd091afff25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=effd1c41a02140088a4713a7647b516e)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:08.745770 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e62141-96d6-4ef0-8598-ecd091afff25 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:08.844071 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-2d9baedc-b7eb-4bc1-82f7-47cc5a9cce9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c6bd1dd30ca48f0a8d0ed5803c6b539'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:08.924824 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-c3e62141-96d6-4ef0-8598-ecd091afff25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'effd1c41a02140088a4713a7647b516e'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:08.965856 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-2d9baedc-b7eb-4bc1-82f7-47cc5a9cce9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c6bd1dd30ca48f0a8d0ed5803c6b539'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:08.973653 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-2d9baedc-b7eb-4bc1-82f7-47cc5a9cce9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c6bd1dd30ca48f0a8d0ed5803c6b539'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:08.974345 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-2d9baedc-b7eb-4bc1-82f7-47cc5a9cce9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c6bd1dd30ca48f0a8d0ed5803c6b539'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:08.986968 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-2d9baedc-b7eb-4bc1-82f7-47cc5a9cce9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c6bd1dd30ca48f0a8d0ed5803c6b539'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:08.993877 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1091/2183] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:50:08 2022] DELETE /identity/v3/users/8c6bd1dd30ca48f0a8d0ed5803c6b539 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:50:09.078133 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-c3e62141-96d6-4ef0-8598-ecd091afff25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'effd1c41a02140088a4713a7647b516e'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:09.090497 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-c3e62141-96d6-4ef0-8598-ecd091afff25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'effd1c41a02140088a4713a7647b516e'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:09.122677 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-c3e62141-96d6-4ef0-8598-ecd091afff25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'effd1c41a02140088a4713a7647b516e'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:09.126499 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-c3e62141-96d6-4ef0-8598-ecd091afff25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'effd1c41a02140088a4713a7647b516e'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:09.133997 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1093/2184] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:50:08 2022] DELETE /identity/v3/users/effd1c41a02140088a4713a7647b516e => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:50:09.149507 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9d976-1541-43b3-8fa0-360890abafd1 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:09.150038 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9d976-1541-43b3-8fa0-360890abafd1 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:09.150038 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9d976-1541-43b3-8fa0-360890abafd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:09.158735 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:50:09.170170 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-dbb9d976-1541-43b3-8fa0-360890abafd1 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:50:09.171424 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-dbb9d976-1541-43b3-8fa0-360890abafd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:09.239687 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1092/2185] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:50:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:50:09.250595 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e62141-96d6-4ef0-8598-ecd091afff25 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:09.252213 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-c3e62141-96d6-4ef0-8598-ecd091afff25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:09.316220 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e62141-96d6-4ef0-8598-ecd091afff25 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:09.319985 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f3866-f7e1-4782-92eb-4c7eebb19932 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:09.320601 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f3866-f7e1-4782-92eb-4c7eebb19932 service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:09.320881 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f3866-f7e1-4782-92eb-4c7eebb19932 service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:09.321154 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f3866-f7e1-4782-92eb-4c7eebb19932 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:09.330326 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f3866-f7e1-4782-92eb-4c7eebb19932 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:09.331904 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f3866-f7e1-4782-92eb-4c7eebb19932 service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:09.341932 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1094/2186] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:50:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:50:09.398233 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:50:09.474986 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9d976-1541-43b3-8fa0-360890abafd1 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:09.476300 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-dbb9d976-1541-43b3-8fa0-360890abafd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:09.491697 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9d976-1541-43b3-8fa0-360890abafd1 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:09.497910 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c4db42-ef61-4d42-81a1-c847ddaa346c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:09.498574 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4db42-ef61-4d42-81a1-c847ddaa346c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:09.499367 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4db42-ef61-4d42-81a1-c847ddaa346c admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:09.499367 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4db42-ef61-4d42-81a1-c847ddaa346c admin admin] PATH_INFO: `/v3/projects/ef6341ab7e4d492297ff7cfd81e8f52b` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:09.500661 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c4db42-ef61-4d42-81a1-c847ddaa346c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef6341ab7e4d492297ff7cfd81e8f52b)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:09.502736 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c4db42-ef61-4d42-81a1-c847ddaa346c admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:09.611128 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-78c4db42-ef61-4d42-81a1-c847ddaa346c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef6341ab7e4d492297ff7cfd81e8f52b', 'request_id': 'req-78c4db42-ef61-4d42-81a1-c847ddaa346c'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:09.681357 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-78c4db42-ef61-4d42-81a1-c847ddaa346c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef6341ab7e4d492297ff7cfd81e8f52b', 'request_id': 'req-78c4db42-ef61-4d42-81a1-c847ddaa346c'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:09.686861 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-78c4db42-ef61-4d42-81a1-c847ddaa346c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef6341ab7e4d492297ff7cfd81e8f52b', 'request_id': 'req-78c4db42-ef61-4d42-81a1-c847ddaa346c'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:09.711590 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-78c4db42-ef61-4d42-81a1-c847ddaa346c admin admin] The token cache is being invalidate because project ef6341ab7e4d492297ff7cfd81e8f52b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:50:09.711590 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-78c4db42-ef61-4d42-81a1-c847ddaa346c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:09.711590 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-78c4db42-ef61-4d42-81a1-c847ddaa346c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:09.711590 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1093/2187] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:50:09 2022] DELETE /identity/v3/projects/ef6341ab7e4d492297ff7cfd81e8f52b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:50:09.717553 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889d24a-a516-4192-b61e-daf4d2107514 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:09.717843 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889d24a-a516-4192-b61e-daf4d2107514 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:09.718127 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889d24a-a516-4192-b61e-daf4d2107514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:09.738488 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-6889d24a-a516-4192-b61e-daf4d2107514 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:50:09.739611 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-6889d24a-a516-4192-b61e-daf4d2107514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:09.799678 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1095/2188] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:50:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:50:09.807897 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc3310-479b-44b1-b3bb-a7469bcf858d None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:09.808179 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc3310-479b-44b1-b3bb-a7469bcf858d None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:09.808454 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc3310-479b-44b1-b3bb-a7469bcf858d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:09.827812 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-86cc3310-479b-44b1-b3bb-a7469bcf858d None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:50:09.829024 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-86cc3310-479b-44b1-b3bb-a7469bcf858d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:09.837475 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1094/2189] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:50:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:50:09.842603 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6889d24a-a516-4192-b61e-daf4d2107514 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:09.855331 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6889d24a-a516-4192-b61e-daf4d2107514 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:09.859359 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8912ff-c8ec-4835-b98b-4e478968a06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:09.859982 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8912ff-c8ec-4835-b98b-4e478968a06e admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:09.860269 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8912ff-c8ec-4835-b98b-4e478968a06e admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:09.860773 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8912ff-c8ec-4835-b98b-4e478968a06e admin admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:09.861292 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8912ff-c8ec-4835-b98b-4e478968a06e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:50:09.861623 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8912ff-c8ec-4835-b98b-4e478968a06e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:09.863280 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8912ff-c8ec-4835-b98b-4e478968a06e admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:09.876717 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1096/2190] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:50:09.887296 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc3310-479b-44b1-b3bb-a7469bcf858d None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:09.896912 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc3310-479b-44b1-b3bb-a7469bcf858d None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:09.905267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8912ff-c8ec-4835-b98b-4e478968a06e admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:09.905731 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c797cedc-d0f6-4cb6-b2e1-ecae9ba6e897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:09.906355 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797cedc-d0f6-4cb6-b2e1-ecae9ba6e897 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:09.906788 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797cedc-d0f6-4cb6-b2e1-ecae9ba6e897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:09.907339 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797cedc-d0f6-4cb6-b2e1-ecae9ba6e897 admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:09.907827 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c797cedc-d0f6-4cb6-b2e1-ecae9ba6e897 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:09.908627 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-2a8912ff-c8ec-4835-b98b-4e478968a06e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:09.909805 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c797cedc-d0f6-4cb6-b2e1-ecae9ba6e897 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:09.932359 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8912ff-c8ec-4835-b98b-4e478968a06e admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:09.937428 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91015ec6-c06d-4a16-9754-913edabc0ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:09.938178 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91015ec6-c06d-4a16-9754-913edabc0ef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:09.938528 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91015ec6-c06d-4a16-9754-913edabc0ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:09.938874 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91015ec6-c06d-4a16-9754-913edabc0ef2 admin admin] PATH_INFO: `/v3/projects/6cfd082bbc6e4283abd5e4abfbbc25aa` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:09.940188 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91015ec6-c06d-4a16-9754-913edabc0ef2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cfd082bbc6e4283abd5e4abfbbc25aa)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:09.942536 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91015ec6-c06d-4a16-9754-913edabc0ef2 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:09.996857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1095/2191] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:50:09 2022] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:50:10.001094 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c797cedc-d0f6-4cb6-b2e1-ecae9ba6e897 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:10.051425 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-91015ec6-c06d-4a16-9754-913edabc0ef2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cfd082bbc6e4283abd5e4abfbbc25aa', 'request_id': 'req-91015ec6-c06d-4a16-9754-913edabc0ef2'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:10.072327 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c797cedc-d0f6-4cb6-b2e1-ecae9ba6e897 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:10.124103 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-91015ec6-c06d-4a16-9754-913edabc0ef2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cfd082bbc6e4283abd5e4abfbbc25aa', 'request_id': 'req-91015ec6-c06d-4a16-9754-913edabc0ef2'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:10.131304 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-91015ec6-c06d-4a16-9754-913edabc0ef2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cfd082bbc6e4283abd5e4abfbbc25aa', 'request_id': 'req-91015ec6-c06d-4a16-9754-913edabc0ef2'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:10.143199 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30448409-2bd6-454a-8637-ae8e86846ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:10.143925 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30448409-2bd6-454a-8637-ae8e86846ad1 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:10.144344 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30448409-2bd6-454a-8637-ae8e86846ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:10.144633 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30448409-2bd6-454a-8637-ae8e86846ad1 admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:10.145599 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30448409-2bd6-454a-8637-ae8e86846ad1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:10.145799 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-91015ec6-c06d-4a16-9754-913edabc0ef2 admin admin] The token cache is being invalidate because project 6cfd082bbc6e4283abd5e4abfbbc25aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:50:10.146246 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-91015ec6-c06d-4a16-9754-913edabc0ef2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:10.147876 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-91015ec6-c06d-4a16-9754-913edabc0ef2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:10.148015 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30448409-2bd6-454a-8637-ae8e86846ad1 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:10.152888 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1097/2192] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:50:09 2022] DELETE /identity/v3/projects/6cfd082bbc6e4283abd5e4abfbbc25aa => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:50:10.249964 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1096/2193] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:50:10 2022] POST /identity/v3/users => generated 291 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:50:10.251549 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91015ec6-c06d-4a16-9754-913edabc0ef2 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:10.255974 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-91015ec6-c06d-4a16-9754-913edabc0ef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:10.274394 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91015ec6-c06d-4a16-9754-913edabc0ef2 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:10.281193 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc128e-d5c7-48e3-8a59-815a948f5bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:10.281897 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc128e-d5c7-48e3-8a59-815a948f5bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:10.282410 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc128e-d5c7-48e3-8a59-815a948f5bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:10.282832 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc128e-d5c7-48e3-8a59-815a948f5bd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:10.283739 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc128e-d5c7-48e3-8a59-815a948f5bd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:10.286380 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc128e-d5c7-48e3-8a59-815a948f5bd6 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:10.307198 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1098/2194] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:50:10.307398 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30448409-2bd6-454a-8637-ae8e86846ad1 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:10.320753 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30448409-2bd6-454a-8637-ae8e86846ad1 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:10.343698 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4768d-f08f-4398-ad5e-c5724b71ff44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:10.344337 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4768d-f08f-4398-ad5e-c5724b71ff44 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:10.344623 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4768d-f08f-4398-ad5e-c5724b71ff44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:10.347779 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4768d-f08f-4398-ad5e-c5724b71ff44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:10.348767 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4768d-f08f-4398-ad5e-c5724b71ff44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:10.351172 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4768d-f08f-4398-ad5e-c5724b71ff44 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:10.354235 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:50:10.369168 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1097/2195] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:50:10.374061 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc128e-d5c7-48e3-8a59-815a948f5bd6 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:10.389484 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc128e-d5c7-48e3-8a59-815a948f5bd6 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:10.397596 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4b4ce-1dcd-4019-ada3-820445ecc0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:10.398286 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4b4ce-1dcd-4019-ada3-820445ecc0e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:10.399366 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4b4ce-1dcd-4019-ada3-820445ecc0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:10.399657 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4b4ce-1dcd-4019-ada3-820445ecc0e4 admin admin] PATH_INFO: `/v3/projects/32b0d6b2ef49472dbe15223ddd26b9fc/users/0e2163ce55c549b193ec68b6d7cafde4/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:10.417420 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:50:10.424470 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4b4ce-1dcd-4019-ada3-820445ecc0e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32b0d6b2ef49472dbe15223ddd26b9fc, user_id=0e2163ce55c549b193ec68b6d7cafde4, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:10.427251 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4b4ce-1dcd-4019-ada3-820445ecc0e4 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:10.494315 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1099/2196] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:50:10 2022] PUT /identity/v3/projects/32b0d6b2ef49472dbe15223ddd26b9fc/users/0e2163ce55c549b193ec68b6d7cafde4/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:50:10.510024 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851f0d4-aba3-4392-b1d0-25f2ae9da11b None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:10.510464 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851f0d4-aba3-4392-b1d0-25f2ae9da11b None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:10.511410 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851f0d4-aba3-4392-b1d0-25f2ae9da11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:10.539208 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-3851f0d4-aba3-4392-b1d0-25f2ae9da11b None None] MFA Rules not processed for user `0e2163ce55c549b193ec68b6d7cafde4`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:50:10.540472 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-3851f0d4-aba3-4392-b1d0-25f2ae9da11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:10.607550 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1098/2197] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:50:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:50:10.611963 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4b4ce-1dcd-4019-ada3-820445ecc0e4 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:10.672687 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4b4ce-1dcd-4019-ada3-820445ecc0e4 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:10.677600 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ecea2-53c9-4027-a9da-abd902261606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:10.678069 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ecea2-53c9-4027-a9da-abd902261606 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:10.678349 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ecea2-53c9-4027-a9da-abd902261606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:10.678624 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ecea2-53c9-4027-a9da-abd902261606 admin admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:10.679495 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5ecea2-53c9-4027-a9da-abd902261606 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:10.681539 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5ecea2-53c9-4027-a9da-abd902261606 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:10.822427 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1100/2198] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:50:10 2022] POST /identity/v3/projects => generated 381 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:50:10.823219 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851f0d4-aba3-4392-b1d0-25f2ae9da11b None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:10.841868 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851f0d4-aba3-4392-b1d0-25f2ae9da11b None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:10.923447 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28aa63-bfbe-4acb-a12e-2980ca9d18a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:10.923447 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28aa63-bfbe-4acb-a12e-2980ca9d18a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:10.923447 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28aa63-bfbe-4acb-a12e-2980ca9d18a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:10.923447 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28aa63-bfbe-4acb-a12e-2980ca9d18a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:10.923860 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc28aa63-bfbe-4acb-a12e-2980ca9d18a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:10.924788 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc28aa63-bfbe-4acb-a12e-2980ca9d18a6 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:11.005966 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1099/2199] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:50:10 2022] POST /identity/v3/users => generated 297 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:50:11.010520 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ecea2-53c9-4027-a9da-abd902261606 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:11.021555 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ecea2-53c9-4027-a9da-abd902261606 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:11.026261 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9d95e-cb7a-4834-84f0-9b7d7292ad89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:11.027046 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9d95e-cb7a-4834-84f0-9b7d7292ad89 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:11.027326 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9d95e-cb7a-4834-84f0-9b7d7292ad89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:11.027759 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9d95e-cb7a-4834-84f0-9b7d7292ad89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:11.028838 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae9d95e-cb7a-4834-84f0-9b7d7292ad89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:11.030768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae9d95e-cb7a-4834-84f0-9b7d7292ad89 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:11.043778 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1101/2200] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:50:11.048495 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28aa63-bfbe-4acb-a12e-2980ca9d18a6 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:11.065329 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28aa63-bfbe-4acb-a12e-2980ca9d18a6 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:11.070087 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:50:11.073634 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71682a94-80d4-4012-b68f-5fb9e4bb3e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:11.074328 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71682a94-80d4-4012-b68f-5fb9e4bb3e3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:11.074725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71682a94-80d4-4012-b68f-5fb9e4bb3e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:11.075026 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71682a94-80d4-4012-b68f-5fb9e4bb3e3e admin admin] PATH_INFO: `/v3/projects/f4b96a8522ed47d3a418a0f7f9511da4/users/bee1fc154f8c4fd8aa2baf826529d300/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:11.091619 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71682a94-80d4-4012-b68f-5fb9e4bb3e3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4b96a8522ed47d3a418a0f7f9511da4, user_id=bee1fc154f8c4fd8aa2baf826529d300, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:11.094346 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71682a94-80d4-4012-b68f-5fb9e4bb3e3e admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:11.154669 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1100/2201] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:50:11 2022] PUT /identity/v3/projects/f4b96a8522ed47d3a418a0f7f9511da4/users/bee1fc154f8c4fd8aa2baf826529d300/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:50:11.158873 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9d95e-cb7a-4834-84f0-9b7d7292ad89 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:11.169341 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9d95e-cb7a-4834-84f0-9b7d7292ad89 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:11.236737 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33598f31-0491-4be3-aef5-b267a3d374e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:11.237367 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33598f31-0491-4be3-aef5-b267a3d374e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:11.237650 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33598f31-0491-4be3-aef5-b267a3d374e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:11.237951 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33598f31-0491-4be3-aef5-b267a3d374e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:11.238615 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33598f31-0491-4be3-aef5-b267a3d374e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:11.240250 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33598f31-0491-4be3-aef5-b267a3d374e6 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:11.251192 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1102/2202] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:50:11.255178 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71682a94-80d4-4012-b68f-5fb9e4bb3e3e admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:11.266464 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71682a94-80d4-4012-b68f-5fb9e4bb3e3e admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:11.283902 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c4d6c-8bdc-4ddb-af18-43582e74d9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:11.284637 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c4d6c-8bdc-4ddb-af18-43582e74d9bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:11.284916 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c4d6c-8bdc-4ddb-af18-43582e74d9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:11.285190 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c4d6c-8bdc-4ddb-af18-43582e74d9bc admin admin] PATH_INFO: `/v3/projects/f4b96a8522ed47d3a418a0f7f9511da4/users/bee1fc154f8c4fd8aa2baf826529d300/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:11.303087 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c4d6c-8bdc-4ddb-af18-43582e74d9bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4b96a8522ed47d3a418a0f7f9511da4, user_id=bee1fc154f8c4fd8aa2baf826529d300, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:11.303087 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c4d6c-8bdc-4ddb-af18-43582e74d9bc admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:11.316697 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1101/2203] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:50:11 2022] PUT /identity/v3/projects/f4b96a8522ed47d3a418a0f7f9511da4/users/bee1fc154f8c4fd8aa2baf826529d300/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:50:11.319266 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5550e1-a8db-4059-bdd3-e5d599eeac66 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:11.319589 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5550e1-a8db-4059-bdd3-e5d599eeac66 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:11.319870 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5550e1-a8db-4059-bdd3-e5d599eeac66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:11.350234 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-3b5550e1-a8db-4059-bdd3-e5d599eeac66 None None] MFA Rules not processed for user `bee1fc154f8c4fd8aa2baf826529d300`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:50:11.351505 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-3b5550e1-a8db-4059-bdd3-e5d599eeac66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:11.399923 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:50:11.444252 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1103/2204] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:50:11 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:50:11.459824 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c4d6c-8bdc-4ddb-af18-43582e74d9bc admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:11.462594 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-228c4d6c-8bdc-4ddb-af18-43582e74d9bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:11.528780 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c4d6c-8bdc-4ddb-af18-43582e74d9bc admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:11.533303 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a90949-a2f7-4d3f-953c-78c9e9107f41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:11.534154 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a90949-a2f7-4d3f-953c-78c9e9107f41 service cinder] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:11.534588 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a90949-a2f7-4d3f-953c-78c9e9107f41 service cinder] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:11.534913 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a90949-a2f7-4d3f-953c-78c9e9107f41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:11.546500 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a90949-a2f7-4d3f-953c-78c9e9107f41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:11.548030 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a90949-a2f7-4d3f-953c-78c9e9107f41 service cinder] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:11.558845 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1102/2205] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:50:11 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:50:11.625653 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5550e1-a8db-4059-bdd3-e5d599eeac66 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:11.627379 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-3b5550e1-a8db-4059-bdd3-e5d599eeac66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:11.692554 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5550e1-a8db-4059-bdd3-e5d599eeac66 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:11.693770 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a90949-a2f7-4d3f-953c-78c9e9107f41 service cinder] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:11.696416 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9ab65-f1a8-40ce-ba86-59bc3f18f0fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:11.697119 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9ab65-f1a8-40ce-ba86-59bc3f18f0fa service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:11.697433 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9ab65-f1a8-40ce-ba86-59bc3f18f0fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:11.697666 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9ab65-f1a8-40ce-ba86-59bc3f18f0fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:11.700240 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-80e9ab65-f1a8-40ce-ba86-59bc3f18f0fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:11.703251 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a90949-a2f7-4d3f-953c-78c9e9107f41 service cinder] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:11.707670 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d3aa9-e4f3-4d36-8dce-84e63984c40f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:11.708320 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d3aa9-e4f3-4d36-8dce-84e63984c40f service cinder] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:11.708602 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d3aa9-e4f3-4d36-8dce-84e63984c40f service cinder] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:11.708886 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d3aa9-e4f3-4d36-8dce-84e63984c40f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:11.768146 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d3aa9-e4f3-4d36-8dce-84e63984c40f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:11.769460 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d3aa9-e4f3-4d36-8dce-84e63984c40f service cinder] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:11.772732 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e9ab65-f1a8-40ce-ba86-59bc3f18f0fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:11.774175 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e9ab65-f1a8-40ce-ba86-59bc3f18f0fa service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:11.780361 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1103/2206] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:50:11 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:50:11.784762 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1104/2207] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:50:11 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:50:12.342166 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d3aa9-e4f3-4d36-8dce-84e63984c40f service cinder] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:12.434625 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d3aa9-e4f3-4d36-8dce-84e63984c40f service cinder] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:12.440094 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ebcdae-b0d8-4f1f-8e20-f556338178a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:12.440885 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebcdae-b0d8-4f1f-8e20-f556338178a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:12.441173 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebcdae-b0d8-4f1f-8e20-f556338178a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:12.441449 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebcdae-b0d8-4f1f-8e20-f556338178a5 admin admin] PATH_INFO: `/v3/users/0e2163ce55c549b193ec68b6d7cafde4` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:12.442639 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ebcdae-b0d8-4f1f-8e20-f556338178a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e2163ce55c549b193ec68b6d7cafde4)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:12.444647 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ebcdae-b0d8-4f1f-8e20-f556338178a5 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:12.469634 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:50:12.639976 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-47ebcdae-b0d8-4f1f-8e20-f556338178a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e2163ce55c549b193ec68b6d7cafde4'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:12.737663 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-47ebcdae-b0d8-4f1f-8e20-f556338178a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e2163ce55c549b193ec68b6d7cafde4'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:12.747524 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-47ebcdae-b0d8-4f1f-8e20-f556338178a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e2163ce55c549b193ec68b6d7cafde4'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:12.748269 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-47ebcdae-b0d8-4f1f-8e20-f556338178a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e2163ce55c549b193ec68b6d7cafde4'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:12.775729 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-47ebcdae-b0d8-4f1f-8e20-f556338178a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e2163ce55c549b193ec68b6d7cafde4'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:12.786854 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1104/2208] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:50:12 2022] DELETE /identity/v3/users/0e2163ce55c549b193ec68b6d7cafde4 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:50:12.790985 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe4a26-c298-4340-83dc-18e38f7f234b None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:12.791591 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe4a26-c298-4340-83dc-18e38f7f234b None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:12.791872 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe4a26-c298-4340-83dc-18e38f7f234b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:12.818753 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-5ffe4a26-c298-4340-83dc-18e38f7f234b None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:50:12.821404 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-5ffe4a26-c298-4340-83dc-18e38f7f234b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:12.902064 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1105/2209] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:50:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:50:12.917853 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ebcdae-b0d8-4f1f-8e20-f556338178a5 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:12.917853 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-47ebcdae-b0d8-4f1f-8e20-f556338178a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:12.989136 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ebcdae-b0d8-4f1f-8e20-f556338178a5 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:12.992910 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc84dd2e-6cc4-4504-9be8-d0ee82cee017 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:12.993535 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84dd2e-6cc4-4504-9be8-d0ee82cee017 service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:12.993817 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84dd2e-6cc4-4504-9be8-d0ee82cee017 service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:12.994094 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84dd2e-6cc4-4504-9be8-d0ee82cee017 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:13.003940 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc84dd2e-6cc4-4504-9be8-d0ee82cee017 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:13.005381 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc84dd2e-6cc4-4504-9be8-d0ee82cee017 service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:13.014907 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1105/2210] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:50:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:50:13.599235 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe4a26-c298-4340-83dc-18e38f7f234b None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:13.600884 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-5ffe4a26-c298-4340-83dc-18e38f7f234b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:13.621555 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe4a26-c298-4340-83dc-18e38f7f234b None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:13.627557 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671bc03-d39c-4ea2-b110-607441f3d0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:13.628347 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671bc03-d39c-4ea2-b110-607441f3d0ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:13.628755 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671bc03-d39c-4ea2-b110-607441f3d0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:13.629084 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671bc03-d39c-4ea2-b110-607441f3d0ca admin admin] PATH_INFO: `/v3/projects/32b0d6b2ef49472dbe15223ddd26b9fc` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:13.630387 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9671bc03-d39c-4ea2-b110-607441f3d0ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=32b0d6b2ef49472dbe15223ddd26b9fc)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:13.640128 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9671bc03-d39c-4ea2-b110-607441f3d0ca admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:13.650368 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:50:13.792653 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-9671bc03-d39c-4ea2-b110-607441f3d0ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32b0d6b2ef49472dbe15223ddd26b9fc', 'request_id': 'req-9671bc03-d39c-4ea2-b110-607441f3d0ca'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:13.850040 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-9671bc03-d39c-4ea2-b110-607441f3d0ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32b0d6b2ef49472dbe15223ddd26b9fc', 'request_id': 'req-9671bc03-d39c-4ea2-b110-607441f3d0ca'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:13.858311 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-9671bc03-d39c-4ea2-b110-607441f3d0ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32b0d6b2ef49472dbe15223ddd26b9fc', 'request_id': 'req-9671bc03-d39c-4ea2-b110-607441f3d0ca'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:13.871093 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-9671bc03-d39c-4ea2-b110-607441f3d0ca admin admin] The token cache is being invalidate because project 32b0d6b2ef49472dbe15223ddd26b9fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:50:13.871393 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-9671bc03-d39c-4ea2-b110-607441f3d0ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:13.872140 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-9671bc03-d39c-4ea2-b110-607441f3d0ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:13.873692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1106/2211] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:50:13 2022] DELETE /identity/v3/projects/32b0d6b2ef49472dbe15223ddd26b9fc => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:50:13.878997 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc84dd2e-6cc4-4504-9be8-d0ee82cee017 service neutron] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:13.893233 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc84dd2e-6cc4-4504-9be8-d0ee82cee017 service neutron] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:13.984700 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273c3da-df1f-4b82-98d4-990e8eb8766b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:13.985377 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273c3da-df1f-4b82-98d4-990e8eb8766b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:13.985642 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273c3da-df1f-4b82-98d4-990e8eb8766b admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:13.986211 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273c3da-df1f-4b82-98d4-990e8eb8766b admin admin] PATH_INFO: `/v3/users/bee1fc154f8c4fd8aa2baf826529d300` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:13.987645 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2273c3da-df1f-4b82-98d4-990e8eb8766b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bee1fc154f8c4fd8aa2baf826529d300)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:13.989692 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2273c3da-df1f-4b82-98d4-990e8eb8766b admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:14.191387 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:50:14.203959 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-2273c3da-df1f-4b82-98d4-990e8eb8766b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bee1fc154f8c4fd8aa2baf826529d300'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:14.296924 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-2273c3da-df1f-4b82-98d4-990e8eb8766b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bee1fc154f8c4fd8aa2baf826529d300'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:14.308337 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-2273c3da-df1f-4b82-98d4-990e8eb8766b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bee1fc154f8c4fd8aa2baf826529d300'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:14.309139 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-2273c3da-df1f-4b82-98d4-990e8eb8766b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bee1fc154f8c4fd8aa2baf826529d300'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:14.325365 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-2273c3da-df1f-4b82-98d4-990e8eb8766b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bee1fc154f8c4fd8aa2baf826529d300'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:14.332266 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1106/2212] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:50:13 2022] DELETE /identity/v3/users/bee1fc154f8c4fd8aa2baf826529d300 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:50:15.493821 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671bc03-d39c-4ea2-b110-607441f3d0ca admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:15.497489 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-9671bc03-d39c-4ea2-b110-607441f3d0ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:15.533484 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671bc03-d39c-4ea2-b110-607441f3d0ca admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:15.677028 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d0786-726a-41a6-b944-b2cb85186149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:15.679223 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d0786-726a-41a6-b944-b2cb85186149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:15.679689 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d0786-726a-41a6-b944-b2cb85186149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:15.683279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d0786-726a-41a6-b944-b2cb85186149 admin admin] PATH_INFO: `/v3/projects/f4b96a8522ed47d3a418a0f7f9511da4` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:15.687755 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164d0786-726a-41a6-b944-b2cb85186149 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4b96a8522ed47d3a418a0f7f9511da4)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:15.690201 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164d0786-726a-41a6-b944-b2cb85186149 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:15.867174 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-164d0786-726a-41a6-b944-b2cb85186149 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4b96a8522ed47d3a418a0f7f9511da4', 'request_id': 'req-164d0786-726a-41a6-b944-b2cb85186149'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:15.954785 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-164d0786-726a-41a6-b944-b2cb85186149 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4b96a8522ed47d3a418a0f7f9511da4', 'request_id': 'req-164d0786-726a-41a6-b944-b2cb85186149'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:15.963183 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-164d0786-726a-41a6-b944-b2cb85186149 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4b96a8522ed47d3a418a0f7f9511da4', 'request_id': 'req-164d0786-726a-41a6-b944-b2cb85186149'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:15.977824 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-164d0786-726a-41a6-b944-b2cb85186149 admin admin] The token cache is being invalidate because project f4b96a8522ed47d3a418a0f7f9511da4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:50:15.978675 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-164d0786-726a-41a6-b944-b2cb85186149 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:15.980403 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-164d0786-726a-41a6-b944-b2cb85186149 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:15.984726 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1107/2213] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:50:15 2022] DELETE /identity/v3/projects/f4b96a8522ed47d3a418a0f7f9511da4 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:50:15.989707 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af64fa-a728-4375-8495-ead3a794ceb8 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:15.991333 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af64fa-a728-4375-8495-ead3a794ceb8 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:15.991758 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af64fa-a728-4375-8495-ead3a794ceb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:16.026104 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-a8af64fa-a728-4375-8495-ead3a794ceb8 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:50:16.027567 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-a8af64fa-a728-4375-8495-ead3a794ceb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:16.128658 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1107/2214] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:50:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:50:16.130031 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a2564-d383-4331-b2fb-58e43d528cbd None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:16.130550 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a2564-d383-4331-b2fb-58e43d528cbd None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:16.130835 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a2564-d383-4331-b2fb-58e43d528cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:16.159009 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-f52a2564-d383-4331-b2fb-58e43d528cbd None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:50:16.160427 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-f52a2564-d383-4331-b2fb-58e43d528cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:16.171076 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1108/2215] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:50:16.175830 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af64fa-a728-4375-8495-ead3a794ceb8 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:16.189158 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af64fa-a728-4375-8495-ead3a794ceb8 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:16.195438 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f33f07-6158-459d-a89f-da547e82f4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:16.196479 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f33f07-6158-459d-a89f-da547e82f4f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:16.197260 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f33f07-6158-459d-a89f-da547e82f4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:16.197676 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f33f07-6158-459d-a89f-da547e82f4f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:16.198651 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f33f07-6158-459d-a89f-da547e82f4f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:50:16.199215 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f33f07-6158-459d-a89f-da547e82f4f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:16.201049 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f33f07-6158-459d-a89f-da547e82f4f1 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:16.215138 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1108/2216] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:50:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:50:16.220004 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a2564-d383-4331-b2fb-58e43d528cbd None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:16.231908 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a2564-d383-4331-b2fb-58e43d528cbd None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:16.237660 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48562195-b665-41aa-bd4a-8b0208d61d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:16.239029 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48562195-b665-41aa-bd4a-8b0208d61d83 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:16.239525 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48562195-b665-41aa-bd4a-8b0208d61d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:16.240000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48562195-b665-41aa-bd4a-8b0208d61d83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:16.241002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48562195-b665-41aa-bd4a-8b0208d61d83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:16.244226 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48562195-b665-41aa-bd4a-8b0208d61d83 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:16.324293 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:50:16.339003 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1109/2217] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:50:16 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:50:16.340553 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f33f07-6158-459d-a89f-da547e82f4f1 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:16.351662 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f33f07-6158-459d-a89f-da547e82f4f1 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:16.425184 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04cd96-98bf-42eb-9d55-e0027c19d391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:16.426103 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04cd96-98bf-42eb-9d55-e0027c19d391 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:16.426546 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04cd96-98bf-42eb-9d55-e0027c19d391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:16.427682 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04cd96-98bf-42eb-9d55-e0027c19d391 admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:16.430583 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04cd96-98bf-42eb-9d55-e0027c19d391 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:16.430747 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04cd96-98bf-42eb-9d55-e0027c19d391 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:16.577812 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1109/2218] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:50:16 2022] POST /identity/v3/users => generated 292 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:50:16.582201 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48562195-b665-41aa-bd4a-8b0208d61d83 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:16.611239 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48562195-b665-41aa-bd4a-8b0208d61d83 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:16.637184 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ba2a8-2ecf-48da-a138-675ccc0a1468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:16.638223 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ba2a8-2ecf-48da-a138-675ccc0a1468 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:16.639835 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ba2a8-2ecf-48da-a138-675ccc0a1468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:16.640281 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ba2a8-2ecf-48da-a138-675ccc0a1468 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:16.641746 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ba2a8-2ecf-48da-a138-675ccc0a1468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:16.646862 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ba2a8-2ecf-48da-a138-675ccc0a1468 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:16.710164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1110/2219] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:50:16.714939 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04cd96-98bf-42eb-9d55-e0027c19d391 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:16.761586 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04cd96-98bf-42eb-9d55-e0027c19d391 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:16.773197 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6cf0b-98f9-4495-afba-dafc61e06e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:16.776631 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6cf0b-98f9-4495-afba-dafc61e06e39 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:16.782122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6cf0b-98f9-4495-afba-dafc61e06e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:16.782495 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6cf0b-98f9-4495-afba-dafc61e06e39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:16.787897 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc6cf0b-98f9-4495-afba-dafc61e06e39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:16.798835 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc6cf0b-98f9-4495-afba-dafc61e06e39 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:16.835170 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ba2a8-2ecf-48da-a138-675ccc0a1468 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:16.841280 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1110/2220] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:50:16.856157 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ba2a8-2ecf-48da-a138-675ccc0a1468 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:16.871818 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539e116-dfff-4ec3-920d-9e52f8c73784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:16.872695 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539e116-dfff-4ec3-920d-9e52f8c73784 admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:16.874241 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539e116-dfff-4ec3-920d-9e52f8c73784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:16.874697 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539e116-dfff-4ec3-920d-9e52f8c73784 admin admin] PATH_INFO: `/v3/projects/58969156341343b294bdec18b0c76414/users/7fa896cc1cf14a29b68351a0236f4364/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:16.930229 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e539e116-dfff-4ec3-920d-9e52f8c73784 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58969156341343b294bdec18b0c76414, user_id=7fa896cc1cf14a29b68351a0236f4364, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:16.933086 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e539e116-dfff-4ec3-920d-9e52f8c73784 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:17.075095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1111/2221] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:50:16 2022] PUT /identity/v3/projects/58969156341343b294bdec18b0c76414/users/7fa896cc1cf14a29b68351a0236f4364/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:50:17.083870 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcf670-44c9-48e5-b611-12b3752460c7 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:17.084897 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcf670-44c9-48e5-b611-12b3752460c7 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:17.085340 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcf670-44c9-48e5-b611-12b3752460c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:17.121687 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-c2bcf670-44c9-48e5-b611-12b3752460c7 None None] MFA Rules not processed for user `7fa896cc1cf14a29b68351a0236f4364`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:50:17.123177 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-c2bcf670-44c9-48e5-b611-12b3752460c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:17.137544 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:50:17.207238 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1111/2222] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:50:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:50:17.212018 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539e116-dfff-4ec3-920d-9e52f8c73784 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:17.290574 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539e116-dfff-4ec3-920d-9e52f8c73784 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:17.309401 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d3630-b7e0-4d97-85c5-8f19c05d9ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:17.311714 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d3630-b7e0-4d97-85c5-8f19c05d9ea1 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:17.312087 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d3630-b7e0-4d97-85c5-8f19c05d9ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:17.313559 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d3630-b7e0-4d97-85c5-8f19c05d9ea1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:17.315244 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1d3630-b7e0-4d97-85c5-8f19c05d9ea1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:17.319742 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1d3630-b7e0-4d97-85c5-8f19c05d9ea1 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:17.483029 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1112/2223] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:50:17 2022] POST /identity/v3/projects => generated 385 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:50:17.488495 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bcf670-44c9-48e5-b611-12b3752460c7 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:17.500302 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bcf670-44c9-48e5-b611-12b3752460c7 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:17.534411 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0ce94-6cee-4e75-9874-36d1ae197abe None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:17.535250 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0ce94-6cee-4e75-9874-36d1ae197abe None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:17.535391 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0ce94-6cee-4e75-9874-36d1ae197abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:17.558482 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-a4f0ce94-6cee-4e75-9874-36d1ae197abe None None] MFA Rules not processed for user `6bea520676244effbbe212aa62b1cc68`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:50:17.559975 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-a4f0ce94-6cee-4e75-9874-36d1ae197abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:17.578995 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe465bd2-c3af-4d70-88ff-75c8a20feab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:17.579752 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe465bd2-c3af-4d70-88ff-75c8a20feab6 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:17.580041 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe465bd2-c3af-4d70-88ff-75c8a20feab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:17.580392 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe465bd2-c3af-4d70-88ff-75c8a20feab6 admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:17.581283 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe465bd2-c3af-4d70-88ff-75c8a20feab6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:17.584164 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe465bd2-c3af-4d70-88ff-75c8a20feab6 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:17.653294 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1113/2224] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Aug 5 02:50:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:50:17.672253 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0ce94-6cee-4e75-9874-36d1ae197abe None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:17.674346 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-a4f0ce94-6cee-4e75-9874-36d1ae197abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:17.712540 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1112/2225] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:50:17 2022] POST /identity/v3/users => generated 293 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:50:17.717559 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe465bd2-c3af-4d70-88ff-75c8a20feab6 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:17.730081 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe465bd2-c3af-4d70-88ff-75c8a20feab6 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:17.741009 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e6acb0-f1a6-4cb3-8982-dc44945b2e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:17.741009 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6acb0-f1a6-4cb3-8982-dc44945b2e3b admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:17.741009 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6acb0-f1a6-4cb3-8982-dc44945b2e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:17.741009 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6acb0-f1a6-4cb3-8982-dc44945b2e3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:17.741449 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e6acb0-f1a6-4cb3-8982-dc44945b2e3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:17.741449 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e6acb0-f1a6-4cb3-8982-dc44945b2e3b admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:17.756332 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1113/2226] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:50:17.760102 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e6acb0-f1a6-4cb3-8982-dc44945b2e3b admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:17.777150 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0ce94-6cee-4e75-9874-36d1ae197abe None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:17.778344 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e6acb0-f1a6-4cb3-8982-dc44945b2e3b admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:17.782300 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63feb3de-75fe-409d-aacd-dffeca92d504 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40f706f1eb2b4137afd367cb5060ced0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:17.783044 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63feb3de-75fe-409d-aacd-dffeca92d504 service swift] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:17.783322 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63feb3de-75fe-409d-aacd-dffeca92d504 service swift] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:17.783598 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63feb3de-75fe-409d-aacd-dffeca92d504 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:17.790431 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad35d15-2210-4753-9b0d-0c76ce48b5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:17.791180 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad35d15-2210-4753-9b0d-0c76ce48b5c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:17.792610 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad35d15-2210-4753-9b0d-0c76ce48b5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:17.792610 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad35d15-2210-4753-9b0d-0c76ce48b5c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:17.793409 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad35d15-2210-4753-9b0d-0c76ce48b5c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:17.794131 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63feb3de-75fe-409d-aacd-dffeca92d504 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:17.795302 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad35d15-2210-4753-9b0d-0c76ce48b5c1 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:17.795767 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63feb3de-75fe-409d-aacd-dffeca92d504 service swift] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:17.806716 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1114/2227] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 5 02:50:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 02:50:17.811465 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1114/2228] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:50:17.813482 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63feb3de-75fe-409d-aacd-dffeca92d504 service swift] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:17.824721 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63feb3de-75fe-409d-aacd-dffeca92d504 service swift] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:17.832686 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5caee42-b4ea-4102-a79f-e5afe4763042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:17.832686 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5caee42-b4ea-4102-a79f-e5afe4763042 admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:17.832686 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5caee42-b4ea-4102-a79f-e5afe4763042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:17.832686 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5caee42-b4ea-4102-a79f-e5afe4763042 admin admin] PATH_INFO: `/v3/projects/a74f8ec17d824a4da0eba7a3424f7206/users/4ca33c0253774e23a8b45bac6c352ede/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:17.847802 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5caee42-b4ea-4102-a79f-e5afe4763042 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a74f8ec17d824a4da0eba7a3424f7206, user_id=4ca33c0253774e23a8b45bac6c352ede, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:17.852345 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5caee42-b4ea-4102-a79f-e5afe4763042 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:17.977526 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1115/2229] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:50:17 2022] PUT /identity/v3/projects/a74f8ec17d824a4da0eba7a3424f7206/users/4ca33c0253774e23a8b45bac6c352ede/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:50:17.981658 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d037253-a517-41ab-814a-37d1f5af7280 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:17.982197 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d037253-a517-41ab-814a-37d1f5af7280 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:17.982908 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d037253-a517-41ab-814a-37d1f5af7280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:18.015821 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-5d037253-a517-41ab-814a-37d1f5af7280 None None] MFA Rules not processed for user `4ca33c0253774e23a8b45bac6c352ede`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:50:18.017281 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-5d037253-a517-41ab-814a-37d1f5af7280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:18.096322 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1115/2230] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:50:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:50:18.102349 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5caee42-b4ea-4102-a79f-e5afe4763042 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:18.192748 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5caee42-b4ea-4102-a79f-e5afe4763042 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:18.198069 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3ae49-3302-4313-a056-f6eab7cb7d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:18.198900 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3ae49-3302-4313-a056-f6eab7cb7d26 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:18.199217 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3ae49-3302-4313-a056-f6eab7cb7d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:18.199497 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3ae49-3302-4313-a056-f6eab7cb7d26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:18.200175 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df3ae49-3302-4313-a056-f6eab7cb7d26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:18.202333 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df3ae49-3302-4313-a056-f6eab7cb7d26 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:18.348967 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1116/2231] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:50:18 2022] POST /identity/v3/projects => generated 383 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:50:18.350571 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d037253-a517-41ab-814a-37d1f5af7280 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:18.368137 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d037253-a517-41ab-814a-37d1f5af7280 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:18.449113 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6caf4-b407-426b-8582-1ac6b43104cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:18.449868 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6caf4-b407-426b-8582-1ac6b43104cc admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:18.450924 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6caf4-b407-426b-8582-1ac6b43104cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:18.451497 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6caf4-b407-426b-8582-1ac6b43104cc admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:18.452451 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6caf4-b407-426b-8582-1ac6b43104cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:18.454904 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6caf4-b407-426b-8582-1ac6b43104cc admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:18.600994 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1116/2232] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:50:18 2022] POST /identity/v3/users => generated 298 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:50:18.605679 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3ae49-3302-4313-a056-f6eab7cb7d26 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:18.618663 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3ae49-3302-4313-a056-f6eab7cb7d26 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:18.626088 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69677573-815c-4959-983a-aacbecaf8c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:18.627036 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69677573-815c-4959-983a-aacbecaf8c20 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:18.627441 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69677573-815c-4959-983a-aacbecaf8c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:18.627809 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69677573-815c-4959-983a-aacbecaf8c20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:18.628654 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69677573-815c-4959-983a-aacbecaf8c20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:18.630363 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69677573-815c-4959-983a-aacbecaf8c20 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:18.663623 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1117/2233] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:50:18.668447 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6caf4-b407-426b-8582-1ac6b43104cc admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:18.683608 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6caf4-b407-426b-8582-1ac6b43104cc admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:18.690327 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe674293-f4d6-4df7-8635-eeebc1395893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:18.691129 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe674293-f4d6-4df7-8635-eeebc1395893 admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:18.691522 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe674293-f4d6-4df7-8635-eeebc1395893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:18.693780 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe674293-f4d6-4df7-8635-eeebc1395893 admin admin] PATH_INFO: `/v3/projects/297b95745b4b47d1a980efd55d8185fa/users/0d558535713346dda78db1f413dfd4eb/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:18.719757 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe674293-f4d6-4df7-8635-eeebc1395893 admin admin] RBAC: Authorizing `identity:create_grant(project_id=297b95745b4b47d1a980efd55d8185fa, user_id=0d558535713346dda78db1f413dfd4eb, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:18.724158 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe674293-f4d6-4df7-8635-eeebc1395893 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:18.837738 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1117/2234] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:50:18 2022] PUT /identity/v3/projects/297b95745b4b47d1a980efd55d8185fa/users/0d558535713346dda78db1f413dfd4eb/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:50:18.839771 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69677573-815c-4959-983a-aacbecaf8c20 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:18.855826 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69677573-815c-4959-983a-aacbecaf8c20 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:18.877791 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:50:18.989069 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465634d1-848e-499b-96fd-7a5f4d22bd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:18.989793 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465634d1-848e-499b-96fd-7a5f4d22bd1d admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:18.990171 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465634d1-848e-499b-96fd-7a5f4d22bd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:18.990516 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465634d1-848e-499b-96fd-7a5f4d22bd1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:18.991396 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465634d1-848e-499b-96fd-7a5f4d22bd1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:18.993139 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465634d1-848e-499b-96fd-7a5f4d22bd1d admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:19.013383 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1118/2235] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:50:19.017961 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe674293-f4d6-4df7-8635-eeebc1395893 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:19.033499 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe674293-f4d6-4df7-8635-eeebc1395893 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:19.040320 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e25feb-dc68-4729-a088-d206d2c899b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:19.042665 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e25feb-dc68-4729-a088-d206d2c899b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:19.043247 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e25feb-dc68-4729-a088-d206d2c899b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:19.043627 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e25feb-dc68-4729-a088-d206d2c899b2 admin admin] PATH_INFO: `/v3/projects/297b95745b4b47d1a980efd55d8185fa/users/0d558535713346dda78db1f413dfd4eb/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:19.046170 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e25feb-dc68-4729-a088-d206d2c899b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=297b95745b4b47d1a980efd55d8185fa, user_id=0d558535713346dda78db1f413dfd4eb, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:19.050138 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e25feb-dc68-4729-a088-d206d2c899b2 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:19.069899 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:50:19.077982 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1118/2236] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:50:19 2022] PUT /identity/v3/projects/297b95745b4b47d1a980efd55d8185fa/users/0d558535713346dda78db1f413dfd4eb/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:50:19.090338 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186efbe2-5d41-49eb-8633-bfe75ef543e6 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:19.090712 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186efbe2-5d41-49eb-8633-bfe75ef543e6 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:19.091097 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186efbe2-5d41-49eb-8633-bfe75ef543e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:19.150180 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-186efbe2-5d41-49eb-8633-bfe75ef543e6 None None] MFA Rules not processed for user `0d558535713346dda78db1f413dfd4eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:50:19.152202 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-186efbe2-5d41-49eb-8633-bfe75ef543e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:19.303119 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1119/2237] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:50:19 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:50:19.317659 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e25feb-dc68-4729-a088-d206d2c899b2 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:19.319630 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-e4e25feb-dc68-4729-a088-d206d2c899b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:19.394556 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:50:19.408280 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e25feb-dc68-4729-a088-d206d2c899b2 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:19.411788 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8754b8-b96f-4717-896f-6264b020af35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:19.412501 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8754b8-b96f-4717-896f-6264b020af35 service cinder] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:19.412842 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8754b8-b96f-4717-896f-6264b020af35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:19.413189 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8754b8-b96f-4717-896f-6264b020af35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:19.492004 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8754b8-b96f-4717-896f-6264b020af35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:19.493866 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8754b8-b96f-4717-896f-6264b020af35 service cinder] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:19.506995 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1119/2238] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:50:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:50:22.164054 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186efbe2-5d41-49eb-8633-bfe75ef543e6 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:22.165683 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-186efbe2-5d41-49eb-8633-bfe75ef543e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:22.188279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186efbe2-5d41-49eb-8633-bfe75ef543e6 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:22.202535 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a96174-9731-4b34-9d4b-eb45a0522eeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:22.203494 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a96174-9731-4b34-9d4b-eb45a0522eeb service cinder] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:22.203810 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a96174-9731-4b34-9d4b-eb45a0522eeb service cinder] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:22.204088 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a96174-9731-4b34-9d4b-eb45a0522eeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:22.290684 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a96174-9731-4b34-9d4b-eb45a0522eeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:22.293272 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a96174-9731-4b34-9d4b-eb45a0522eeb service cinder] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:22.303352 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1120/2239] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:50:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:50:24.238199 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8754b8-b96f-4717-896f-6264b020af35 service cinder] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:24.253090 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8754b8-b96f-4717-896f-6264b020af35 service cinder] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:24.256246 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef4e0b-629b-43eb-b96a-26f78043b39b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:24.257205 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef4e0b-629b-43eb-b96a-26f78043b39b service cinder] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:24.257654 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef4e0b-629b-43eb-b96a-26f78043b39b service cinder] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:24.258277 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef4e0b-629b-43eb-b96a-26f78043b39b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:24.273203 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:50:24.273203 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef4e0b-629b-43eb-b96a-26f78043b39b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:24.273986 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef4e0b-629b-43eb-b96a-26f78043b39b service cinder] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:24.289539 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1120/2240] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:50:24 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:50:29.544247 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a96174-9731-4b34-9d4b-eb45a0522eeb service cinder] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:29.630879 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a96174-9731-4b34-9d4b-eb45a0522eeb service cinder] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:29.635706 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5db9c-3608-4556-9f34-8ad1f91f8a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:29.636356 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5db9c-3608-4556-9f34-8ad1f91f8a70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:29.636642 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5db9c-3608-4556-9f34-8ad1f91f8a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:29.636917 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5db9c-3608-4556-9f34-8ad1f91f8a70 admin admin] PATH_INFO: `/v3/users/7fa896cc1cf14a29b68351a0236f4364` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:29.638104 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5db9c-3608-4556-9f34-8ad1f91f8a70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fa896cc1cf14a29b68351a0236f4364)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:29.640153 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5db9c-3608-4556-9f34-8ad1f91f8a70 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:29.895724 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-93c5db9c-3608-4556-9f34-8ad1f91f8a70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fa896cc1cf14a29b68351a0236f4364'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:29.964692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-93c5db9c-3608-4556-9f34-8ad1f91f8a70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fa896cc1cf14a29b68351a0236f4364'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:29.967388 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:50:29.976075 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-93c5db9c-3608-4556-9f34-8ad1f91f8a70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fa896cc1cf14a29b68351a0236f4364'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:29.991151 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-93c5db9c-3608-4556-9f34-8ad1f91f8a70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fa896cc1cf14a29b68351a0236f4364'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:29.991920 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-93c5db9c-3608-4556-9f34-8ad1f91f8a70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fa896cc1cf14a29b68351a0236f4364'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:29.998465 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1121/2241] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:50:29 2022] DELETE /identity/v3/users/7fa896cc1cf14a29b68351a0236f4364 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:50:30.003633 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928f661-7716-4616-9933-5eebb354176b None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:30.004168 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928f661-7716-4616-9933-5eebb354176b None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:30.004282 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928f661-7716-4616-9933-5eebb354176b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:30.025063 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-3928f661-7716-4616-9933-5eebb354176b None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:50:30.026201 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-3928f661-7716-4616-9933-5eebb354176b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:30.086378 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1121/2242] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:50:30.096692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5db9c-3608-4556-9f34-8ad1f91f8a70 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:30.098200 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-93c5db9c-3608-4556-9f34-8ad1f91f8a70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:30.158916 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5db9c-3608-4556-9f34-8ad1f91f8a70 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:30.162447 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c842c-c827-424b-a7c7-718c967b4dea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:30.163105 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c842c-c827-424b-a7c7-718c967b4dea service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:30.163389 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c842c-c827-424b-a7c7-718c967b4dea service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:30.163666 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c842c-c827-424b-a7c7-718c967b4dea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:30.173390 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c842c-c827-424b-a7c7-718c967b4dea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:30.175002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c842c-c827-424b-a7c7-718c967b4dea service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:30.185599 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1122/2243] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:50:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:50:30.725990 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3928f661-7716-4616-9933-5eebb354176b None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:30.727473 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-3928f661-7716-4616-9933-5eebb354176b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:30.740616 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3928f661-7716-4616-9933-5eebb354176b None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:30.745615 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a866ef81-7284-47cc-8dd7-83cf0c7bf7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:30.746470 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a866ef81-7284-47cc-8dd7-83cf0c7bf7d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:30.746754 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a866ef81-7284-47cc-8dd7-83cf0c7bf7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:30.747072 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a866ef81-7284-47cc-8dd7-83cf0c7bf7d8 admin admin] PATH_INFO: `/v3/projects/58969156341343b294bdec18b0c76414` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:30.751190 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a866ef81-7284-47cc-8dd7-83cf0c7bf7d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58969156341343b294bdec18b0c76414)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:30.753174 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a866ef81-7284-47cc-8dd7-83cf0c7bf7d8 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:30.873661 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-a866ef81-7284-47cc-8dd7-83cf0c7bf7d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58969156341343b294bdec18b0c76414', 'request_id': 'req-a866ef81-7284-47cc-8dd7-83cf0c7bf7d8'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:30.952380 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-a866ef81-7284-47cc-8dd7-83cf0c7bf7d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58969156341343b294bdec18b0c76414', 'request_id': 'req-a866ef81-7284-47cc-8dd7-83cf0c7bf7d8'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:30.958926 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-a866ef81-7284-47cc-8dd7-83cf0c7bf7d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58969156341343b294bdec18b0c76414', 'request_id': 'req-a866ef81-7284-47cc-8dd7-83cf0c7bf7d8'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:30.971208 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-a866ef81-7284-47cc-8dd7-83cf0c7bf7d8 admin admin] The token cache is being invalidate because project 58969156341343b294bdec18b0c76414 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:50:30.971351 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-a866ef81-7284-47cc-8dd7-83cf0c7bf7d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:30.971963 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-a866ef81-7284-47cc-8dd7-83cf0c7bf7d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:30.973525 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1122/2244] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:50:30 2022] DELETE /identity/v3/projects/58969156341343b294bdec18b0c76414 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:50:30.977751 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c842c-c827-424b-a7c7-718c967b4dea service neutron] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:30.988495 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c842c-c827-424b-a7c7-718c967b4dea service neutron] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:31.049847 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b2a02-4ce2-4422-9e78-14978216b3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:31.050492 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b2a02-4ce2-4422-9e78-14978216b3f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:31.050771 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b2a02-4ce2-4422-9e78-14978216b3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:31.051075 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b2a02-4ce2-4422-9e78-14978216b3f0 admin admin] PATH_INFO: `/v3/users/4ca33c0253774e23a8b45bac6c352ede` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:31.052287 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b2a02-4ce2-4422-9e78-14978216b3f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ca33c0253774e23a8b45bac6c352ede)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:31.054234 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b2a02-4ce2-4422-9e78-14978216b3f0 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:31.211132 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-de3b2a02-4ce2-4422-9e78-14978216b3f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ca33c0253774e23a8b45bac6c352ede'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:31.284051 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-de3b2a02-4ce2-4422-9e78-14978216b3f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ca33c0253774e23a8b45bac6c352ede'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:31.292416 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-de3b2a02-4ce2-4422-9e78-14978216b3f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ca33c0253774e23a8b45bac6c352ede'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:31.302623 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:50:31.305095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-de3b2a02-4ce2-4422-9e78-14978216b3f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ca33c0253774e23a8b45bac6c352ede'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:31.305912 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-de3b2a02-4ce2-4422-9e78-14978216b3f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ca33c0253774e23a8b45bac6c352ede'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:31.313188 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1123/2245] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:50:30 2022] DELETE /identity/v3/users/4ca33c0253774e23a8b45bac6c352ede => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:50:31.942852 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a866ef81-7284-47cc-8dd7-83cf0c7bf7d8 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:31.945761 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-a866ef81-7284-47cc-8dd7-83cf0c7bf7d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:31.961114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a866ef81-7284-47cc-8dd7-83cf0c7bf7d8 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:32.025030 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86a70c-497f-4625-8012-7643ded527e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:32.026281 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86a70c-497f-4625-8012-7643ded527e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:32.026281 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86a70c-497f-4625-8012-7643ded527e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:32.026281 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86a70c-497f-4625-8012-7643ded527e9 admin admin] PATH_INFO: `/v3/projects/a74f8ec17d824a4da0eba7a3424f7206` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:32.027536 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86a70c-497f-4625-8012-7643ded527e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a74f8ec17d824a4da0eba7a3424f7206)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:32.029500 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86a70c-497f-4625-8012-7643ded527e9 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:32.054119 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:50:32.113475 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-ef86a70c-497f-4625-8012-7643ded527e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a74f8ec17d824a4da0eba7a3424f7206', 'request_id': 'req-ef86a70c-497f-4625-8012-7643ded527e9'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:32.184722 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-ef86a70c-497f-4625-8012-7643ded527e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a74f8ec17d824a4da0eba7a3424f7206', 'request_id': 'req-ef86a70c-497f-4625-8012-7643ded527e9'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:32.190762 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-ef86a70c-497f-4625-8012-7643ded527e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a74f8ec17d824a4da0eba7a3424f7206', 'request_id': 'req-ef86a70c-497f-4625-8012-7643ded527e9'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:32.203075 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-ef86a70c-497f-4625-8012-7643ded527e9 admin admin] The token cache is being invalidate because project a74f8ec17d824a4da0eba7a3424f7206 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:50:32.203364 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-ef86a70c-497f-4625-8012-7643ded527e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:32.204050 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-ef86a70c-497f-4625-8012-7643ded527e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:32.205562 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1123/2246] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:50:31 2022] DELETE /identity/v3/projects/a74f8ec17d824a4da0eba7a3424f7206 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:50:32.209615 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b2a02-4ce2-4422-9e78-14978216b3f0 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:32.211077 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-de3b2a02-4ce2-4422-9e78-14978216b3f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:32.225280 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b2a02-4ce2-4422-9e78-14978216b3f0 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:32.285778 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faca32b5-cce9-4806-8294-667b6b401a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:32.286459 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca32b5-cce9-4806-8294-667b6b401a7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:32.286743 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca32b5-cce9-4806-8294-667b6b401a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:32.287069 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca32b5-cce9-4806-8294-667b6b401a7d admin admin] PATH_INFO: `/v3/users/0d558535713346dda78db1f413dfd4eb` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:32.288251 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faca32b5-cce9-4806-8294-667b6b401a7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d558535713346dda78db1f413dfd4eb)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:32.290199 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faca32b5-cce9-4806-8294-667b6b401a7d admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:32.466270 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-faca32b5-cce9-4806-8294-667b6b401a7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d558535713346dda78db1f413dfd4eb'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:32.523640 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-faca32b5-cce9-4806-8294-667b6b401a7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d558535713346dda78db1f413dfd4eb'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:32.531704 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-faca32b5-cce9-4806-8294-667b6b401a7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d558535713346dda78db1f413dfd4eb'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:32.547715 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-faca32b5-cce9-4806-8294-667b6b401a7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d558535713346dda78db1f413dfd4eb'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:32.548556 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-faca32b5-cce9-4806-8294-667b6b401a7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d558535713346dda78db1f413dfd4eb'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:32.555341 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1124/2247] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:50:32 2022] DELETE /identity/v3/users/0d558535713346dda78db1f413dfd4eb => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:50:33.006464 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86a70c-497f-4625-8012-7643ded527e9 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:33.008002 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-ef86a70c-497f-4625-8012-7643ded527e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:33.022081 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86a70c-497f-4625-8012-7643ded527e9 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:33.085773 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f842be-16a4-4260-8ef4-917aec2dc9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:33.086477 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f842be-16a4-4260-8ef4-917aec2dc9eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:33.086754 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f842be-16a4-4260-8ef4-917aec2dc9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:33.087155 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f842be-16a4-4260-8ef4-917aec2dc9eb admin admin] PATH_INFO: `/v3/projects/297b95745b4b47d1a980efd55d8185fa` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:33.088502 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f842be-16a4-4260-8ef4-917aec2dc9eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=297b95745b4b47d1a980efd55d8185fa)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:33.090821 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f842be-16a4-4260-8ef4-917aec2dc9eb admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:33.223736 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-e2f842be-16a4-4260-8ef4-917aec2dc9eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '297b95745b4b47d1a980efd55d8185fa', 'request_id': 'req-e2f842be-16a4-4260-8ef4-917aec2dc9eb'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:33.322055 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-e2f842be-16a4-4260-8ef4-917aec2dc9eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '297b95745b4b47d1a980efd55d8185fa', 'request_id': 'req-e2f842be-16a4-4260-8ef4-917aec2dc9eb'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:33.328432 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-e2f842be-16a4-4260-8ef4-917aec2dc9eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '297b95745b4b47d1a980efd55d8185fa', 'request_id': 'req-e2f842be-16a4-4260-8ef4-917aec2dc9eb'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:33.341012 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-e2f842be-16a4-4260-8ef4-917aec2dc9eb admin admin] The token cache is being invalidate because project 297b95745b4b47d1a980efd55d8185fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:50:33.341305 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-e2f842be-16a4-4260-8ef4-917aec2dc9eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:33.341959 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-e2f842be-16a4-4260-8ef4-917aec2dc9eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:33.343547 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1124/2248] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:50:33 2022] DELETE /identity/v3/projects/297b95745b4b47d1a980efd55d8185fa => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:50:33.348405 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c309f0f-4bed-4790-b612-bf1d507bd30f None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:33.348875 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c309f0f-4bed-4790-b612-bf1d507bd30f None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:33.348982 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c309f0f-4bed-4790-b612-bf1d507bd30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:33.370796 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-9c309f0f-4bed-4790-b612-bf1d507bd30f None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:50:33.372047 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-9c309f0f-4bed-4790-b612-bf1d507bd30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:33.431588 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1125/2249] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:50:33.497392 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef367f6b-52cf-401d-8d22-6964ff1c94a7 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:33.497677 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef367f6b-52cf-401d-8d22-6964ff1c94a7 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:33.497953 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef367f6b-52cf-401d-8d22-6964ff1c94a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:33.517155 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-ef367f6b-52cf-401d-8d22-6964ff1c94a7 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:50:33.518377 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-ef367f6b-52cf-401d-8d22-6964ff1c94a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:33.526347 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1125/2250] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:50:33.530492 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c309f0f-4bed-4790-b612-bf1d507bd30f None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:33.540064 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c309f0f-4bed-4790-b612-bf1d507bd30f None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:33.545176 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0bd681-f2b5-4b56-9587-b9f5d7cfeb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:33.545788 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0bd681-f2b5-4b56-9587-b9f5d7cfeb62 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:33.546071 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0bd681-f2b5-4b56-9587-b9f5d7cfeb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:33.546345 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0bd681-f2b5-4b56-9587-b9f5d7cfeb62 admin admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:33.547069 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0bd681-f2b5-4b56-9587-b9f5d7cfeb62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:50:33.547376 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0bd681-f2b5-4b56-9587-b9f5d7cfeb62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:33.548975 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0bd681-f2b5-4b56-9587-b9f5d7cfeb62 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:33.557940 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:50:33.561067 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1126/2251] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:50:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:50:33.565325 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef367f6b-52cf-401d-8d22-6964ff1c94a7 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:33.574978 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef367f6b-52cf-401d-8d22-6964ff1c94a7 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:33.579905 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d362e98-79f3-43d5-b028-37eae7a668eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:33.580528 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d362e98-79f3-43d5-b028-37eae7a668eb admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:33.580818 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d362e98-79f3-43d5-b028-37eae7a668eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:33.581111 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d362e98-79f3-43d5-b028-37eae7a668eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:33.581762 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d362e98-79f3-43d5-b028-37eae7a668eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:33.583718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d362e98-79f3-43d5-b028-37eae7a668eb admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:33.689646 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1126/2252] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:50:33 2022] POST /identity/v3/projects => generated 373 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:50:33.694036 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0bd681-f2b5-4b56-9587-b9f5d7cfeb62 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:33.704093 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0bd681-f2b5-4b56-9587-b9f5d7cfeb62 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:33.762134 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4287c803-690b-43a8-9a0c-b7d113b35e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:33.762907 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287c803-690b-43a8-9a0c-b7d113b35e5c admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:33.763233 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287c803-690b-43a8-9a0c-b7d113b35e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:33.763659 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287c803-690b-43a8-9a0c-b7d113b35e5c admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:33.764349 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4287c803-690b-43a8-9a0c-b7d113b35e5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:33.766324 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4287c803-690b-43a8-9a0c-b7d113b35e5c admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:33.893947 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1127/2253] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:50:33 2022] POST /identity/v3/users => generated 287 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:50:33.898075 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d362e98-79f3-43d5-b028-37eae7a668eb admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:33.909202 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d362e98-79f3-43d5-b028-37eae7a668eb admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:33.913825 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477022c4-d3b0-4e7d-a31a-0a6937ce3044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:33.914546 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477022c4-d3b0-4e7d-a31a-0a6937ce3044 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:33.914979 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477022c4-d3b0-4e7d-a31a-0a6937ce3044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:33.915263 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477022c4-d3b0-4e7d-a31a-0a6937ce3044 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:33.916597 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477022c4-d3b0-4e7d-a31a-0a6937ce3044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:33.918338 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477022c4-d3b0-4e7d-a31a-0a6937ce3044 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:33.924508 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:50:33.929629 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1127/2254] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:50:33.933875 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4287c803-690b-43a8-9a0c-b7d113b35e5c admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:33.943983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4287c803-690b-43a8-9a0c-b7d113b35e5c admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:33.948781 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1f7aa-dfde-4334-900a-028235fd49af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:33.949396 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1f7aa-dfde-4334-900a-028235fd49af admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:33.949681 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1f7aa-dfde-4334-900a-028235fd49af admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:33.949965 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1f7aa-dfde-4334-900a-028235fd49af admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:33.950671 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1f7aa-dfde-4334-900a-028235fd49af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:33.952327 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1f7aa-dfde-4334-900a-028235fd49af admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:33.963583 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1128/2255] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:50:33.968083 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477022c4-d3b0-4e7d-a31a-0a6937ce3044 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:33.980804 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477022c4-d3b0-4e7d-a31a-0a6937ce3044 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:33.985623 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425964ce-60ff-40f2-afe1-df25f0f7e3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:33.986295 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425964ce-60ff-40f2-afe1-df25f0f7e3e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:33.986572 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425964ce-60ff-40f2-afe1-df25f0f7e3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:33.986850 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425964ce-60ff-40f2-afe1-df25f0f7e3e2 admin admin] PATH_INFO: `/v3/projects/d17ab49aa3e54be7bb4ff74a63a01a92/users/55df59986d294b87a31e4b4faf88afe3/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:34.004017 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425964ce-60ff-40f2-afe1-df25f0f7e3e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d17ab49aa3e54be7bb4ff74a63a01a92, user_id=55df59986d294b87a31e4b4faf88afe3, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:34.006741 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425964ce-60ff-40f2-afe1-df25f0f7e3e2 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:34.113128 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1128/2256] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:50:33 2022] PUT /identity/v3/projects/d17ab49aa3e54be7bb4ff74a63a01a92/users/55df59986d294b87a31e4b4faf88afe3/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:50:34.123755 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fdc403-c2b1-459b-86e1-944f68884932 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:34.124044 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fdc403-c2b1-459b-86e1-944f68884932 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:34.124324 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fdc403-c2b1-459b-86e1-944f68884932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:34.157080 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-83fdc403-c2b1-459b-86e1-944f68884932 None None] MFA Rules not processed for user `55df59986d294b87a31e4b4faf88afe3`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:50:34.158204 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-83fdc403-c2b1-459b-86e1-944f68884932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:34.237355 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1129/2257] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:50:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:50:34.248602 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425964ce-60ff-40f2-afe1-df25f0f7e3e2 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:34.250540 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-425964ce-60ff-40f2-afe1-df25f0f7e3e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:34.322744 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425964ce-60ff-40f2-afe1-df25f0f7e3e2 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:34.327072 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc8626b-329f-47d4-81dc-46a47ca7d5fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:34.329269 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8626b-329f-47d4-81dc-46a47ca7d5fb service cinder] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:34.329573 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8626b-329f-47d4-81dc-46a47ca7d5fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:34.329965 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8626b-329f-47d4-81dc-46a47ca7d5fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:34.343670 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc8626b-329f-47d4-81dc-46a47ca7d5fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:34.345150 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc8626b-329f-47d4-81dc-46a47ca7d5fb service cinder] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:34.358342 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1129/2258] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:50:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:50:36.263883 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81616e4-0aff-4077-8b3b-f39dcb013d42 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:36.264441 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81616e4-0aff-4077-8b3b-f39dcb013d42 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:36.264441 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81616e4-0aff-4077-8b3b-f39dcb013d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:36.286481 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-d81616e4-0aff-4077-8b3b-f39dcb013d42 None None] MFA Rules not processed for user `55df59986d294b87a31e4b4faf88afe3`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:50:36.287742 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-d81616e4-0aff-4077-8b3b-f39dcb013d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:36.295019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1130/2259] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:50:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:50:37.320353 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e22d5c-e97e-4000-9b4d-d289fa4d88a3 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:37.323039 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e22d5c-e97e-4000-9b4d-d289fa4d88a3 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:37.323039 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e22d5c-e97e-4000-9b4d-d289fa4d88a3 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:37.323039 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1130/2260] 10.222.0.42 () {54 vars in 921 bytes} [Fri Aug 5 02:50:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:50:37.329428 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383fae3-f9a6-48f6-9239-783138326d11 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:37.330030 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383fae3-f9a6-48f6-9239-783138326d11 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:37.330030 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383fae3-f9a6-48f6-9239-783138326d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:37.351137 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-6383fae3-f9a6-48f6-9239-783138326d11 None None] MFA Rules not processed for user `55374d3bccd541c9a8f82da9b21c2fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:50:37.354241 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-6383fae3-f9a6-48f6-9239-783138326d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:37.413753 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:50:37.429005 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1131/2261] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Aug 5 02:50:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:50:37.442902 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e22d5c-e97e-4000-9b4d-d289fa4d88a3 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:37.444621 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-77e22d5c-e97e-4000-9b4d-d289fa4d88a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:37.507293 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e22d5c-e97e-4000-9b4d-d289fa4d88a3 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:37.510833 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80887368-3f80-448a-b87e-27fbb8aa9c09 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '116f66d7dd7b42878f71bd29dc55729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:37.511477 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80887368-3f80-448a-b87e-27fbb8aa9c09 service glance] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:37.511762 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80887368-3f80-448a-b87e-27fbb8aa9c09 service glance] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:37.512152 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80887368-3f80-448a-b87e-27fbb8aa9c09 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:37.523722 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80887368-3f80-448a-b87e-27fbb8aa9c09 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:37.525724 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80887368-3f80-448a-b87e-27fbb8aa9c09 service glance] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:37.536744 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1131/2262] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:50:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:50:37.803014 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6389e-4727-4900-a70b-6faca17566cf None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:37.803308 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6389e-4727-4900-a70b-6faca17566cf None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:37.803624 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6389e-4727-4900-a70b-6faca17566cf None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:37.805030 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1132/2263] 10.222.0.42 () {54 vars in 921 bytes} [Fri Aug 5 02:50:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:50:37.809840 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466c2c7-4796-434d-80b8-4633818da0ec None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:37.810127 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466c2c7-4796-434d-80b8-4633818da0ec None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:37.810402 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466c2c7-4796-434d-80b8-4633818da0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:37.830708 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-5466c2c7-4796-434d-80b8-4633818da0ec None None] MFA Rules not processed for user `a0035fcd8b06400bb7946f7ac37393a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:50:37.843017 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-5466c2c7-4796-434d-80b8-4633818da0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:37.887912 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1132/2264] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Aug 5 02:50:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:50:37.900276 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c6389e-4727-4900-a70b-6faca17566cf None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:37.901993 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-69c6389e-4727-4900-a70b-6faca17566cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:37.917481 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c6389e-4727-4900-a70b-6faca17566cf None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:37.921077 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aca3b9-13aa-4724-a57d-84f85a9703d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:37.921691 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aca3b9-13aa-4724-a57d-84f85a9703d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:37.922014 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aca3b9-13aa-4724-a57d-84f85a9703d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:37.922288 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aca3b9-13aa-4724-a57d-84f85a9703d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:37.929803 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aca3b9-13aa-4724-a57d-84f85a9703d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:37.931460 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aca3b9-13aa-4724-a57d-84f85a9703d3 service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:37.939553 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1133/2265] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:50:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:50:38.027364 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f051ff-4355-4422-aa3f-87183edd6e7f None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:38.027658 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f051ff-4355-4422-aa3f-87183edd6e7f None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:38.027938 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f051ff-4355-4422-aa3f-87183edd6e7f None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:38.029320 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1133/2266] 10.222.0.42 () {54 vars in 921 bytes} [Fri Aug 5 02:50:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:50:38.036242 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319ee81-676f-42f6-9ba8-747dafa307d0 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:38.036602 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319ee81-676f-42f6-9ba8-747dafa307d0 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:38.036946 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319ee81-676f-42f6-9ba8-747dafa307d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:38.058245 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-a319ee81-676f-42f6-9ba8-747dafa307d0 None None] MFA Rules not processed for user `55374d3bccd541c9a8f82da9b21c2fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:50:38.059813 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-a319ee81-676f-42f6-9ba8-747dafa307d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:38.069417 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1134/2267] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Aug 5 02:50:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:50:38.081756 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f051ff-4355-4422-aa3f-87183edd6e7f None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:38.094066 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f051ff-4355-4422-aa3f-87183edd6e7f None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:38.097709 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d092b-c721-440a-9ca6-30eaae5b2938 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:38.098265 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d092b-c721-440a-9ca6-30eaae5b2938 service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:38.098544 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d092b-c721-440a-9ca6-30eaae5b2938 service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:38.098836 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d092b-c721-440a-9ca6-30eaae5b2938 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:38.109486 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d092b-c721-440a-9ca6-30eaae5b2938 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:38.110937 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d092b-c721-440a-9ca6-30eaae5b2938 service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:38.122507 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1134/2268] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:50:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:50:41.873228 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3aea53-f5de-4dd5-bd4a-5bfe7d4633e9 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:41.873687 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3aea53-f5de-4dd5-bd4a-5bfe7d4633e9 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:41.873792 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3aea53-f5de-4dd5-bd4a-5bfe7d4633e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:41.893323 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-2d3aea53-f5de-4dd5-bd4a-5bfe7d4633e9 None None] MFA Rules not processed for user `6bea520676244effbbe212aa62b1cc68`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:50:41.894535 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-2d3aea53-f5de-4dd5-bd4a-5bfe7d4633e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:41.961991 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1135/2269] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Aug 5 02:50:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:50:41.975334 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d092b-c721-440a-9ca6-30eaae5b2938 service neutron] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:41.979810 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-827d092b-c721-440a-9ca6-30eaae5b2938 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:42.012868 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:50:42.077442 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d092b-c721-440a-9ca6-30eaae5b2938 service neutron] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:42.082716 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3657c1a-c734-4a4c-87cc-17fee7952b87 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40f706f1eb2b4137afd367cb5060ced0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:42.083367 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3657c1a-c734-4a4c-87cc-17fee7952b87 service swift] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:42.083719 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3657c1a-c734-4a4c-87cc-17fee7952b87 service swift] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:42.083929 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3657c1a-c734-4a4c-87cc-17fee7952b87 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:42.092935 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3657c1a-c734-4a4c-87cc-17fee7952b87 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:42.094516 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3657c1a-c734-4a4c-87cc-17fee7952b87 service swift] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:42.102808 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1135/2270] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 5 02:50:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 02:50:48.221376 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3aea53-f5de-4dd5-bd4a-5bfe7d4633e9 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:48.222835 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-2d3aea53-f5de-4dd5-bd4a-5bfe7d4633e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:48.297274 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3aea53-f5de-4dd5-bd4a-5bfe7d4633e9 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:48.365464 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0920668-3f9f-45a6-974f-43d7709383ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:48.365464 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0920668-3f9f-45a6-974f-43d7709383ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:48.365464 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0920668-3f9f-45a6-974f-43d7709383ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:48.365464 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0920668-3f9f-45a6-974f-43d7709383ab admin admin] PATH_INFO: `/v3/users/5e36da26fd4a491dbf8d03f6e8d6a96e` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:48.366678 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0920668-3f9f-45a6-974f-43d7709383ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e36da26fd4a491dbf8d03f6e8d6a96e)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:48.366678 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0920668-3f9f-45a6-974f-43d7709383ab admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:48.890385 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-a0920668-3f9f-45a6-974f-43d7709383ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e36da26fd4a491dbf8d03f6e8d6a96e'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:49.266032 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-a0920668-3f9f-45a6-974f-43d7709383ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e36da26fd4a491dbf8d03f6e8d6a96e'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:49.279936 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-a0920668-3f9f-45a6-974f-43d7709383ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e36da26fd4a491dbf8d03f6e8d6a96e'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:49.295239 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-a0920668-3f9f-45a6-974f-43d7709383ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e36da26fd4a491dbf8d03f6e8d6a96e'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:49.295964 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-a0920668-3f9f-45a6-974f-43d7709383ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e36da26fd4a491dbf8d03f6e8d6a96e'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:49.298127 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:50:49.303434 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1136/2271] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:50:48 2022] DELETE /identity/v3/users/5e36da26fd4a491dbf8d03f6e8d6a96e => generated 0 bytes in 1083 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:50:49.308654 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164c508-83ca-4325-ab3c-fe092d984c06 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:49.309145 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164c508-83ca-4325-ab3c-fe092d984c06 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:49.309249 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164c508-83ca-4325-ab3c-fe092d984c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:49.328881 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-b164c508-83ca-4325-ab3c-fe092d984c06 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:50:49.330358 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-b164c508-83ca-4325-ab3c-fe092d984c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:49.392989 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1136/2272] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:50:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:50:49.403348 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0920668-3f9f-45a6-974f-43d7709383ab admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:49.404844 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-a0920668-3f9f-45a6-974f-43d7709383ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:49.464488 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0920668-3f9f-45a6-974f-43d7709383ab admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:49.468586 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec204eb-1028-4557-a242-3cd5ec4beec7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:49.469214 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec204eb-1028-4557-a242-3cd5ec4beec7 service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:49.469726 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec204eb-1028-4557-a242-3cd5ec4beec7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:49.469869 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec204eb-1028-4557-a242-3cd5ec4beec7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:49.480776 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec204eb-1028-4557-a242-3cd5ec4beec7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:49.482299 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec204eb-1028-4557-a242-3cd5ec4beec7 service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:49.492604 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1137/2273] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:50:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:50:50.353218 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164c508-83ca-4325-ab3c-fe092d984c06 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:50.354683 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-b164c508-83ca-4325-ab3c-fe092d984c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:50.368883 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164c508-83ca-4325-ab3c-fe092d984c06 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:50.381120 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4fd6a0-88a4-4d54-b9f3-9173eb180425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:50.387484 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fd6a0-88a4-4d54-b9f3-9173eb180425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:50.387782 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fd6a0-88a4-4d54-b9f3-9173eb180425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:50.388091 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fd6a0-88a4-4d54-b9f3-9173eb180425 admin admin] PATH_INFO: `/v3/projects/208458e15ee341faa2dca5d6b366b198` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:50.389383 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4fd6a0-88a4-4d54-b9f3-9173eb180425 admin admin] RBAC: Authorizing `identity:delete_project(project_id=208458e15ee341faa2dca5d6b366b198)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:50.391362 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4fd6a0-88a4-4d54-b9f3-9173eb180425 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:50.528841 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-0c4fd6a0-88a4-4d54-b9f3-9173eb180425 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '208458e15ee341faa2dca5d6b366b198', 'request_id': 'req-0c4fd6a0-88a4-4d54-b9f3-9173eb180425'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:50.600556 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-0c4fd6a0-88a4-4d54-b9f3-9173eb180425 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '208458e15ee341faa2dca5d6b366b198', 'request_id': 'req-0c4fd6a0-88a4-4d54-b9f3-9173eb180425'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:50.608778 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-0c4fd6a0-88a4-4d54-b9f3-9173eb180425 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '208458e15ee341faa2dca5d6b366b198', 'request_id': 'req-0c4fd6a0-88a4-4d54-b9f3-9173eb180425'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:50.626809 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-0c4fd6a0-88a4-4d54-b9f3-9173eb180425 admin admin] The token cache is being invalidate because project 208458e15ee341faa2dca5d6b366b198 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:50:50.627222 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-0c4fd6a0-88a4-4d54-b9f3-9173eb180425 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:50.628010 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-0c4fd6a0-88a4-4d54-b9f3-9173eb180425 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:50:50.629589 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1137/2274] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:50:50 2022] DELETE /identity/v3/projects/208458e15ee341faa2dca5d6b366b198 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:50:50.634695 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f9828-0d8d-4805-ad5f-64450f89a2be None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:50.635387 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f9828-0d8d-4805-ad5f-64450f89a2be None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:50.637284 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f9828-0d8d-4805-ad5f-64450f89a2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:50.660170 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-772f9828-0d8d-4805-ad5f-64450f89a2be None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:50:50.661492 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-772f9828-0d8d-4805-ad5f-64450f89a2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:50.726465 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1138/2275] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:50:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:50:50.736070 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47276ab-03bf-4376-9dd0-9b9858d5b690 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:50.736365 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47276ab-03bf-4376-9dd0-9b9858d5b690 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:50.736690 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47276ab-03bf-4376-9dd0-9b9858d5b690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:50.775045 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-f47276ab-03bf-4376-9dd0-9b9858d5b690 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:50:50.777427 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-f47276ab-03bf-4376-9dd0-9b9858d5b690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:50.954423 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1138/2276] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:50:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:50:50.955692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f9828-0d8d-4805-ad5f-64450f89a2be None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:50.955692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f9828-0d8d-4805-ad5f-64450f89a2be None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:50.955692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660036fa-a504-432f-9798-fe386e8a2cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:50.955692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660036fa-a504-432f-9798-fe386e8a2cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:50.956247 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660036fa-a504-432f-9798-fe386e8a2cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:50.956247 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660036fa-a504-432f-9798-fe386e8a2cc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:50.956725 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660036fa-a504-432f-9798-fe386e8a2cc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:50:50.956811 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660036fa-a504-432f-9798-fe386e8a2cc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:50.958583 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660036fa-a504-432f-9798-fe386e8a2cc7 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:50.976509 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1139/2277] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:50:50.980625 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47276ab-03bf-4376-9dd0-9b9858d5b690 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:50.996195 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47276ab-03bf-4376-9dd0-9b9858d5b690 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:51.001360 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd94192-4e1b-48f2-8dfc-ee854701cc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:51.001987 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd94192-4e1b-48f2-8dfc-ee854701cc7e admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:51.002293 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd94192-4e1b-48f2-8dfc-ee854701cc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:51.002578 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd94192-4e1b-48f2-8dfc-ee854701cc7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:51.003564 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd94192-4e1b-48f2-8dfc-ee854701cc7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:51.005960 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd94192-4e1b-48f2-8dfc-ee854701cc7e admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:51.139421 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1139/2278] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:50:50 2022] POST /identity/v3/projects => generated 381 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:50:51.143645 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660036fa-a504-432f-9798-fe386e8a2cc7 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:51.156852 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660036fa-a504-432f-9798-fe386e8a2cc7 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:51.249506 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec521edd-d036-48a0-ba29-708ccce60cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:51.250316 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec521edd-d036-48a0-ba29-708ccce60cbf admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:51.250679 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec521edd-d036-48a0-ba29-708ccce60cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:51.251057 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec521edd-d036-48a0-ba29-708ccce60cbf admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:51.251798 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec521edd-d036-48a0-ba29-708ccce60cbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:51.253953 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec521edd-d036-48a0-ba29-708ccce60cbf admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:51.361258 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1140/2279] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:50:51 2022] POST /identity/v3/users => generated 291 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:50:51.362850 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd94192-4e1b-48f2-8dfc-ee854701cc7e admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:51.370006 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:50:51.375718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd94192-4e1b-48f2-8dfc-ee854701cc7e admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:51.380440 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28f39e-078d-458f-9138-391ceb14c08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:51.381070 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28f39e-078d-458f-9138-391ceb14c08b admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:51.381354 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28f39e-078d-458f-9138-391ceb14c08b admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:51.381631 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28f39e-078d-458f-9138-391ceb14c08b admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:51.382394 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b28f39e-078d-458f-9138-391ceb14c08b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:51.384149 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b28f39e-078d-458f-9138-391ceb14c08b admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:51.395784 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1140/2280] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:50:51.402240 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec521edd-d036-48a0-ba29-708ccce60cbf admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:51.413965 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec521edd-d036-48a0-ba29-708ccce60cbf admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:51.419395 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31146e-200b-4b2b-b105-8a386bf56b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:51.426630 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31146e-200b-4b2b-b105-8a386bf56b3c admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:51.426630 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31146e-200b-4b2b-b105-8a386bf56b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:51.426630 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31146e-200b-4b2b-b105-8a386bf56b3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:51.426630 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c31146e-200b-4b2b-b105-8a386bf56b3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:51.426630 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c31146e-200b-4b2b-b105-8a386bf56b3c admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:51.435715 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1141/2281] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:50:51.439947 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28f39e-078d-458f-9138-391ceb14c08b admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:51.453602 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28f39e-078d-458f-9138-391ceb14c08b admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:51.464009 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc143b72-f384-4982-b474-5ecc930a1636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:51.464778 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc143b72-f384-4982-b474-5ecc930a1636 admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:51.465063 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc143b72-f384-4982-b474-5ecc930a1636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:51.465427 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc143b72-f384-4982-b474-5ecc930a1636 admin admin] PATH_INFO: `/v3/projects/26d5d551156a4ce8a133160cd5d2e33a/users/a1fe4b24e4f346d6bcbbeb3afd54450a/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:51.487349 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc143b72-f384-4982-b474-5ecc930a1636 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26d5d551156a4ce8a133160cd5d2e33a, user_id=a1fe4b24e4f346d6bcbbeb3afd54450a, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:51.490049 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc143b72-f384-4982-b474-5ecc930a1636 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:51.563804 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1141/2282] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:50:51 2022] PUT /identity/v3/projects/26d5d551156a4ce8a133160cd5d2e33a/users/a1fe4b24e4f346d6bcbbeb3afd54450a/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:50:51.569074 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2d585-998c-4381-b22c-870de89caa8f None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:51.569386 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2d585-998c-4381-b22c-870de89caa8f None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:51.569665 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2d585-998c-4381-b22c-870de89caa8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:51.582890 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:50:51.589073 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-aaa2d585-998c-4381-b22c-870de89caa8f None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:50:51.590283 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-aaa2d585-998c-4381-b22c-870de89caa8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:51.655544 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1142/2283] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:50:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:50:51.665984 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc143b72-f384-4982-b474-5ecc930a1636 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:51.667827 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-fc143b72-f384-4982-b474-5ecc930a1636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:51.734494 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc143b72-f384-4982-b474-5ecc930a1636 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:51.738689 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79794288-24fa-4c84-aaf5-12e6f75fd8bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:51.739342 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79794288-24fa-4c84-aaf5-12e6f75fd8bb service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:51.739625 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79794288-24fa-4c84-aaf5-12e6f75fd8bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:51.740047 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79794288-24fa-4c84-aaf5-12e6f75fd8bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:51.750118 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79794288-24fa-4c84-aaf5-12e6f75fd8bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:51.751606 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79794288-24fa-4c84-aaf5-12e6f75fd8bb service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:51.761683 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1142/2284] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:50:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:50:53.608574 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986f5b5-60fd-490d-8c53-ac093aa35c7c None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:53.608574 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986f5b5-60fd-490d-8c53-ac093aa35c7c None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:53.608574 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986f5b5-60fd-490d-8c53-ac093aa35c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:53.634923 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-d986f5b5-60fd-490d-8c53-ac093aa35c7c None None] MFA Rules not processed for user `a1fe4b24e4f346d6bcbbeb3afd54450a`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:50:53.636702 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-d986f5b5-60fd-490d-8c53-ac093aa35c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:53.731770 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1143/2285] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:50:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:50:53.742267 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79794288-24fa-4c84-aaf5-12e6f75fd8bb service neutron] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:50:53.743702 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-79794288-24fa-4c84-aaf5-12e6f75fd8bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:53.801658 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79794288-24fa-4c84-aaf5-12e6f75fd8bb service neutron] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:50:53.817445 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a372af-66b0-4fa7-87ce-7a032204a620 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:50:53.818085 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a372af-66b0-4fa7-87ce-7a032204a620 service cinder] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:53.818364 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a372af-66b0-4fa7-87ce-7a032204a620 service cinder] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:53.818635 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a372af-66b0-4fa7-87ce-7a032204a620 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:53.828592 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a372af-66b0-4fa7-87ce-7a032204a620 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:50:53.830075 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a372af-66b0-4fa7-87ce-7a032204a620 service cinder] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:50:53.839679 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1143/2286] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:50:53 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:50:55.512539 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5def1cf-ddac-4092-a168-cbe1df8155d5 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:50:55.513050 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5def1cf-ddac-4092-a168-cbe1df8155d5 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:50:55.513152 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5def1cf-ddac-4092-a168-cbe1df8155d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:50:55.532234 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-d5def1cf-ddac-4092-a168-cbe1df8155d5 None None] MFA Rules not processed for user `a1fe4b24e4f346d6bcbbeb3afd54450a`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:50:55.533422 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-d5def1cf-ddac-4092-a168-cbe1df8155d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:50:55.541249 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1144/2287] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:50:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:51:00.739471 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a372af-66b0-4fa7-87ce-7a032204a620 service cinder] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:51:00.745950 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-66a372af-66b0-4fa7-87ce-7a032204a620 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:51:00.846911 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a372af-66b0-4fa7-87ce-7a032204a620 service cinder] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:51:00.853645 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75415a2-d605-42a8-a10a-07602f408122 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647f2cb18a41d6a9e124e886faa994', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:51:00.854536 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75415a2-d605-42a8-a10a-07602f408122 service placement] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:51:00.855051 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75415a2-d605-42a8-a10a-07602f408122 service placement] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:51:00.855587 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75415a2-d605-42a8-a10a-07602f408122 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:51:00.857843 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-a75415a2-d605-42a8-a10a-07602f408122 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:51:00.871434 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75415a2-d605-42a8-a10a-07602f408122 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:51:00.873437 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75415a2-d605-42a8-a10a-07602f408122 service placement] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:51:00.895364 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1144/2288] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:51:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:51:03.599331 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17abd7b-ca0d-4584-8fe4-85d0401152f3 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:51:03.599792 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17abd7b-ca0d-4584-8fe4-85d0401152f3 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:51:03.599919 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17abd7b-ca0d-4584-8fe4-85d0401152f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:51:03.619145 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-e17abd7b-ca0d-4584-8fe4-85d0401152f3 None None] MFA Rules not processed for user `6bea520676244effbbe212aa62b1cc68`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:51:03.620338 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-e17abd7b-ca0d-4584-8fe4-85d0401152f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:51:03.693630 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1145/2289] 10.222.0.42 () {58 vars in 967 bytes} [Fri Aug 5 02:51:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:51:03.706702 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75415a2-d605-42a8-a10a-07602f408122 service placement] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:51:03.708192 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-a75415a2-d605-42a8-a10a-07602f408122 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:51:03.713435 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:51:03.781817 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75415a2-d605-42a8-a10a-07602f408122 service placement] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:51:03.785761 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088b784-aff1-41f2-84bc-bd6fb3cd7f52 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40f706f1eb2b4137afd367cb5060ced0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:51:03.786380 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088b784-aff1-41f2-84bc-bd6fb3cd7f52 service swift] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:51:03.786661 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088b784-aff1-41f2-84bc-bd6fb3cd7f52 service swift] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:51:03.786937 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088b784-aff1-41f2-84bc-bd6fb3cd7f52 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:51:03.795442 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7088b784-aff1-41f2-84bc-bd6fb3cd7f52 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:51:03.797038 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7088b784-aff1-41f2-84bc-bd6fb3cd7f52 service swift] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:51:03.806461 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1145/2290] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 5 02:51:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 02:51:05.583794 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88afd5-6eb9-4787-a58a-6812147e7457 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:51:05.584311 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88afd5-6eb9-4787-a58a-6812147e7457 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:51:05.584406 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88afd5-6eb9-4787-a58a-6812147e7457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:51:05.603948 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-fb88afd5-6eb9-4787-a58a-6812147e7457 None None] MFA Rules not processed for user `6bea520676244effbbe212aa62b1cc68`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:51:05.605276 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-fb88afd5-6eb9-4787-a58a-6812147e7457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:51:05.612918 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1146/2291] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Aug 5 02:51:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:51:05.625727 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088b784-aff1-41f2-84bc-bd6fb3cd7f52 service swift] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:51:05.635995 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088b784-aff1-41f2-84bc-bd6fb3cd7f52 service swift] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:51:05.641219 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ea59f-a656-41fd-963d-4947cea13c4f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40f706f1eb2b4137afd367cb5060ced0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:51:05.642074 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ea59f-a656-41fd-963d-4947cea13c4f service swift] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:51:05.642456 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ea59f-a656-41fd-963d-4947cea13c4f service swift] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:51:05.642864 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ea59f-a656-41fd-963d-4947cea13c4f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:51:05.652662 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ea59f-a656-41fd-963d-4947cea13c4f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:51:05.654415 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ea59f-a656-41fd-963d-4947cea13c4f service swift] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:51:05.663769 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1146/2292] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 5 02:51:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 02:51:06.656073 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3959f-9a08-4e27-850c-f7f3bba1ebee None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:51:06.656554 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3959f-9a08-4e27-850c-f7f3bba1ebee None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:51:06.656773 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3959f-9a08-4e27-850c-f7f3bba1ebee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:51:06.676507 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-73b3959f-9a08-4e27-850c-f7f3bba1ebee None None] MFA Rules not processed for user `6bea520676244effbbe212aa62b1cc68`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:51:06.677702 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-73b3959f-9a08-4e27-850c-f7f3bba1ebee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:51:06.685394 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1147/2293] 10.222.0.42 () {58 vars in 967 bytes} [Fri Aug 5 02:51:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:51:06.698573 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ea59f-a656-41fd-963d-4947cea13c4f service swift] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:51:06.708831 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ea59f-a656-41fd-963d-4947cea13c4f service swift] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:51:06.714103 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f42e0-b881-4186-b8ff-95336b5adf87 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40f706f1eb2b4137afd367cb5060ced0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:51:06.714766 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f42e0-b881-4186-b8ff-95336b5adf87 service swift] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:51:06.715084 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f42e0-b881-4186-b8ff-95336b5adf87 service swift] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:51:06.715357 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f42e0-b881-4186-b8ff-95336b5adf87 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:51:06.723150 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f42e0-b881-4186-b8ff-95336b5adf87 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:51:06.724718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f42e0-b881-4186-b8ff-95336b5adf87 service swift] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:51:06.732778 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1147/2294] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 5 02:51:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 02:51:07.341541 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f25f7-dccd-421a-8cf4-1ecba87f4d2f None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:51:07.341778 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f25f7-dccd-421a-8cf4-1ecba87f4d2f None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:51:07.342055 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f25f7-dccd-421a-8cf4-1ecba87f4d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:51:07.361929 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-024f25f7-dccd-421a-8cf4-1ecba87f4d2f None None] MFA Rules not processed for user `6bea520676244effbbe212aa62b1cc68`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:51:07.363148 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-024f25f7-dccd-421a-8cf4-1ecba87f4d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:51:07.370800 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1148/2295] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Aug 5 02:51:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:51:07.382604 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f42e0-b881-4186-b8ff-95336b5adf87 service swift] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:51:07.393277 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f42e0-b881-4186-b8ff-95336b5adf87 service swift] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:51:07.398921 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aadfff-d747-4238-8a03-449fdd9e9972 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40f706f1eb2b4137afd367cb5060ced0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:51:07.399555 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aadfff-d747-4238-8a03-449fdd9e9972 service swift] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:51:07.399841 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aadfff-d747-4238-8a03-449fdd9e9972 service swift] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:51:07.400120 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aadfff-d747-4238-8a03-449fdd9e9972 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:51:07.408440 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aadfff-d747-4238-8a03-449fdd9e9972 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:51:07.410027 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aadfff-d747-4238-8a03-449fdd9e9972 service swift] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:51:07.418880 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1148/2296] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 5 02:51:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 02:51:07.966194 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a99179-9ba4-42d7-8db1-75e78dc28248 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:51:07.966661 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a99179-9ba4-42d7-8db1-75e78dc28248 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:51:07.966752 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a99179-9ba4-42d7-8db1-75e78dc28248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:51:07.985402 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-82a99179-9ba4-42d7-8db1-75e78dc28248 None None] MFA Rules not processed for user `6bea520676244effbbe212aa62b1cc68`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:51:07.986597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-82a99179-9ba4-42d7-8db1-75e78dc28248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:51:07.993674 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1149/2297] 10.222.0.42 () {58 vars in 967 bytes} [Fri Aug 5 02:51:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:51:08.005831 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aadfff-d747-4238-8a03-449fdd9e9972 service swift] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:51:08.016793 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aadfff-d747-4238-8a03-449fdd9e9972 service swift] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:51:08.021727 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c5cef8-cf72-48e1-bbb9-3a6c7061a0ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40f706f1eb2b4137afd367cb5060ced0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:51:08.022327 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5cef8-cf72-48e1-bbb9-3a6c7061a0ea service swift] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:51:08.023269 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5cef8-cf72-48e1-bbb9-3a6c7061a0ea service swift] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:51:08.023545 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5cef8-cf72-48e1-bbb9-3a6c7061a0ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:51:08.031528 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c5cef8-cf72-48e1-bbb9-3a6c7061a0ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:51:08.033132 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c5cef8-cf72-48e1-bbb9-3a6c7061a0ea service swift] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:51:08.041261 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1149/2298] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 5 02:51:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 02:51:10.827649 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a99179-9ba4-42d7-8db1-75e78dc28248 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:51:10.829079 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-82a99179-9ba4-42d7-8db1-75e78dc28248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:51:10.844399 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a99179-9ba4-42d7-8db1-75e78dc28248 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:51:10.849441 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b143c-c53f-4cd1-8ebb-d12561d036a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:51:10.849710 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b143c-c53f-4cd1-8ebb-d12561d036a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:51:10.849991 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b143c-c53f-4cd1-8ebb-d12561d036a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:51:10.850272 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b143c-c53f-4cd1-8ebb-d12561d036a4 admin admin] PATH_INFO: `/v3/users/55df59986d294b87a31e4b4faf88afe3` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:51:10.851805 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b143c-c53f-4cd1-8ebb-d12561d036a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55df59986d294b87a31e4b4faf88afe3)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:51:10.853768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b143c-c53f-4cd1-8ebb-d12561d036a4 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:51:10.856449 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:51:11.058336 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-7e6b143c-c53f-4cd1-8ebb-d12561d036a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55df59986d294b87a31e4b4faf88afe3'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:51:11.135930 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-7e6b143c-c53f-4cd1-8ebb-d12561d036a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55df59986d294b87a31e4b4faf88afe3'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:51:11.143208 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-7e6b143c-c53f-4cd1-8ebb-d12561d036a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55df59986d294b87a31e4b4faf88afe3'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:51:11.155056 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-7e6b143c-c53f-4cd1-8ebb-d12561d036a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55df59986d294b87a31e4b4faf88afe3'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:51:11.155849 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-7e6b143c-c53f-4cd1-8ebb-d12561d036a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55df59986d294b87a31e4b4faf88afe3'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:51:11.162043 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1150/2299] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:51:10 2022] DELETE /identity/v3/users/55df59986d294b87a31e4b4faf88afe3 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:51:11.166990 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da0f5b-281d-4c43-81ee-f7d56bf2500b None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:51:11.167823 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da0f5b-281d-4c43-81ee-f7d56bf2500b None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:51:11.168319 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da0f5b-281d-4c43-81ee-f7d56bf2500b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:51:11.191840 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-91da0f5b-281d-4c43-81ee-f7d56bf2500b None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:51:11.193305 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-91da0f5b-281d-4c43-81ee-f7d56bf2500b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:51:11.257307 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1150/2300] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:51:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:51:11.268104 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b143c-c53f-4cd1-8ebb-d12561d036a4 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:51:11.269632 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-7e6b143c-c53f-4cd1-8ebb-d12561d036a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:51:11.339951 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b143c-c53f-4cd1-8ebb-d12561d036a4 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:51:11.344071 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b9bf7-64ec-4dc6-8436-86aff466af04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:51:11.344899 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b9bf7-64ec-4dc6-8436-86aff466af04 service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:51:11.345178 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b9bf7-64ec-4dc6-8436-86aff466af04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:51:11.346621 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b9bf7-64ec-4dc6-8436-86aff466af04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:51:11.363918 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b9bf7-64ec-4dc6-8436-86aff466af04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:51:11.365481 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b9bf7-64ec-4dc6-8436-86aff466af04 service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:51:11.379577 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1151/2301] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:51:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:51:11.788411 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da0f5b-281d-4c43-81ee-f7d56bf2500b None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:51:11.790364 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-91da0f5b-281d-4c43-81ee-f7d56bf2500b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:51:11.804493 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da0f5b-281d-4c43-81ee-f7d56bf2500b None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:51:11.810145 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d6b5f7-091c-46f3-8f19-a4a78807ac53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:51:11.811181 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6b5f7-091c-46f3-8f19-a4a78807ac53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:51:11.811458 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6b5f7-091c-46f3-8f19-a4a78807ac53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:51:11.811910 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6b5f7-091c-46f3-8f19-a4a78807ac53 admin admin] PATH_INFO: `/v3/projects/d17ab49aa3e54be7bb4ff74a63a01a92` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:51:11.813258 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d6b5f7-091c-46f3-8f19-a4a78807ac53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d17ab49aa3e54be7bb4ff74a63a01a92)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:51:11.815350 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d6b5f7-091c-46f3-8f19-a4a78807ac53 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:51:11.957791 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:51:11.969159 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-76d6b5f7-091c-46f3-8f19-a4a78807ac53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd17ab49aa3e54be7bb4ff74a63a01a92', 'request_id': 'req-76d6b5f7-091c-46f3-8f19-a4a78807ac53'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:51:12.059610 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-76d6b5f7-091c-46f3-8f19-a4a78807ac53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd17ab49aa3e54be7bb4ff74a63a01a92', 'request_id': 'req-76d6b5f7-091c-46f3-8f19-a4a78807ac53'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:51:12.066323 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-76d6b5f7-091c-46f3-8f19-a4a78807ac53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd17ab49aa3e54be7bb4ff74a63a01a92', 'request_id': 'req-76d6b5f7-091c-46f3-8f19-a4a78807ac53'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:51:12.077608 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-76d6b5f7-091c-46f3-8f19-a4a78807ac53 admin admin] The token cache is being invalidate because project d17ab49aa3e54be7bb4ff74a63a01a92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:51:12.078130 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-76d6b5f7-091c-46f3-8f19-a4a78807ac53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:51:12.078809 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-76d6b5f7-091c-46f3-8f19-a4a78807ac53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:51:12.080802 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1151/2302] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:51:11 2022] DELETE /identity/v3/projects/d17ab49aa3e54be7bb4ff74a63a01a92 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:51:21.373203 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=51,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:51:22.310232 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:DELETE=5,keystone:SELECT=11,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:51:28.572955 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51092f2-40eb-40cb-a186-dbf939d52d65 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:51:28.577617 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51092f2-40eb-40cb-a186-dbf939d52d65 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:51:28.577617 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51092f2-40eb-40cb-a186-dbf939d52d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:51:28.592970 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-e51092f2-40eb-40cb-a186-dbf939d52d65 None None] MFA Rules not processed for user `4033953c81e5494ea03a7031df9ddcc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:51:28.594980 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-e51092f2-40eb-40cb-a186-dbf939d52d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:51:28.648752 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1152/2303] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:51:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:51:35.412381 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632e423-79e2-432b-bfc6-044adb397407 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:51:35.412960 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632e423-79e2-432b-bfc6-044adb397407 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:51:35.412960 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632e423-79e2-432b-bfc6-044adb397407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:51:35.433371 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-a632e423-79e2-432b-bfc6-044adb397407 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:51:35.434484 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-a632e423-79e2-432b-bfc6-044adb397407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:51:35.492660 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1152/2304] 10.222.0.44 () {58 vars in 1016 bytes} [Fri Aug 5 02:51:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:51:35.506414 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51092f2-40eb-40cb-a186-dbf939d52d65 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:51:35.507945 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-e51092f2-40eb-40cb-a186-dbf939d52d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:51:35.580145 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51092f2-40eb-40cb-a186-dbf939d52d65 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:51:35.585554 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501f28f-a41e-4dd5-9255-42441b282510 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:51:35.586167 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501f28f-a41e-4dd5-9255-42441b282510 service nova] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:51:35.586444 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501f28f-a41e-4dd5-9255-42441b282510 service nova] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:51:35.587048 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501f28f-a41e-4dd5-9255-42441b282510 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:51:35.595103 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8501f28f-a41e-4dd5-9255-42441b282510 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:51:35.596694 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8501f28f-a41e-4dd5-9255-42441b282510 service nova] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:51:35.606527 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1153/2305] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:51:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:51:37.248806 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78e188-d43b-42c4-840d-9971eddddbc0 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:51:37.249303 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78e188-d43b-42c4-840d-9971eddddbc0 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:51:37.249415 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78e188-d43b-42c4-840d-9971eddddbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:51:37.269049 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-8e78e188-d43b-42c4-840d-9971eddddbc0 None None] MFA Rules not processed for user `8f8ed7d12ca44a058ed8b888ca723b57`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:51:37.270278 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-8e78e188-d43b-42c4-840d-9971eddddbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:51:37.325371 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1153/2306] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:51:37 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:51:41.678919 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ece623-a997-4616-8a30-e8b411b84225 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:51:41.679476 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ece623-a997-4616-8a30-e8b411b84225 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:51:41.679476 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ece623-a997-4616-8a30-e8b411b84225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:51:41.698939 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-30ece623-a997-4616-8a30-e8b411b84225 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:51:41.700141 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-30ece623-a997-4616-8a30-e8b411b84225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:51:41.707902 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1154/2307] 10.222.0.44 () {58 vars in 1016 bytes} [Fri Aug 5 02:51:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:51:41.722095 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78e188-d43b-42c4-840d-9971eddddbc0 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:51:41.735078 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78e188-d43b-42c4-840d-9971eddddbc0 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:51:41.740439 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42a2ef-cf38-4e99-b729-6d96fce45336 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:51:41.741038 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42a2ef-cf38-4e99-b729-6d96fce45336 service nova] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:51:41.741362 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42a2ef-cf38-4e99-b729-6d96fce45336 service nova] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:51:41.741630 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42a2ef-cf38-4e99-b729-6d96fce45336 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:51:41.750270 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad42a2ef-cf38-4e99-b729-6d96fce45336 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:51:41.751970 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad42a2ef-cf38-4e99-b729-6d96fce45336 service nova] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:51:41.761281 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1154/2308] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:51:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:51:46.316273 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6097ccc-b345-4317-94fe-c074f612e029 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:51:46.316728 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6097ccc-b345-4317-94fe-c074f612e029 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:51:46.316838 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6097ccc-b345-4317-94fe-c074f612e029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:51:46.336684 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-d6097ccc-b345-4317-94fe-c074f612e029 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:51:46.338028 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-d6097ccc-b345-4317-94fe-c074f612e029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:51:46.345792 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1155/2309] 10.222.0.44 () {58 vars in 1016 bytes} [Fri Aug 5 02:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:51:46.382538 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42a2ef-cf38-4e99-b729-6d96fce45336 service nova] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:51:46.394193 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42a2ef-cf38-4e99-b729-6d96fce45336 service nova] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:51:46.399592 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c8d5c-9b2f-4e39-9251-880a82f0d0cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:51:46.400186 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c8d5c-9b2f-4e39-9251-880a82f0d0cf service nova] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:51:46.400461 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c8d5c-9b2f-4e39-9251-880a82f0d0cf service nova] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:51:46.400730 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c8d5c-9b2f-4e39-9251-880a82f0d0cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:51:46.408802 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c8d5c-9b2f-4e39-9251-880a82f0d0cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:51:46.410369 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c8d5c-9b2f-4e39-9251-880a82f0d0cf service nova] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:51:46.419872 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1155/2310] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:51:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:51:50.143702 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c72cc-f4b3-4740-b336-ba4c20c4dc75 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:51:50.144212 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c72cc-f4b3-4740-b336-ba4c20c4dc75 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:51:50.144316 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c72cc-f4b3-4740-b336-ba4c20c4dc75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:51:50.165125 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-a93c72cc-f4b3-4740-b336-ba4c20c4dc75 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:51:50.166413 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-a93c72cc-f4b3-4740-b336-ba4c20c4dc75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:51:50.174487 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1156/2311] 10.222.0.44 () {58 vars in 1016 bytes} [Fri Aug 5 02:51:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:51:50.193220 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c8d5c-9b2f-4e39-9251-880a82f0d0cf service nova] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:51:50.195080 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-0d5c8d5c-9b2f-4e39-9251-880a82f0d0cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:51:50.210936 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c8d5c-9b2f-4e39-9251-880a82f0d0cf service nova] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:51:50.216897 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a4def-fa4a-4086-b741-16479ce8246e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:51:50.217506 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a4def-fa4a-4086-b741-16479ce8246e service nova] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:51:50.217792 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a4def-fa4a-4086-b741-16479ce8246e service nova] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:51:50.218073 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a4def-fa4a-4086-b741-16479ce8246e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:51:50.227901 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8a4def-fa4a-4086-b741-16479ce8246e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:51:50.229498 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8a4def-fa4a-4086-b741-16479ce8246e service nova] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:51:50.240177 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1156/2312] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:51:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:51:54.404421 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262928aa-0484-4290-8d13-bae5ed729138 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:51:54.404923 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262928aa-0484-4290-8d13-bae5ed729138 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:51:54.405025 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262928aa-0484-4290-8d13-bae5ed729138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:51:54.412841 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=69 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:51:54.424699 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-262928aa-0484-4290-8d13-bae5ed729138 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:51:54.425949 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-262928aa-0484-4290-8d13-bae5ed729138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:51:54.433833 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1157/2313] 10.222.0.44 () {58 vars in 1016 bytes} [Fri Aug 5 02:51:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:51:54.451914 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a4def-fa4a-4086-b741-16479ce8246e service nova] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:51:54.463933 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a4def-fa4a-4086-b741-16479ce8246e service nova] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:51:54.469279 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f06ee-44e8-4250-9952-4cfe96386f66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:51:54.469904 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f06ee-44e8-4250-9952-4cfe96386f66 service nova] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:51:54.470202 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f06ee-44e8-4250-9952-4cfe96386f66 service nova] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:51:54.470459 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f06ee-44e8-4250-9952-4cfe96386f66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:51:54.478410 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4f06ee-44e8-4250-9952-4cfe96386f66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:51:54.480054 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4f06ee-44e8-4250-9952-4cfe96386f66 service nova] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:51:54.489220 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1157/2314] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:51:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:51:58.659722 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b2abd-4eb9-4a0a-bad9-159185f67533 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:51:58.660299 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b2abd-4eb9-4a0a-bad9-159185f67533 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:51:58.660299 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b2abd-4eb9-4a0a-bad9-159185f67533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:51:58.681020 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-6e1b2abd-4eb9-4a0a-bad9-159185f67533 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:51:58.682382 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-6e1b2abd-4eb9-4a0a-bad9-159185f67533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:51:58.691949 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1158/2315] 10.222.0.44 () {58 vars in 1016 bytes} [Fri Aug 5 02:51:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:51:58.707504 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f06ee-44e8-4250-9952-4cfe96386f66 service nova] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:51:58.719804 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f06ee-44e8-4250-9952-4cfe96386f66 service nova] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:51:58.726074 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8648aa7-76b0-4b09-8851-cb07e3437179 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:51:58.726074 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8648aa7-76b0-4b09-8851-cb07e3437179 service nova] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:51:58.726501 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8648aa7-76b0-4b09-8851-cb07e3437179 service nova] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:51:58.726681 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8648aa7-76b0-4b09-8851-cb07e3437179 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:51:58.741031 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8648aa7-76b0-4b09-8851-cb07e3437179 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:51:58.743133 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8648aa7-76b0-4b09-8851-cb07e3437179 service nova] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:51:58.754046 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1158/2316] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:51:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:52:07.780227 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2381493-8606-44d4-adfd-5fd3df05f360 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:52:07.780772 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2381493-8606-44d4-adfd-5fd3df05f360 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:52:07.780772 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2381493-8606-44d4-adfd-5fd3df05f360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:52:07.805528 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-e2381493-8606-44d4-adfd-5fd3df05f360 None None] MFA Rules not processed for user `16970234a29e41cf8639b6ffc1aeadaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:52:07.807247 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-e2381493-8606-44d4-adfd-5fd3df05f360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:52:07.892665 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1159/2317] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:52:07 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:52:08.748944 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=82 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:52:17.866860 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=30 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:52:19.526876 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fecb0-c5d0-46a3-8947-26782fed322d None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:52:19.527407 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fecb0-c5d0-46a3-8947-26782fed322d None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:52:19.527534 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fecb0-c5d0-46a3-8947-26782fed322d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:52:19.550657 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-5b1fecb0-c5d0-46a3-8947-26782fed322d None None] MFA Rules not processed for user `a1fe4b24e4f346d6bcbbeb3afd54450a`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:52:19.552626 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-5b1fecb0-c5d0-46a3-8947-26782fed322d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:52:19.623495 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1159/2318] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:52:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:52:20.662063 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be667eab-9689-42d3-b38a-42f08ed84b86 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:52:20.662505 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be667eab-9689-42d3-b38a-42f08ed84b86 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:52:20.662647 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be667eab-9689-42d3-b38a-42f08ed84b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:52:20.683402 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-be667eab-9689-42d3-b38a-42f08ed84b86 None None] MFA Rules not processed for user `6bea520676244effbbe212aa62b1cc68`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:52:20.684626 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-be667eab-9689-42d3-b38a-42f08ed84b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:52:20.747746 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1160/2319] 10.222.0.42 () {58 vars in 967 bytes} [Fri Aug 5 02:52:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:52:20.927525 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1fecb0-c5d0-46a3-8947-26782fed322d None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:52:20.928656 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-5b1fecb0-c5d0-46a3-8947-26782fed322d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:52:20.996919 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1fecb0-c5d0-46a3-8947-26782fed322d None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:52:21.001832 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee1adc9-aa3c-42e7-be25-5a7e719e3141 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40f706f1eb2b4137afd367cb5060ced0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:52:21.002446 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1adc9-aa3c-42e7-be25-5a7e719e3141 service swift] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:52:21.002730 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1adc9-aa3c-42e7-be25-5a7e719e3141 service swift] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:52:21.003033 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1adc9-aa3c-42e7-be25-5a7e719e3141 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:52:21.011813 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee1adc9-aa3c-42e7-be25-5a7e719e3141 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:52:21.013400 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee1adc9-aa3c-42e7-be25-5a7e719e3141 service swift] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:52:21.021369 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1160/2320] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 5 02:52:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 02:52:30.206835 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be667eab-9689-42d3-b38a-42f08ed84b86 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:52:30.208135 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-be667eab-9689-42d3-b38a-42f08ed84b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:52:30.222846 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be667eab-9689-42d3-b38a-42f08ed84b86 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:52:30.227372 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbe96e-2000-4140-a468-321cf01f9e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:52:30.228666 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbe96e-2000-4140-a468-321cf01f9e42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:52:30.228945 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbe96e-2000-4140-a468-321cf01f9e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:52:30.229214 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbe96e-2000-4140-a468-321cf01f9e42 admin admin] PATH_INFO: `/v3/users/8899e781da8d4d05af2ce5a120874d08` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:52:30.230394 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adbe96e-2000-4140-a468-321cf01f9e42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8899e781da8d4d05af2ce5a120874d08)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:52:30.232358 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adbe96e-2000-4140-a468-321cf01f9e42 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:52:30.387114 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-4adbe96e-2000-4140-a468-321cf01f9e42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8899e781da8d4d05af2ce5a120874d08'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:52:30.439420 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-4adbe96e-2000-4140-a468-321cf01f9e42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8899e781da8d4d05af2ce5a120874d08'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:52:30.446804 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-4adbe96e-2000-4140-a468-321cf01f9e42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8899e781da8d4d05af2ce5a120874d08'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:52:30.459091 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-4adbe96e-2000-4140-a468-321cf01f9e42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8899e781da8d4d05af2ce5a120874d08'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:52:30.459780 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-4adbe96e-2000-4140-a468-321cf01f9e42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8899e781da8d4d05af2ce5a120874d08'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:52:30.466361 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1161/2321] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:52:30 2022] DELETE /identity/v3/users/8899e781da8d4d05af2ce5a120874d08 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:52:30.710197 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee1adc9-aa3c-42e7-be25-5a7e719e3141 service swift] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:52:30.722474 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee1adc9-aa3c-42e7-be25-5a7e719e3141 service swift] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:52:30.782311 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8feb004-845e-47a9-b88a-e02154e58afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:52:30.783004 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8feb004-845e-47a9-b88a-e02154e58afc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:52:30.783261 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8feb004-845e-47a9-b88a-e02154e58afc admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:52:30.783588 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8feb004-845e-47a9-b88a-e02154e58afc admin admin] PATH_INFO: `/v3/projects/6636331ab23743878eca0521a172853e` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:52:30.785293 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8feb004-845e-47a9-b88a-e02154e58afc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6636331ab23743878eca0521a172853e)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:52:30.787279 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8feb004-845e-47a9-b88a-e02154e58afc admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:52:30.892467 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:52:30.901310 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-a8feb004-845e-47a9-b88a-e02154e58afc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6636331ab23743878eca0521a172853e', 'request_id': 'req-a8feb004-845e-47a9-b88a-e02154e58afc'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:52:30.990631 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-a8feb004-845e-47a9-b88a-e02154e58afc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6636331ab23743878eca0521a172853e', 'request_id': 'req-a8feb004-845e-47a9-b88a-e02154e58afc'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:52:30.997101 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-a8feb004-845e-47a9-b88a-e02154e58afc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6636331ab23743878eca0521a172853e', 'request_id': 'req-a8feb004-845e-47a9-b88a-e02154e58afc'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:52:31.008015 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-a8feb004-845e-47a9-b88a-e02154e58afc admin admin] The token cache is being invalidate because project 6636331ab23743878eca0521a172853e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:52:31.008299 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-a8feb004-845e-47a9-b88a-e02154e58afc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:52:31.009004 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-a8feb004-845e-47a9-b88a-e02154e58afc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:52:31.011194 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1161/2322] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:52:30 2022] DELETE /identity/v3/projects/6636331ab23743878eca0521a172853e => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:52:31.015285 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbe96e-2000-4140-a468-321cf01f9e42 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:52:31.016674 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-4adbe96e-2000-4140-a468-321cf01f9e42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:52:31.029719 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbe96e-2000-4140-a468-321cf01f9e42 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:52:31.086347 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391845af-4015-4db4-8d61-076d12206ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:52:31.087017 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391845af-4015-4db4-8d61-076d12206ff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:52:31.087567 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391845af-4015-4db4-8d61-076d12206ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:52:31.087842 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391845af-4015-4db4-8d61-076d12206ff6 admin admin] PATH_INFO: `/v3/users/5546cb42464b4a9085e54eaca89586b7` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:52:31.089015 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391845af-4015-4db4-8d61-076d12206ff6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5546cb42464b4a9085e54eaca89586b7)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:52:31.090981 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391845af-4015-4db4-8d61-076d12206ff6 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:52:31.111316 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:52:31.242223 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-391845af-4015-4db4-8d61-076d12206ff6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5546cb42464b4a9085e54eaca89586b7'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:52:31.349396 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-391845af-4015-4db4-8d61-076d12206ff6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5546cb42464b4a9085e54eaca89586b7'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:52:31.362356 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-391845af-4015-4db4-8d61-076d12206ff6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5546cb42464b4a9085e54eaca89586b7'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:52:31.379120 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-391845af-4015-4db4-8d61-076d12206ff6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5546cb42464b4a9085e54eaca89586b7'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:52:31.380033 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-391845af-4015-4db4-8d61-076d12206ff6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5546cb42464b4a9085e54eaca89586b7'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:52:31.387548 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1162/2323] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:52:31 2022] DELETE /identity/v3/users/5546cb42464b4a9085e54eaca89586b7 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:52:31.652999 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8feb004-845e-47a9-b88a-e02154e58afc admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:52:31.654801 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-a8feb004-845e-47a9-b88a-e02154e58afc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:52:31.670461 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8feb004-845e-47a9-b88a-e02154e58afc admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:52:31.729155 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d49b09-a5ef-4344-9ba2-3421658be893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:52:31.729779 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d49b09-a5ef-4344-9ba2-3421658be893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:52:31.730067 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d49b09-a5ef-4344-9ba2-3421658be893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:52:31.730350 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d49b09-a5ef-4344-9ba2-3421658be893 admin admin] PATH_INFO: `/v3/projects/93f154b99ccb4045986f2ad81892e122` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:52:31.731549 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d49b09-a5ef-4344-9ba2-3421658be893 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93f154b99ccb4045986f2ad81892e122)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:52:31.733462 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d49b09-a5ef-4344-9ba2-3421658be893 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:52:31.846313 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-36d49b09-a5ef-4344-9ba2-3421658be893 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93f154b99ccb4045986f2ad81892e122', 'request_id': 'req-36d49b09-a5ef-4344-9ba2-3421658be893'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:52:31.930725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-36d49b09-a5ef-4344-9ba2-3421658be893 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93f154b99ccb4045986f2ad81892e122', 'request_id': 'req-36d49b09-a5ef-4344-9ba2-3421658be893'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:52:31.936676 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-36d49b09-a5ef-4344-9ba2-3421658be893 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93f154b99ccb4045986f2ad81892e122', 'request_id': 'req-36d49b09-a5ef-4344-9ba2-3421658be893'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:52:31.948044 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-36d49b09-a5ef-4344-9ba2-3421658be893 admin admin] The token cache is being invalidate because project 93f154b99ccb4045986f2ad81892e122 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:52:31.948332 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-36d49b09-a5ef-4344-9ba2-3421658be893 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:52:31.949011 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-36d49b09-a5ef-4344-9ba2-3421658be893 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:52:31.950619 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1162/2324] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:52:31 2022] DELETE /identity/v3/projects/93f154b99ccb4045986f2ad81892e122 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:52:40.788816 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4525d3-adf6-4138-8c43-41f45392cc5e None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:52:40.789395 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4525d3-adf6-4138-8c43-41f45392cc5e None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:52:40.789395 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4525d3-adf6-4138-8c43-41f45392cc5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:52:40.810362 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-ff4525d3-adf6-4138-8c43-41f45392cc5e None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:52:40.811630 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-ff4525d3-adf6-4138-8c43-41f45392cc5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:52:40.885886 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1163/2325] 10.222.0.44 () {58 vars in 1016 bytes} [Fri Aug 5 02:52:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:52:40.903854 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d49b09-a5ef-4344-9ba2-3421658be893 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:52:40.906582 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-36d49b09-a5ef-4344-9ba2-3421658be893 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:52:40.965541 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:52:40.989575 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d49b09-a5ef-4344-9ba2-3421658be893 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:52:40.995221 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9538a3-496a-4b3f-9d4a-33440fb3e753 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:52:40.995845 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9538a3-496a-4b3f-9d4a-33440fb3e753 service nova] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:52:40.996129 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9538a3-496a-4b3f-9d4a-33440fb3e753 service nova] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:52:40.996413 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9538a3-496a-4b3f-9d4a-33440fb3e753 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:52:41.004661 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9538a3-496a-4b3f-9d4a-33440fb3e753 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:52:41.006258 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9538a3-496a-4b3f-9d4a-33440fb3e753 service nova] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:52:41.017035 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1163/2326] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:52:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:52:41.514575 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d7153-def8-445b-8a37-cfd3810295a6 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:52:41.514892 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d7153-def8-445b-8a37-cfd3810295a6 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:52:41.515204 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d7153-def8-445b-8a37-cfd3810295a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:52:41.533753 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-6e7d7153-def8-445b-8a37-cfd3810295a6 None None] MFA Rules not processed for user `526cd8eb496f4389a52dd557306dd314`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:52:41.534891 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-6e7d7153-def8-445b-8a37-cfd3810295a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:52:41.588985 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1164/2327] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:52:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:52:46.472080 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9434a3-6dce-443c-8c5e-699340ef4a27 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:52:46.472497 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9434a3-6dce-443c-8c5e-699340ef4a27 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:52:46.472629 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9434a3-6dce-443c-8c5e-699340ef4a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:52:46.492098 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-6a9434a3-6dce-443c-8c5e-699340ef4a27 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:52:46.498361 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-6a9434a3-6dce-443c-8c5e-699340ef4a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:52:46.501611 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1164/2328] 10.222.0.44 () {58 vars in 1016 bytes} [Fri Aug 5 02:52:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:52:46.527358 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d7153-def8-445b-8a37-cfd3810295a6 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:52:46.546758 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d7153-def8-445b-8a37-cfd3810295a6 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:52:46.552494 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2359cec-daa6-47c2-92f3-d55d96c3b9d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:52:46.553676 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2359cec-daa6-47c2-92f3-d55d96c3b9d6 service nova] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:52:46.554002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2359cec-daa6-47c2-92f3-d55d96c3b9d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:52:46.554286 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2359cec-daa6-47c2-92f3-d55d96c3b9d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:52:46.563537 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2359cec-daa6-47c2-92f3-d55d96c3b9d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:52:46.567036 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2359cec-daa6-47c2-92f3-d55d96c3b9d6 service nova] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:52:46.581430 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1165/2329] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:52:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:52:50.079965 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9434a3-6dce-443c-8c5e-699340ef4a27 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:52:50.081586 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-6a9434a3-6dce-443c-8c5e-699340ef4a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:52:50.148205 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9434a3-6dce-443c-8c5e-699340ef4a27 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:52:50.151855 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd91d6a-23a6-4cd4-98c4-c5111b6803a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:52:50.152489 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd91d6a-23a6-4cd4-98c4-c5111b6803a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:52:50.152775 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd91d6a-23a6-4cd4-98c4-c5111b6803a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:52:50.153621 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd91d6a-23a6-4cd4-98c4-c5111b6803a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:52:50.155482 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-bfd91d6a-23a6-4cd4-98c4-c5111b6803a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:52:50.170793 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd91d6a-23a6-4cd4-98c4-c5111b6803a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:52:50.172421 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd91d6a-23a6-4cd4-98c4-c5111b6803a7 service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:52:50.184400 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1165/2330] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:52:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:52:50.425301 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850bd43-c731-411d-9608-499b40486848 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:52:50.425919 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850bd43-c731-411d-9608-499b40486848 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:52:50.425919 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850bd43-c731-411d-9608-499b40486848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:52:50.447233 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-7850bd43-c731-411d-9608-499b40486848 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:52:50.448745 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-7850bd43-c731-411d-9608-499b40486848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:52:50.458983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1166/2331] 10.222.0.44 () {58 vars in 1016 bytes} [Fri Aug 5 02:52:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:52:50.475651 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd91d6a-23a6-4cd4-98c4-c5111b6803a7 service neutron] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:52:50.490109 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd91d6a-23a6-4cd4-98c4-c5111b6803a7 service neutron] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:52:50.496333 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe88fb-edff-4127-9fd1-d87f0cffe4a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:52:50.497682 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe88fb-edff-4127-9fd1-d87f0cffe4a6 service nova] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:52:50.498180 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe88fb-edff-4127-9fd1-d87f0cffe4a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:52:50.498669 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe88fb-edff-4127-9fd1-d87f0cffe4a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:52:50.508349 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe88fb-edff-4127-9fd1-d87f0cffe4a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:52:50.509950 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe88fb-edff-4127-9fd1-d87f0cffe4a6 service nova] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:52:50.521186 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1166/2332] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:52:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:52:50.744218 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850bd43-c731-411d-9608-499b40486848 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:52:50.756719 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850bd43-c731-411d-9608-499b40486848 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:52:50.761278 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9573303-d0b6-45cd-94a6-7e04d840b009 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:52:50.761278 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9573303-d0b6-45cd-94a6-7e04d840b009 service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:52:50.761477 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9573303-d0b6-45cd-94a6-7e04d840b009 service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:52:50.761723 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9573303-d0b6-45cd-94a6-7e04d840b009 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:52:50.763596 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-e9573303-d0b6-45cd-94a6-7e04d840b009 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:52:50.777789 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9573303-d0b6-45cd-94a6-7e04d840b009 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:52:50.779227 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9573303-d0b6-45cd-94a6-7e04d840b009 service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:52:50.792001 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1167/2333] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:52:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:52:57.801306 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92758a9b-beae-42c6-b8fa-840ed738e916 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:52:57.801857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92758a9b-beae-42c6-b8fa-840ed738e916 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:52:57.801857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92758a9b-beae-42c6-b8fa-840ed738e916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:52:57.822507 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-92758a9b-beae-42c6-b8fa-840ed738e916 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:52:57.823689 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-92758a9b-beae-42c6-b8fa-840ed738e916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:52:57.832198 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1167/2334] 10.222.0.44 () {58 vars in 1016 bytes} [Fri Aug 5 02:52:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:52:57.879029 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9573303-d0b6-45cd-94a6-7e04d840b009 service neutron] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:52:57.891478 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9573303-d0b6-45cd-94a6-7e04d840b009 service neutron] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:52:57.897781 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51459d-bbe8-4196-a362-9c09da395389 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:52:57.898469 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51459d-bbe8-4196-a362-9c09da395389 service nova] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:52:57.898751 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51459d-bbe8-4196-a362-9c09da395389 service nova] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:52:57.899061 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51459d-bbe8-4196-a362-9c09da395389 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:52:57.905700 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:52:57.908226 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51459d-bbe8-4196-a362-9c09da395389 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:52:57.909814 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51459d-bbe8-4196-a362-9c09da395389 service nova] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:52:57.919625 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1168/2335] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:52:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:52:58.728232 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92758a9b-beae-42c6-b8fa-840ed738e916 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:52:58.738496 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92758a9b-beae-42c6-b8fa-840ed738e916 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:52:58.742126 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aedeb1-1b72-44da-8380-d3d6ab6ab081 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:52:58.744439 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aedeb1-1b72-44da-8380-d3d6ab6ab081 service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:52:58.744439 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aedeb1-1b72-44da-8380-d3d6ab6ab081 service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:52:58.744439 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aedeb1-1b72-44da-8380-d3d6ab6ab081 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:52:58.745092 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-64aedeb1-1b72-44da-8380-d3d6ab6ab081 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:52:58.756795 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aedeb1-1b72-44da-8380-d3d6ab6ab081 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:52:58.758219 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aedeb1-1b72-44da-8380-d3d6ab6ab081 service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:52:58.768089 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1168/2336] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:52:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:53:00.840775 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9930498-bbaf-4dc1-a4e5-b9a2619f123b None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:00.841721 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9930498-bbaf-4dc1-a4e5-b9a2619f123b None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:00.842372 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9930498-bbaf-4dc1-a4e5-b9a2619f123b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:00.864251 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-e9930498-bbaf-4dc1-a4e5-b9a2619f123b None None] MFA Rules not processed for user `4033953c81e5494ea03a7031df9ddcc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:53:00.865730 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-e9930498-bbaf-4dc1-a4e5-b9a2619f123b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:01.003772 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1169/2337] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:53:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:53:01.060377 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af45a55-04eb-4965-a10c-078edc3ed370 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:01.061418 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af45a55-04eb-4965-a10c-078edc3ed370 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:01.061877 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af45a55-04eb-4965-a10c-078edc3ed370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:01.090477 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-1af45a55-04eb-4965-a10c-078edc3ed370 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:53:01.092828 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-1af45a55-04eb-4965-a10c-078edc3ed370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:01.103501 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1169/2338] 10.222.0.44 () {58 vars in 1016 bytes} [Fri Aug 5 02:53:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:53:01.241590 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9930498-bbaf-4dc1-a4e5-b9a2619f123b None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:01.243640 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-e9930498-bbaf-4dc1-a4e5-b9a2619f123b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:01.280280 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9930498-bbaf-4dc1-a4e5-b9a2619f123b None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:01.286457 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ad25d-4257-4a79-b94c-44b61f84c250 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:01.287275 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ad25d-4257-4a79-b94c-44b61f84c250 service nova] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:01.287663 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ad25d-4257-4a79-b94c-44b61f84c250 service nova] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:01.288042 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ad25d-4257-4a79-b94c-44b61f84c250 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:01.299516 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ad25d-4257-4a79-b94c-44b61f84c250 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:01.301438 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ad25d-4257-4a79-b94c-44b61f84c250 service nova] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:01.330919 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1170/2339] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:53:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:53:03.332956 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af45a55-04eb-4965-a10c-078edc3ed370 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:03.334680 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-1af45a55-04eb-4965-a10c-078edc3ed370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:03.350786 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af45a55-04eb-4965-a10c-078edc3ed370 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:03.355717 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bbdad9-0d6d-47dc-b5d0-099fc4ed6795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:03.356364 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbdad9-0d6d-47dc-b5d0-099fc4ed6795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:03.356645 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbdad9-0d6d-47dc-b5d0-099fc4ed6795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:03.356916 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbdad9-0d6d-47dc-b5d0-099fc4ed6795 admin admin] PATH_INFO: `/v3/users/8f8ed7d12ca44a058ed8b888ca723b57` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:03.358300 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bbdad9-0d6d-47dc-b5d0-099fc4ed6795 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f8ed7d12ca44a058ed8b888ca723b57)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:03.360474 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bbdad9-0d6d-47dc-b5d0-099fc4ed6795 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:03.576190 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-72bbdad9-0d6d-47dc-b5d0-099fc4ed6795 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f8ed7d12ca44a058ed8b888ca723b57'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:03.652261 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-72bbdad9-0d6d-47dc-b5d0-099fc4ed6795 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f8ed7d12ca44a058ed8b888ca723b57'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:03.659888 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-72bbdad9-0d6d-47dc-b5d0-099fc4ed6795 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f8ed7d12ca44a058ed8b888ca723b57'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:03.664130 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-72bbdad9-0d6d-47dc-b5d0-099fc4ed6795 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f8ed7d12ca44a058ed8b888ca723b57'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:03.673051 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-72bbdad9-0d6d-47dc-b5d0-099fc4ed6795 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f8ed7d12ca44a058ed8b888ca723b57'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:03.679048 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1170/2340] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:53:03 2022] DELETE /identity/v3/users/8f8ed7d12ca44a058ed8b888ca723b57 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:53:03.927409 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ad25d-4257-4a79-b94c-44b61f84c250 service nova] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:03.939155 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ad25d-4257-4a79-b94c-44b61f84c250 service nova] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:04.003468 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265777e-9d25-4650-b989-c8d5b00db195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:04.004269 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265777e-9d25-4650-b989-c8d5b00db195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:04.004612 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265777e-9d25-4650-b989-c8d5b00db195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:04.004950 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265777e-9d25-4650-b989-c8d5b00db195 admin admin] PATH_INFO: `/v3/projects/2c2ae546c66548f38f5cbeff1c53b341` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:04.006150 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a265777e-9d25-4650-b989-c8d5b00db195 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c2ae546c66548f38f5cbeff1c53b341)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:04.008083 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a265777e-9d25-4650-b989-c8d5b00db195 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:04.139116 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-a265777e-9d25-4650-b989-c8d5b00db195 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c2ae546c66548f38f5cbeff1c53b341', 'request_id': 'req-a265777e-9d25-4650-b989-c8d5b00db195'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:04.234096 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-a265777e-9d25-4650-b989-c8d5b00db195 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c2ae546c66548f38f5cbeff1c53b341', 'request_id': 'req-a265777e-9d25-4650-b989-c8d5b00db195'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:04.240563 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-a265777e-9d25-4650-b989-c8d5b00db195 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c2ae546c66548f38f5cbeff1c53b341', 'request_id': 'req-a265777e-9d25-4650-b989-c8d5b00db195'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:04.252196 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-a265777e-9d25-4650-b989-c8d5b00db195 admin admin] The token cache is being invalidate because project 2c2ae546c66548f38f5cbeff1c53b341 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:53:04.252484 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-a265777e-9d25-4650-b989-c8d5b00db195 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:04.253123 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-a265777e-9d25-4650-b989-c8d5b00db195 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:04.254608 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1171/2341] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:53:03 2022] DELETE /identity/v3/projects/2c2ae546c66548f38f5cbeff1c53b341 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:53:04.267591 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca2453-8e81-4cff-8f84-4ede47fdc5fa None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:04.268242 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca2453-8e81-4cff-8f84-4ede47fdc5fa None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:04.268678 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca2453-8e81-4cff-8f84-4ede47fdc5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:04.298115 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-beca2453-8e81-4cff-8f84-4ede47fdc5fa None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:53:04.299362 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-beca2453-8e81-4cff-8f84-4ede47fdc5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:04.303922 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:53:04.363854 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1171/2342] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:53:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:53:04.370641 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd2eab-3c1c-498d-84b0-7e2e3eee0aa1 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:04.371000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd2eab-3c1c-498d-84b0-7e2e3eee0aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:04.371282 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd2eab-3c1c-498d-84b0-7e2e3eee0aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:04.392815 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-b5bd2eab-3c1c-498d-84b0-7e2e3eee0aa1 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:53:04.394033 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-b5bd2eab-3c1c-498d-84b0-7e2e3eee0aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:04.402036 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1172/2343] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:53:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:53:04.407188 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca2453-8e81-4cff-8f84-4ede47fdc5fa None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:04.417387 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca2453-8e81-4cff-8f84-4ede47fdc5fa None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:04.421957 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0a168-4072-408a-9eb9-9b309fffece8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:04.422566 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0a168-4072-408a-9eb9-9b309fffece8 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:04.422851 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0a168-4072-408a-9eb9-9b309fffece8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:04.423170 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0a168-4072-408a-9eb9-9b309fffece8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:04.424126 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0a168-4072-408a-9eb9-9b309fffece8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:53:04.424433 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0a168-4072-408a-9eb9-9b309fffece8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:04.426040 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0a168-4072-408a-9eb9-9b309fffece8 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:04.437527 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1172/2344] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:53:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:53:04.442020 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd2eab-3c1c-498d-84b0-7e2e3eee0aa1 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:04.451109 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd2eab-3c1c-498d-84b0-7e2e3eee0aa1 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:04.456426 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be41c26-4251-4206-91bf-f8e4aa6201c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:04.457062 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be41c26-4251-4206-91bf-f8e4aa6201c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:04.457344 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be41c26-4251-4206-91bf-f8e4aa6201c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:04.457621 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be41c26-4251-4206-91bf-f8e4aa6201c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:04.458295 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be41c26-4251-4206-91bf-f8e4aa6201c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:04.460228 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be41c26-4251-4206-91bf-f8e4aa6201c5 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:04.471071 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:53:04.544438 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1173/2345] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:53:04 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:53:04.553324 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0a168-4072-408a-9eb9-9b309fffece8 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:04.563927 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0a168-4072-408a-9eb9-9b309fffece8 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:04.630871 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558d25f-54dd-4f44-9a56-4b6474230e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:04.631530 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558d25f-54dd-4f44-9a56-4b6474230e53 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:04.631815 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558d25f-54dd-4f44-9a56-4b6474230e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:04.632382 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558d25f-54dd-4f44-9a56-4b6474230e53 admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:04.633438 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d558d25f-54dd-4f44-9a56-4b6474230e53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:04.636077 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d558d25f-54dd-4f44-9a56-4b6474230e53 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:04.703109 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1173/2346] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:53:04 2022] POST /identity/v3/users => generated 290 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:53:04.707374 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be41c26-4251-4206-91bf-f8e4aa6201c5 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:04.718210 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be41c26-4251-4206-91bf-f8e4aa6201c5 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:04.723378 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0128710-ccbe-4bc8-9867-92bac9d8096d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:04.724238 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0128710-ccbe-4bc8-9867-92bac9d8096d admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:04.724795 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0128710-ccbe-4bc8-9867-92bac9d8096d admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:04.725140 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0128710-ccbe-4bc8-9867-92bac9d8096d admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:04.726353 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0128710-ccbe-4bc8-9867-92bac9d8096d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:04.728288 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0128710-ccbe-4bc8-9867-92bac9d8096d admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:04.739921 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1174/2347] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:53:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:53:04.744173 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558d25f-54dd-4f44-9a56-4b6474230e53 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:04.755029 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558d25f-54dd-4f44-9a56-4b6474230e53 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:04.759781 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c7b05-9c7b-4ca3-b1c5-f4b09dd9cdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:04.760387 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c7b05-9c7b-4ca3-b1c5-f4b09dd9cdfe admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:04.760666 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c7b05-9c7b-4ca3-b1c5-f4b09dd9cdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:04.760938 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c7b05-9c7b-4ca3-b1c5-f4b09dd9cdfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:04.761656 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81c7b05-9c7b-4ca3-b1c5-f4b09dd9cdfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:04.763280 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81c7b05-9c7b-4ca3-b1c5-f4b09dd9cdfe admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:04.777524 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1174/2348] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:53:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:53:04.779402 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0128710-ccbe-4bc8-9867-92bac9d8096d admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:04.790495 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0128710-ccbe-4bc8-9867-92bac9d8096d admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:04.795680 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3937d-e019-4858-80de-f0468e60abb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:04.796386 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3937d-e019-4858-80de-f0468e60abb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:04.796699 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3937d-e019-4858-80de-f0468e60abb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:04.796999 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3937d-e019-4858-80de-f0468e60abb4 admin admin] PATH_INFO: `/v3/projects/b87405c225f143a58a4900b341a7ed36/users/4e0617385b814bda8e7b58a3ccf3e067/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:04.814538 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae3937d-e019-4858-80de-f0468e60abb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b87405c225f143a58a4900b341a7ed36, user_id=4e0617385b814bda8e7b58a3ccf3e067, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:04.817538 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae3937d-e019-4858-80de-f0468e60abb4 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:04.928612 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1175/2349] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:53:04 2022] PUT /identity/v3/projects/b87405c225f143a58a4900b341a7ed36/users/4e0617385b814bda8e7b58a3ccf3e067/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:53:04.939546 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204e925-935d-4967-9a76-73bff19c387d None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:04.939856 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204e925-935d-4967-9a76-73bff19c387d None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:04.940134 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204e925-935d-4967-9a76-73bff19c387d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:04.970109 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-4204e925-935d-4967-9a76-73bff19c387d None None] MFA Rules not processed for user `4e0617385b814bda8e7b58a3ccf3e067`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:53:04.971585 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-4204e925-935d-4967-9a76-73bff19c387d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:05.040751 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1175/2350] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:53:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:53:05.045580 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3937d-e019-4858-80de-f0468e60abb4 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:05.112511 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3937d-e019-4858-80de-f0468e60abb4 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:05.117216 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50a684-f1d8-4f2d-9323-7613cbf3aa11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:05.117887 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50a684-f1d8-4f2d-9323-7613cbf3aa11 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:05.118164 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50a684-f1d8-4f2d-9323-7613cbf3aa11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:05.118438 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50a684-f1d8-4f2d-9323-7613cbf3aa11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:05.119169 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b50a684-f1d8-4f2d-9323-7613cbf3aa11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:05.121109 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b50a684-f1d8-4f2d-9323-7613cbf3aa11 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:05.209413 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1176/2351] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:53:05 2022] POST /identity/v3/projects => generated 381 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:53:05.215633 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204e925-935d-4967-9a76-73bff19c387d None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:05.223252 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:53:05.227947 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204e925-935d-4967-9a76-73bff19c387d None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:05.241032 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50a684-f1d8-4f2d-9323-7613cbf3aa11 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:05.250861 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-6b50a684-f1d8-4f2d-9323-7613cbf3aa11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:05.306695 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea2fac-eb85-4155-9bcf-4fd7e3afa4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:05.306695 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea2fac-eb85-4155-9bcf-4fd7e3afa4ea admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:05.306695 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea2fac-eb85-4155-9bcf-4fd7e3afa4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:05.306695 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea2fac-eb85-4155-9bcf-4fd7e3afa4ea admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:05.307682 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea2fac-eb85-4155-9bcf-4fd7e3afa4ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:05.308453 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea2fac-eb85-4155-9bcf-4fd7e3afa4ea admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:05.379358 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50a684-f1d8-4f2d-9323-7613cbf3aa11 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:05.383919 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e3c6a-87fc-4009-829d-e4ac6351c591 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:05.384548 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e3c6a-87fc-4009-829d-e4ac6351c591 service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:05.384826 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e3c6a-87fc-4009-829d-e4ac6351c591 service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:05.385102 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e3c6a-87fc-4009-829d-e4ac6351c591 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:05.386914 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-a22e3c6a-87fc-4009-829d-e4ac6351c591 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:05.412091 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1176/2352] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:53:05 2022] POST /identity/v3/users => generated 297 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:53:05.414114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea2fac-eb85-4155-9bcf-4fd7e3afa4ea admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:05.417126 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-4cea2fac-eb85-4155-9bcf-4fd7e3afa4ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:05.459866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:53:05.464582 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22e3c6a-87fc-4009-829d-e4ac6351c591 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:05.466664 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22e3c6a-87fc-4009-829d-e4ac6351c591 service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:05.482601 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1177/2353] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:53:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:53:05.485665 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e3c6a-87fc-4009-829d-e4ac6351c591 service neutron] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:05.504527 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e3c6a-87fc-4009-829d-e4ac6351c591 service neutron] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:05.509809 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4fb9a3-5f88-4dd0-af20-1dbd53ec35d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:05.510561 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4fb9a3-5f88-4dd0-af20-1dbd53ec35d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:05.510919 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4fb9a3-5f88-4dd0-af20-1dbd53ec35d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:05.511327 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4fb9a3-5f88-4dd0-af20-1dbd53ec35d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:05.512759 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4fb9a3-5f88-4dd0-af20-1dbd53ec35d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:05.515882 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4fb9a3-5f88-4dd0-af20-1dbd53ec35d9 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:05.531469 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1178/2354] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:53:05.531642 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea2fac-eb85-4155-9bcf-4fd7e3afa4ea admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:05.532654 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4fb9a3-5f88-4dd0-af20-1dbd53ec35d9 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:05.543525 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4fb9a3-5f88-4dd0-af20-1dbd53ec35d9 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:05.550462 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c8751b-57b1-466e-a09d-0dd34c065881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:05.551002 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d451f-4ad6-41e6-a317-9c1382c1d9e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:05.551404 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8751b-57b1-466e-a09d-0dd34c065881 admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:05.551806 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8751b-57b1-466e-a09d-0dd34c065881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:05.551938 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d451f-4ad6-41e6-a317-9c1382c1d9e6 service nova] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:05.552093 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d451f-4ad6-41e6-a317-9c1382c1d9e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:05.552374 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8751b-57b1-466e-a09d-0dd34c065881 admin admin] PATH_INFO: `/v3/projects/d458f6caa9fb4a4c9c0d6f0b6dea2584/users/609e97f983df45cb8410ab852ea7e2a3/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:05.552496 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d451f-4ad6-41e6-a317-9c1382c1d9e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:05.571800 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c8751b-57b1-466e-a09d-0dd34c065881 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d458f6caa9fb4a4c9c0d6f0b6dea2584, user_id=609e97f983df45cb8410ab852ea7e2a3, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:05.572298 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336d451f-4ad6-41e6-a317-9c1382c1d9e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:05.574630 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336d451f-4ad6-41e6-a317-9c1382c1d9e6 service nova] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:05.575024 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c8751b-57b1-466e-a09d-0dd34c065881 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:05.586601 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1177/2355] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:53:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:53:05.702736 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1179/2356] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:53:05 2022] PUT /identity/v3/projects/d458f6caa9fb4a4c9c0d6f0b6dea2584/users/609e97f983df45cb8410ab852ea7e2a3/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:53:05.705729 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d451f-4ad6-41e6-a317-9c1382c1d9e6 service nova] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:05.717310 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d451f-4ad6-41e6-a317-9c1382c1d9e6 service nova] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:05.790392 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee5b3f-4086-4a5e-99e2-e3df3fd5eecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:05.791121 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee5b3f-4086-4a5e-99e2-e3df3fd5eecb admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:05.791405 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee5b3f-4086-4a5e-99e2-e3df3fd5eecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:05.791680 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee5b3f-4086-4a5e-99e2-e3df3fd5eecb admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:05.792583 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee5b3f-4086-4a5e-99e2-e3df3fd5eecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:05.794119 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee5b3f-4086-4a5e-99e2-e3df3fd5eecb admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:05.804860 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1178/2357] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:53:05.809154 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c8751b-57b1-466e-a09d-0dd34c065881 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:05.819860 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c8751b-57b1-466e-a09d-0dd34c065881 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:05.824807 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013640f-dd64-4f06-9cd6-c764c3a1592b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:05.825948 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013640f-dd64-4f06-9cd6-c764c3a1592b admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:05.825948 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013640f-dd64-4f06-9cd6-c764c3a1592b admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:05.826187 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013640f-dd64-4f06-9cd6-c764c3a1592b admin admin] PATH_INFO: `/v3/projects/d458f6caa9fb4a4c9c0d6f0b6dea2584/users/609e97f983df45cb8410ab852ea7e2a3/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:05.828833 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013640f-dd64-4f06-9cd6-c764c3a1592b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d458f6caa9fb4a4c9c0d6f0b6dea2584, user_id=609e97f983df45cb8410ab852ea7e2a3, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:05.831632 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013640f-dd64-4f06-9cd6-c764c3a1592b admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:05.842775 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1180/2358] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:53:05 2022] PUT /identity/v3/projects/d458f6caa9fb4a4c9c0d6f0b6dea2584/users/609e97f983df45cb8410ab852ea7e2a3/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:53:05.854907 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d8e67-4f85-4e0e-864f-c5d51ca94fd0 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:05.855228 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d8e67-4f85-4e0e-864f-c5d51ca94fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:05.855573 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d8e67-4f85-4e0e-864f-c5d51ca94fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:05.889340 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-c77d8e67-4f85-4e0e-864f-c5d51ca94fd0 None None] MFA Rules not processed for user `609e97f983df45cb8410ab852ea7e2a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:53:05.891320 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-c77d8e67-4f85-4e0e-864f-c5d51ca94fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:05.895555 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:53:05.964710 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1179/2359] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:53:05 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:53:05.978170 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013640f-dd64-4f06-9cd6-c764c3a1592b admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:05.980375 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-4013640f-dd64-4f06-9cd6-c764c3a1592b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:06.078772 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013640f-dd64-4f06-9cd6-c764c3a1592b admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:06.082536 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16bfd7a-7413-4fc1-8137-6156de7cbc78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:06.083317 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16bfd7a-7413-4fc1-8137-6156de7cbc78 service cinder] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:06.083700 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16bfd7a-7413-4fc1-8137-6156de7cbc78 service cinder] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:06.084143 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16bfd7a-7413-4fc1-8137-6156de7cbc78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:06.097632 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16bfd7a-7413-4fc1-8137-6156de7cbc78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:06.100161 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16bfd7a-7413-4fc1-8137-6156de7cbc78 service cinder] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:06.109665 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1181/2360] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:53:05 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:53:06.668506 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d8e67-4f85-4e0e-864f-c5d51ca94fd0 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:06.763981 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d8e67-4f85-4e0e-864f-c5d51ca94fd0 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:06.773935 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79240844-09cd-4143-8b39-0d097640c9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:06.774594 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79240844-09cd-4143-8b39-0d097640c9b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:06.774879 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79240844-09cd-4143-8b39-0d097640c9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:06.775194 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79240844-09cd-4143-8b39-0d097640c9b1 admin admin] PATH_INFO: `/v3/users/4e0617385b814bda8e7b58a3ccf3e067` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:06.776432 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79240844-09cd-4143-8b39-0d097640c9b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e0617385b814bda8e7b58a3ccf3e067)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:06.778512 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79240844-09cd-4143-8b39-0d097640c9b1 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:07.053488 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-79240844-09cd-4143-8b39-0d097640c9b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e0617385b814bda8e7b58a3ccf3e067'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:07.148899 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-79240844-09cd-4143-8b39-0d097640c9b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e0617385b814bda8e7b58a3ccf3e067'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:07.158574 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-79240844-09cd-4143-8b39-0d097640c9b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e0617385b814bda8e7b58a3ccf3e067'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:07.159408 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-79240844-09cd-4143-8b39-0d097640c9b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e0617385b814bda8e7b58a3ccf3e067'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:07.176144 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-79240844-09cd-4143-8b39-0d097640c9b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e0617385b814bda8e7b58a3ccf3e067'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:07.183264 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1180/2361] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:53:06 2022] DELETE /identity/v3/users/4e0617385b814bda8e7b58a3ccf3e067 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:53:07.187542 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c5007-ebfa-480d-825d-2903c094f549 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:07.188030 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c5007-ebfa-480d-825d-2903c094f549 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:07.188135 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c5007-ebfa-480d-825d-2903c094f549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:07.208512 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-cf0c5007-ebfa-480d-825d-2903c094f549 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:53:07.209749 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-cf0c5007-ebfa-480d-825d-2903c094f549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:07.282207 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1182/2362] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:53:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:53:07.292579 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79240844-09cd-4143-8b39-0d097640c9b1 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:07.294876 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-79240844-09cd-4143-8b39-0d097640c9b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:07.320191 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:53:07.371887 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79240844-09cd-4143-8b39-0d097640c9b1 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:07.375454 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba9f80-4417-46b7-a1be-833a5c07deb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:07.376241 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba9f80-4417-46b7-a1be-833a5c07deb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:07.376491 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba9f80-4417-46b7-a1be-833a5c07deb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:07.376769 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba9f80-4417-46b7-a1be-833a5c07deb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:07.386686 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba9f80-4417-46b7-a1be-833a5c07deb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:07.388264 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba9f80-4417-46b7-a1be-833a5c07deb4 service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:07.404011 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1181/2363] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:53:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:53:07.803873 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c5007-ebfa-480d-825d-2903c094f549 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:07.805300 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-cf0c5007-ebfa-480d-825d-2903c094f549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:07.822025 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c5007-ebfa-480d-825d-2903c094f549 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:07.831832 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb09869-4cd7-4db0-89a2-332cfd4fba7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:07.831832 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb09869-4cd7-4db0-89a2-332cfd4fba7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:07.831832 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb09869-4cd7-4db0-89a2-332cfd4fba7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:07.831832 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb09869-4cd7-4db0-89a2-332cfd4fba7b admin admin] PATH_INFO: `/v3/projects/b87405c225f143a58a4900b341a7ed36` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:07.832489 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb09869-4cd7-4db0-89a2-332cfd4fba7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b87405c225f143a58a4900b341a7ed36)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:07.833945 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb09869-4cd7-4db0-89a2-332cfd4fba7b admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:07.983291 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:53:07.988800 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-edb09869-4cd7-4db0-89a2-332cfd4fba7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b87405c225f143a58a4900b341a7ed36', 'request_id': 'req-edb09869-4cd7-4db0-89a2-332cfd4fba7b'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:08.056974 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-edb09869-4cd7-4db0-89a2-332cfd4fba7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b87405c225f143a58a4900b341a7ed36', 'request_id': 'req-edb09869-4cd7-4db0-89a2-332cfd4fba7b'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:08.063504 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-edb09869-4cd7-4db0-89a2-332cfd4fba7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b87405c225f143a58a4900b341a7ed36', 'request_id': 'req-edb09869-4cd7-4db0-89a2-332cfd4fba7b'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:08.074535 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-edb09869-4cd7-4db0-89a2-332cfd4fba7b admin admin] The token cache is being invalidate because project b87405c225f143a58a4900b341a7ed36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:53:08.074827 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-edb09869-4cd7-4db0-89a2-332cfd4fba7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:08.075519 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-edb09869-4cd7-4db0-89a2-332cfd4fba7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:08.077027 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1183/2364] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:53:07 2022] DELETE /identity/v3/projects/b87405c225f143a58a4900b341a7ed36 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:53:08.081063 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba9f80-4417-46b7-a1be-833a5c07deb4 service neutron] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:08.090754 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba9f80-4417-46b7-a1be-833a5c07deb4 service neutron] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:08.146607 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec55894a-f619-4930-bbcf-60c23f07ff95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:08.147291 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55894a-f619-4930-bbcf-60c23f07ff95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:08.147577 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55894a-f619-4930-bbcf-60c23f07ff95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:08.147856 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55894a-f619-4930-bbcf-60c23f07ff95 admin admin] PATH_INFO: `/v3/users/609e97f983df45cb8410ab852ea7e2a3` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:08.149006 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec55894a-f619-4930-bbcf-60c23f07ff95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=609e97f983df45cb8410ab852ea7e2a3)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:08.150996 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec55894a-f619-4930-bbcf-60c23f07ff95 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:08.323068 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-ec55894a-f619-4930-bbcf-60c23f07ff95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '609e97f983df45cb8410ab852ea7e2a3'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:08.400218 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-ec55894a-f619-4930-bbcf-60c23f07ff95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '609e97f983df45cb8410ab852ea7e2a3'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:08.408327 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-ec55894a-f619-4930-bbcf-60c23f07ff95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '609e97f983df45cb8410ab852ea7e2a3'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:08.408971 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-ec55894a-f619-4930-bbcf-60c23f07ff95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '609e97f983df45cb8410ab852ea7e2a3'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:08.422172 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-ec55894a-f619-4930-bbcf-60c23f07ff95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '609e97f983df45cb8410ab852ea7e2a3'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:08.428431 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1182/2365] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:53:08 2022] DELETE /identity/v3/users/609e97f983df45cb8410ab852ea7e2a3 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:53:08.820455 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb09869-4cd7-4db0-89a2-332cfd4fba7b admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:08.821934 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-edb09869-4cd7-4db0-89a2-332cfd4fba7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:08.835776 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb09869-4cd7-4db0-89a2-332cfd4fba7b admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:08.892639 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935902ef-b41a-43ed-95e4-1fd0e6b76f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:08.893282 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935902ef-b41a-43ed-95e4-1fd0e6b76f9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:08.893564 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935902ef-b41a-43ed-95e4-1fd0e6b76f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:08.893845 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935902ef-b41a-43ed-95e4-1fd0e6b76f9b admin admin] PATH_INFO: `/v3/projects/d458f6caa9fb4a4c9c0d6f0b6dea2584` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:08.895030 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935902ef-b41a-43ed-95e4-1fd0e6b76f9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d458f6caa9fb4a4c9c0d6f0b6dea2584)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:08.896978 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935902ef-b41a-43ed-95e4-1fd0e6b76f9b admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:09.005307 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-935902ef-b41a-43ed-95e4-1fd0e6b76f9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd458f6caa9fb4a4c9c0d6f0b6dea2584', 'request_id': 'req-935902ef-b41a-43ed-95e4-1fd0e6b76f9b'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:09.076587 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-935902ef-b41a-43ed-95e4-1fd0e6b76f9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd458f6caa9fb4a4c9c0d6f0b6dea2584', 'request_id': 'req-935902ef-b41a-43ed-95e4-1fd0e6b76f9b'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:09.083235 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-935902ef-b41a-43ed-95e4-1fd0e6b76f9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd458f6caa9fb4a4c9c0d6f0b6dea2584', 'request_id': 'req-935902ef-b41a-43ed-95e4-1fd0e6b76f9b'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:09.096029 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-935902ef-b41a-43ed-95e4-1fd0e6b76f9b admin admin] The token cache is being invalidate because project d458f6caa9fb4a4c9c0d6f0b6dea2584 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:53:09.096245 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-935902ef-b41a-43ed-95e4-1fd0e6b76f9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:09.096886 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-935902ef-b41a-43ed-95e4-1fd0e6b76f9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:09.098650 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1184/2366] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:53:08 2022] DELETE /identity/v3/projects/d458f6caa9fb4a4c9c0d6f0b6dea2584 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:53:09.104378 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f942225-037b-43ad-8c2a-84be3a3e46a3 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:09.104895 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f942225-037b-43ad-8c2a-84be3a3e46a3 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:09.104990 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f942225-037b-43ad-8c2a-84be3a3e46a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:09.124396 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-2f942225-037b-43ad-8c2a-84be3a3e46a3 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:53:09.126134 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-2f942225-037b-43ad-8c2a-84be3a3e46a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:09.165647 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:53:09.185417 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1183/2367] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:53:09.193832 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a80c9-3b0e-4775-87ac-9ac70cba691d None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:09.194118 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a80c9-3b0e-4775-87ac-9ac70cba691d None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:09.194398 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a80c9-3b0e-4775-87ac-9ac70cba691d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:09.216264 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-e25a80c9-3b0e-4775-87ac-9ac70cba691d None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:53:09.217451 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-e25a80c9-3b0e-4775-87ac-9ac70cba691d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:09.225479 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1185/2368] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:53:09.229799 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f942225-037b-43ad-8c2a-84be3a3e46a3 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:09.240787 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f942225-037b-43ad-8c2a-84be3a3e46a3 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:09.244420 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935a28b-7563-416f-b2a9-3bce95e82410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:09.248552 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935a28b-7563-416f-b2a9-3bce95e82410 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:09.248552 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935a28b-7563-416f-b2a9-3bce95e82410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:09.248552 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935a28b-7563-416f-b2a9-3bce95e82410 admin admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:09.248552 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4935a28b-7563-416f-b2a9-3bce95e82410 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:53:09.248552 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4935a28b-7563-416f-b2a9-3bce95e82410 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:09.248552 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4935a28b-7563-416f-b2a9-3bce95e82410 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:09.259809 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1184/2369] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:53:09.264360 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a80c9-3b0e-4775-87ac-9ac70cba691d None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:09.274803 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a80c9-3b0e-4775-87ac-9ac70cba691d None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:09.279400 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c45fbc-f309-4f85-b322-e9554459898c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:09.280005 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c45fbc-f309-4f85-b322-e9554459898c admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:09.280284 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c45fbc-f309-4f85-b322-e9554459898c admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:09.280571 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c45fbc-f309-4f85-b322-e9554459898c admin admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:09.281246 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c45fbc-f309-4f85-b322-e9554459898c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:09.283198 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c45fbc-f309-4f85-b322-e9554459898c admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:09.364267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1186/2370] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:53:09 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:53:09.368466 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935a28b-7563-416f-b2a9-3bce95e82410 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:09.379428 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935a28b-7563-416f-b2a9-3bce95e82410 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:09.437660 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d56999-e16e-4df6-90ae-60544383ffb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:09.438365 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d56999-e16e-4df6-90ae-60544383ffb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:09.438642 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d56999-e16e-4df6-90ae-60544383ffb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:09.438916 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d56999-e16e-4df6-90ae-60544383ffb3 admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:09.439602 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d56999-e16e-4df6-90ae-60544383ffb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:09.441520 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d56999-e16e-4df6-90ae-60544383ffb3 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:09.543547 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1185/2371] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:53:09 2022] POST /identity/v3/users => generated 288 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:53:09.548323 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c45fbc-f309-4f85-b322-e9554459898c admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:09.558630 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c45fbc-f309-4f85-b322-e9554459898c admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:09.563884 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e74c1a-0316-44a9-8038-47bab1c58cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:09.564538 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e74c1a-0316-44a9-8038-47bab1c58cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:09.564783 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e74c1a-0316-44a9-8038-47bab1c58cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:09.565079 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e74c1a-0316-44a9-8038-47bab1c58cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:09.565767 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e74c1a-0316-44a9-8038-47bab1c58cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:09.567413 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e74c1a-0316-44a9-8038-47bab1c58cf5 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:09.577779 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1187/2372] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:53:09.581839 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d56999-e16e-4df6-90ae-60544383ffb3 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:09.591741 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d56999-e16e-4df6-90ae-60544383ffb3 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:09.596592 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468104f-648f-46dd-aa2b-dfbc39bbc0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:09.597195 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468104f-648f-46dd-aa2b-dfbc39bbc0d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:09.597474 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468104f-648f-46dd-aa2b-dfbc39bbc0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:09.597745 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468104f-648f-46dd-aa2b-dfbc39bbc0d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:09.598431 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4468104f-648f-46dd-aa2b-dfbc39bbc0d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:09.600061 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4468104f-648f-46dd-aa2b-dfbc39bbc0d6 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:09.611115 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1186/2373] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:53:09.615297 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e74c1a-0316-44a9-8038-47bab1c58cf5 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:09.625718 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e74c1a-0316-44a9-8038-47bab1c58cf5 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:09.630413 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321a34f-959a-4584-b86d-c23659d78cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:09.631117 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321a34f-959a-4584-b86d-c23659d78cdc admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:09.631394 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321a34f-959a-4584-b86d-c23659d78cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:09.631668 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321a34f-959a-4584-b86d-c23659d78cdc admin admin] PATH_INFO: `/v3/projects/d40447ebb2aa4e1aaa88d556d7f1c88c/users/e46241f25b494cf6a83cf0b571f82c10/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:09.649238 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6321a34f-959a-4584-b86d-c23659d78cdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d40447ebb2aa4e1aaa88d556d7f1c88c, user_id=e46241f25b494cf6a83cf0b571f82c10, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:09.652100 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6321a34f-959a-4584-b86d-c23659d78cdc admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:09.721144 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:53:09.726732 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1188/2374] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:53:09 2022] PUT /identity/v3/projects/d40447ebb2aa4e1aaa88d556d7f1c88c/users/e46241f25b494cf6a83cf0b571f82c10/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:53:09.737559 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d59ac-3297-4ec7-9de0-a64e6e707f26 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:09.737951 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d59ac-3297-4ec7-9de0-a64e6e707f26 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:09.738225 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d59ac-3297-4ec7-9de0-a64e6e707f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:09.766205 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-ea1d59ac-3297-4ec7-9de0-a64e6e707f26 None None] MFA Rules not processed for user `e46241f25b494cf6a83cf0b571f82c10`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:53:09.767504 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-ea1d59ac-3297-4ec7-9de0-a64e6e707f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:09.831832 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1187/2375] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:53:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:53:09.843152 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321a34f-959a-4584-b86d-c23659d78cdc admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:09.845185 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-6321a34f-959a-4584-b86d-c23659d78cdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:09.901443 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321a34f-959a-4584-b86d-c23659d78cdc admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:09.904965 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b008798b-e43d-48ee-b901-f825ba42bb09 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '116f66d7dd7b42878f71bd29dc55729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:09.905585 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008798b-e43d-48ee-b901-f825ba42bb09 service glance] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:09.906371 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008798b-e43d-48ee-b901-f825ba42bb09 service glance] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:09.906645 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008798b-e43d-48ee-b901-f825ba42bb09 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:09.922115 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b008798b-e43d-48ee-b901-f825ba42bb09 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:09.922115 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b008798b-e43d-48ee-b901-f825ba42bb09 service glance] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:09.925782 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1189/2376] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:53:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:53:12.421274 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d59ac-3297-4ec7-9de0-a64e6e707f26 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:12.423387 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-ea1d59ac-3297-4ec7-9de0-a64e6e707f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:12.473286 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:53:12.504238 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d59ac-3297-4ec7-9de0-a64e6e707f26 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:12.510100 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90c601-83e3-4ad7-bf12-efb04578291d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:12.510736 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90c601-83e3-4ad7-bf12-efb04578291d service nova] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:12.511041 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90c601-83e3-4ad7-bf12-efb04578291d service nova] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:12.511313 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90c601-83e3-4ad7-bf12-efb04578291d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:12.513080 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-5b90c601-83e3-4ad7-bf12-efb04578291d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:12.574910 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b90c601-83e3-4ad7-bf12-efb04578291d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:12.576625 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b90c601-83e3-4ad7-bf12-efb04578291d service nova] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:12.591331 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1188/2377] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:53:12 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:53:15.892339 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b008798b-e43d-48ee-b901-f825ba42bb09 service glance] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:15.893769 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-b008798b-e43d-48ee-b901-f825ba42bb09 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:15.952564 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b008798b-e43d-48ee-b901-f825ba42bb09 service glance] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:15.957502 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc23d97-848e-44c1-b00f-8880d77c97f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:15.958141 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc23d97-848e-44c1-b00f-8880d77c97f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:15.958423 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc23d97-848e-44c1-b00f-8880d77c97f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:15.958701 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc23d97-848e-44c1-b00f-8880d77c97f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:15.960750 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-cfc23d97-848e-44c1-b00f-8880d77c97f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:15.971191 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc23d97-848e-44c1-b00f-8880d77c97f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:15.972614 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc23d97-848e-44c1-b00f-8880d77c97f8 service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:15.980622 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1190/2378] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:53:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:53:22.608228 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=39 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:53:25.976893 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=53 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:53:28.309688 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90c601-83e3-4ad7-bf12-efb04578291d service nova] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:28.371498 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90c601-83e3-4ad7-bf12-efb04578291d service nova] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:28.376223 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89527ae9-dc86-4403-b2e4-7420c6b16fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:28.376865 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89527ae9-dc86-4403-b2e4-7420c6b16fdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:28.377150 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89527ae9-dc86-4403-b2e4-7420c6b16fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:28.377430 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89527ae9-dc86-4403-b2e4-7420c6b16fdd admin admin] PATH_INFO: `/v3/users/e46241f25b494cf6a83cf0b571f82c10` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:28.378600 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89527ae9-dc86-4403-b2e4-7420c6b16fdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e46241f25b494cf6a83cf0b571f82c10)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:28.380635 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89527ae9-dc86-4403-b2e4-7420c6b16fdd admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:28.549388 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-89527ae9-dc86-4403-b2e4-7420c6b16fdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e46241f25b494cf6a83cf0b571f82c10'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:28.639088 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-89527ae9-dc86-4403-b2e4-7420c6b16fdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e46241f25b494cf6a83cf0b571f82c10'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:28.647603 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-89527ae9-dc86-4403-b2e4-7420c6b16fdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e46241f25b494cf6a83cf0b571f82c10'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:28.648313 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-89527ae9-dc86-4403-b2e4-7420c6b16fdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e46241f25b494cf6a83cf0b571f82c10'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:28.661020 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-89527ae9-dc86-4403-b2e4-7420c6b16fdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e46241f25b494cf6a83cf0b571f82c10'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:28.667098 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1189/2379] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:53:28 2022] DELETE /identity/v3/users/e46241f25b494cf6a83cf0b571f82c10 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:53:28.671580 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6ec41-6e5c-444e-99a2-2f4d92d4cea4 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:28.672097 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6ec41-6e5c-444e-99a2-2f4d92d4cea4 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:28.672208 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6ec41-6e5c-444e-99a2-2f4d92d4cea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:28.691561 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-fdd6ec41-6e5c-444e-99a2-2f4d92d4cea4 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:53:28.698400 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-fdd6ec41-6e5c-444e-99a2-2f4d92d4cea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:28.759754 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1191/2380] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:53:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:53:28.769858 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89527ae9-dc86-4403-b2e4-7420c6b16fdd admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:28.771366 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-89527ae9-dc86-4403-b2e4-7420c6b16fdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:28.831876 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89527ae9-dc86-4403-b2e4-7420c6b16fdd admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:28.835578 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25e9ef-78db-4d7d-86f7-7bc2c210baf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:28.836220 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25e9ef-78db-4d7d-86f7-7bc2c210baf8 service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:28.836486 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25e9ef-78db-4d7d-86f7-7bc2c210baf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:28.836765 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25e9ef-78db-4d7d-86f7-7bc2c210baf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:28.846491 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a25e9ef-78db-4d7d-86f7-7bc2c210baf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:28.848263 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a25e9ef-78db-4d7d-86f7-7bc2c210baf8 service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:28.857956 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1190/2381] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:53:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:53:29.305637 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd6ec41-6e5c-444e-99a2-2f4d92d4cea4 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:29.307201 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-fdd6ec41-6e5c-444e-99a2-2f4d92d4cea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:29.324779 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd6ec41-6e5c-444e-99a2-2f4d92d4cea4 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:29.336334 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5438135b-1cb3-4d6d-bc9a-46ab744b01c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:29.336334 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5438135b-1cb3-4d6d-bc9a-46ab744b01c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:29.336334 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5438135b-1cb3-4d6d-bc9a-46ab744b01c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:29.336334 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5438135b-1cb3-4d6d-bc9a-46ab744b01c3 admin admin] PATH_INFO: `/v3/projects/d40447ebb2aa4e1aaa88d556d7f1c88c` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:29.336644 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5438135b-1cb3-4d6d-bc9a-46ab744b01c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d40447ebb2aa4e1aaa88d556d7f1c88c)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:29.336644 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5438135b-1cb3-4d6d-bc9a-46ab744b01c3 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:29.437962 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-5438135b-1cb3-4d6d-bc9a-46ab744b01c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd40447ebb2aa4e1aaa88d556d7f1c88c', 'request_id': 'req-5438135b-1cb3-4d6d-bc9a-46ab744b01c3'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:29.508000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-5438135b-1cb3-4d6d-bc9a-46ab744b01c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd40447ebb2aa4e1aaa88d556d7f1c88c', 'request_id': 'req-5438135b-1cb3-4d6d-bc9a-46ab744b01c3'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:29.514171 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-5438135b-1cb3-4d6d-bc9a-46ab744b01c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd40447ebb2aa4e1aaa88d556d7f1c88c', 'request_id': 'req-5438135b-1cb3-4d6d-bc9a-46ab744b01c3'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:29.525308 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-5438135b-1cb3-4d6d-bc9a-46ab744b01c3 admin admin] The token cache is being invalidate because project d40447ebb2aa4e1aaa88d556d7f1c88c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:53:29.525596 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-5438135b-1cb3-4d6d-bc9a-46ab744b01c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:29.526217 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-5438135b-1cb3-4d6d-bc9a-46ab744b01c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:29.527807 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1192/2382] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:53:29 2022] DELETE /identity/v3/projects/d40447ebb2aa4e1aaa88d556d7f1c88c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:53:29.532615 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d736c-5c97-4fbf-88e3-4b8c64c792da None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:29.533099 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d736c-5c97-4fbf-88e3-4b8c64c792da None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:29.533209 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d736c-5c97-4fbf-88e3-4b8c64c792da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:29.553673 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-a67d736c-5c97-4fbf-88e3-4b8c64c792da None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:53:29.554878 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-a67d736c-5c97-4fbf-88e3-4b8c64c792da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:29.571828 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:53:29.614500 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1191/2383] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:53:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:53:29.623420 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b8eff-bc68-4875-84bc-522b83b5a2e8 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:29.623707 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b8eff-bc68-4875-84bc-522b83b5a2e8 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:29.623982 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b8eff-bc68-4875-84bc-522b83b5a2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:29.643848 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-df3b8eff-bc68-4875-84bc-522b83b5a2e8 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:53:29.645038 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-df3b8eff-bc68-4875-84bc-522b83b5a2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:29.653167 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1193/2384] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:53:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:53:29.657428 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d736c-5c97-4fbf-88e3-4b8c64c792da None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:29.667405 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d736c-5c97-4fbf-88e3-4b8c64c792da None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:29.671934 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d635e4a-8cf8-4464-ba9a-b04e39b3d948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:29.672545 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d635e4a-8cf8-4464-ba9a-b04e39b3d948 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:29.673032 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d635e4a-8cf8-4464-ba9a-b04e39b3d948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:29.673553 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d635e4a-8cf8-4464-ba9a-b04e39b3d948 admin admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:29.675244 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d635e4a-8cf8-4464-ba9a-b04e39b3d948 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:53:29.675648 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d635e4a-8cf8-4464-ba9a-b04e39b3d948 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:29.677326 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d635e4a-8cf8-4464-ba9a-b04e39b3d948 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:29.688734 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1192/2385] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:53:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:53:29.693118 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b8eff-bc68-4875-84bc-522b83b5a2e8 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:29.702477 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b8eff-bc68-4875-84bc-522b83b5a2e8 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:29.707403 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ec773-18a7-48fe-bc3f-b41c4b215999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:29.708043 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ec773-18a7-48fe-bc3f-b41c4b215999 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:29.708323 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ec773-18a7-48fe-bc3f-b41c4b215999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:29.708718 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ec773-18a7-48fe-bc3f-b41c4b215999 admin admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:29.709384 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14ec773-18a7-48fe-bc3f-b41c4b215999 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:29.711567 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14ec773-18a7-48fe-bc3f-b41c4b215999 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:29.781067 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1194/2386] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:53:29 2022] POST /identity/v3/projects => generated 377 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:53:29.782115 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d635e4a-8cf8-4464-ba9a-b04e39b3d948 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:29.794086 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d635e4a-8cf8-4464-ba9a-b04e39b3d948 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:29.858887 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0283dd-9247-467e-a946-9c2fbfcfd5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:29.859653 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0283dd-9247-467e-a946-9c2fbfcfd5ed admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:29.860080 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0283dd-9247-467e-a946-9c2fbfcfd5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:29.860480 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0283dd-9247-467e-a946-9c2fbfcfd5ed admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:29.861215 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0283dd-9247-467e-a946-9c2fbfcfd5ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:29.863192 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0283dd-9247-467e-a946-9c2fbfcfd5ed admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:29.934546 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1193/2387] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:53:29 2022] POST /identity/v3/users => generated 289 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:53:29.940916 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ec773-18a7-48fe-bc3f-b41c4b215999 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:29.951043 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ec773-18a7-48fe-bc3f-b41c4b215999 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:29.956121 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbcce7-58f3-407a-b51b-f34001812d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:29.956723 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbcce7-58f3-407a-b51b-f34001812d58 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:29.957005 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbcce7-58f3-407a-b51b-f34001812d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:29.957277 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbcce7-58f3-407a-b51b-f34001812d58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:29.957979 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fbcce7-58f3-407a-b51b-f34001812d58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:29.959612 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fbcce7-58f3-407a-b51b-f34001812d58 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:29.970902 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1195/2388] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:53:29.975905 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0283dd-9247-467e-a946-9c2fbfcfd5ed admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:29.985917 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0283dd-9247-467e-a946-9c2fbfcfd5ed admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:29.993860 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f7f65-01d3-4384-988c-08f310c96e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:29.993860 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f7f65-01d3-4384-988c-08f310c96e01 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:29.993860 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f7f65-01d3-4384-988c-08f310c96e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:29.993860 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f7f65-01d3-4384-988c-08f310c96e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:29.994259 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f7f65-01d3-4384-988c-08f310c96e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:29.994259 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f7f65-01d3-4384-988c-08f310c96e01 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:30.004833 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1194/2389] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:53:30.009088 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbcce7-58f3-407a-b51b-f34001812d58 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:30.019564 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbcce7-58f3-407a-b51b-f34001812d58 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:30.024110 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41dad4-26ac-41b6-b259-cd9f97a06956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:30.024759 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41dad4-26ac-41b6-b259-cd9f97a06956 admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:30.025038 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41dad4-26ac-41b6-b259-cd9f97a06956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:30.025311 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41dad4-26ac-41b6-b259-cd9f97a06956 admin admin] PATH_INFO: `/v3/projects/cbd8ae043285412d96d0442cca46bb87/users/b8016e0bd2ca4561bcf60b8b6a542a9b/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:30.040116 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41dad4-26ac-41b6-b259-cd9f97a06956 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbd8ae043285412d96d0442cca46bb87, user_id=b8016e0bd2ca4561bcf60b8b6a542a9b, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:30.042753 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41dad4-26ac-41b6-b259-cd9f97a06956 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:30.111585 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1196/2390] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:53:30 2022] PUT /identity/v3/projects/cbd8ae043285412d96d0442cca46bb87/users/b8016e0bd2ca4561bcf60b8b6a542a9b/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:53:30.123613 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d410600-8807-4507-96f4-30a3d1663ce2 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:30.124041 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d410600-8807-4507-96f4-30a3d1663ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:30.124150 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d410600-8807-4507-96f4-30a3d1663ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:30.153790 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-1d410600-8807-4507-96f4-30a3d1663ce2 None None] MFA Rules not processed for user `b8016e0bd2ca4561bcf60b8b6a542a9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:53:30.155080 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-1d410600-8807-4507-96f4-30a3d1663ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:30.218665 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1195/2391] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:53:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:53:30.223701 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41dad4-26ac-41b6-b259-cd9f97a06956 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:30.245305 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:53:30.286076 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41dad4-26ac-41b6-b259-cd9f97a06956 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:30.290706 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac0449-282e-4e89-964e-e55d41399c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:30.291364 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac0449-282e-4e89-964e-e55d41399c1e admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:30.291643 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac0449-282e-4e89-964e-e55d41399c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:30.291965 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac0449-282e-4e89-964e-e55d41399c1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:30.292638 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac0449-282e-4e89-964e-e55d41399c1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:30.294587 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac0449-282e-4e89-964e-e55d41399c1e admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:30.383807 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1197/2392] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:53:30 2022] POST /identity/v3/projects => generated 375 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:53:30.388204 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d410600-8807-4507-96f4-30a3d1663ce2 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:30.399593 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d410600-8807-4507-96f4-30a3d1663ce2 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:30.411960 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:53:30.456967 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad1fac-8093-414d-bc05-26666a812822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:30.457576 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad1fac-8093-414d-bc05-26666a812822 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:30.457869 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad1fac-8093-414d-bc05-26666a812822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:30.458124 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad1fac-8093-414d-bc05-26666a812822 admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:30.458809 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ad1fac-8093-414d-bc05-26666a812822 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:30.460764 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ad1fac-8093-414d-bc05-26666a812822 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:30.547085 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1196/2393] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:53:30 2022] POST /identity/v3/users => generated 288 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:53:30.551690 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac0449-282e-4e89-964e-e55d41399c1e admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:30.562154 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac0449-282e-4e89-964e-e55d41399c1e admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:30.567391 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eac65d-e23d-4dc6-b0a0-d770cd0bdbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:30.567999 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eac65d-e23d-4dc6-b0a0-d770cd0bdbf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:30.568274 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eac65d-e23d-4dc6-b0a0-d770cd0bdbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:30.568546 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eac65d-e23d-4dc6-b0a0-d770cd0bdbf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:30.569236 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eac65d-e23d-4dc6-b0a0-d770cd0bdbf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:30.570820 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eac65d-e23d-4dc6-b0a0-d770cd0bdbf9 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:30.581208 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1198/2394] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:53:30.585288 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad1fac-8093-414d-bc05-26666a812822 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:30.595388 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad1fac-8093-414d-bc05-26666a812822 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:30.600348 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c368e74-0552-4912-a86e-8c2ddd2142a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:30.600946 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c368e74-0552-4912-a86e-8c2ddd2142a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:30.601231 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c368e74-0552-4912-a86e-8c2ddd2142a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:30.601499 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c368e74-0552-4912-a86e-8c2ddd2142a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:30.602184 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c368e74-0552-4912-a86e-8c2ddd2142a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:30.603861 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c368e74-0552-4912-a86e-8c2ddd2142a1 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:30.614642 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1197/2395] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:53:30.618772 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eac65d-e23d-4dc6-b0a0-d770cd0bdbf9 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:30.629251 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eac65d-e23d-4dc6-b0a0-d770cd0bdbf9 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:30.633754 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c339b-2434-47ce-a251-a17313e87647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:30.634403 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c339b-2434-47ce-a251-a17313e87647 admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:30.634681 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c339b-2434-47ce-a251-a17313e87647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:30.634979 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c339b-2434-47ce-a251-a17313e87647 admin admin] PATH_INFO: `/v3/projects/e5539818ec184a27a2126e458edf0423/users/1c5c7e05674042a9958d5a968b3b0997/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:30.648841 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1c339b-2434-47ce-a251-a17313e87647 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5539818ec184a27a2126e458edf0423, user_id=1c5c7e05674042a9958d5a968b3b0997, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:30.651521 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1c339b-2434-47ce-a251-a17313e87647 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:30.730464 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1199/2396] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:53:30 2022] PUT /identity/v3/projects/e5539818ec184a27a2126e458edf0423/users/1c5c7e05674042a9958d5a968b3b0997/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:53:30.741122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f8998-fba0-44ee-a1c3-55678fa360ff None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:30.742855 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f8998-fba0-44ee-a1c3-55678fa360ff None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:30.742855 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f8998-fba0-44ee-a1c3-55678fa360ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:30.769824 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-de0f8998-fba0-44ee-a1c3-55678fa360ff None None] MFA Rules not processed for user `1c5c7e05674042a9958d5a968b3b0997`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:53:30.771360 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-de0f8998-fba0-44ee-a1c3-55678fa360ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:30.834529 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1198/2397] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:53:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:53:30.840399 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c339b-2434-47ce-a251-a17313e87647 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:30.901414 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c339b-2434-47ce-a251-a17313e87647 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:30.906137 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccec09-6fe8-45f4-90fd-78016dca6bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:30.909325 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccec09-6fe8-45f4-90fd-78016dca6bbc admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:30.909325 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccec09-6fe8-45f4-90fd-78016dca6bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:30.909325 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccec09-6fe8-45f4-90fd-78016dca6bbc admin admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:30.909325 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ccec09-6fe8-45f4-90fd-78016dca6bbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:30.910409 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ccec09-6fe8-45f4-90fd-78016dca6bbc admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:30.991407 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1200/2398] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:53:30 2022] POST /identity/v3/projects => generated 377 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:53:30.992455 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f8998-fba0-44ee-a1c3-55678fa360ff None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:31.003869 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f8998-fba0-44ee-a1c3-55678fa360ff None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:31.065374 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51212d-6f78-41ce-a913-05a2f0e9ef27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:31.065995 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51212d-6f78-41ce-a913-05a2f0e9ef27 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:31.066272 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51212d-6f78-41ce-a913-05a2f0e9ef27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:31.066556 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51212d-6f78-41ce-a913-05a2f0e9ef27 admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:31.067248 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51212d-6f78-41ce-a913-05a2f0e9ef27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:31.069219 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51212d-6f78-41ce-a913-05a2f0e9ef27 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:31.161935 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1199/2399] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:53:30 2022] POST /identity/v3/users => generated 295 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:53:31.166016 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccec09-6fe8-45f4-90fd-78016dca6bbc admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:31.176933 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccec09-6fe8-45f4-90fd-78016dca6bbc admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:31.181544 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1aa13-5bd5-4155-9c68-c30a060d2505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:31.182188 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1aa13-5bd5-4155-9c68-c30a060d2505 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:31.182471 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1aa13-5bd5-4155-9c68-c30a060d2505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:31.182747 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1aa13-5bd5-4155-9c68-c30a060d2505 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:31.183483 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1aa13-5bd5-4155-9c68-c30a060d2505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:31.186063 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1aa13-5bd5-4155-9c68-c30a060d2505 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:31.196087 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1201/2400] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:53:31.200078 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51212d-6f78-41ce-a913-05a2f0e9ef27 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:31.210553 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51212d-6f78-41ce-a913-05a2f0e9ef27 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:31.217022 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619171c-fc70-49a8-b5e1-989fbabcabbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:31.217022 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619171c-fc70-49a8-b5e1-989fbabcabbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:31.217022 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619171c-fc70-49a8-b5e1-989fbabcabbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:31.217022 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619171c-fc70-49a8-b5e1-989fbabcabbb admin admin] PATH_INFO: `/v3/projects/7bb3f0c9290f48ea84c0fde981749620/users/9c1da59348b84f649d16b53bb4aee402/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:31.229097 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:53:31.232257 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d619171c-fc70-49a8-b5e1-989fbabcabbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bb3f0c9290f48ea84c0fde981749620, user_id=9c1da59348b84f649d16b53bb4aee402, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:31.234962 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d619171c-fc70-49a8-b5e1-989fbabcabbb admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:31.323473 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1200/2401] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:53:31 2022] PUT /identity/v3/projects/7bb3f0c9290f48ea84c0fde981749620/users/9c1da59348b84f649d16b53bb4aee402/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:53:31.327646 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1aa13-5bd5-4155-9c68-c30a060d2505 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:31.337955 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1aa13-5bd5-4155-9c68-c30a060d2505 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:31.380204 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:53:31.396065 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74d7b0-4f9c-488d-9427-7b290aeaf167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:31.396700 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74d7b0-4f9c-488d-9427-7b290aeaf167 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:31.396981 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74d7b0-4f9c-488d-9427-7b290aeaf167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:31.397258 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74d7b0-4f9c-488d-9427-7b290aeaf167 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:31.397961 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e74d7b0-4f9c-488d-9427-7b290aeaf167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:31.399634 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e74d7b0-4f9c-488d-9427-7b290aeaf167 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:31.410516 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1202/2402] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:53:31.415110 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619171c-fc70-49a8-b5e1-989fbabcabbb admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:31.426604 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619171c-fc70-49a8-b5e1-989fbabcabbb admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:31.431907 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6a591-a98b-46d6-be19-5076cbd7c90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:31.432353 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6a591-a98b-46d6-be19-5076cbd7c90d admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:31.432721 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6a591-a98b-46d6-be19-5076cbd7c90d admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:31.432975 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6a591-a98b-46d6-be19-5076cbd7c90d admin admin] PATH_INFO: `/v3/projects/7bb3f0c9290f48ea84c0fde981749620/users/9c1da59348b84f649d16b53bb4aee402/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:31.434886 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc6a591-a98b-46d6-be19-5076cbd7c90d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bb3f0c9290f48ea84c0fde981749620, user_id=9c1da59348b84f649d16b53bb4aee402, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:31.437616 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc6a591-a98b-46d6-be19-5076cbd7c90d admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:31.450441 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1201/2403] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:53:31 2022] PUT /identity/v3/projects/7bb3f0c9290f48ea84c0fde981749620/users/9c1da59348b84f649d16b53bb4aee402/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:53:31.461336 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772697a4-fa95-42f1-b67b-273286a30277 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:31.472050 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772697a4-fa95-42f1-b67b-273286a30277 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:31.472050 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772697a4-fa95-42f1-b67b-273286a30277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:31.490843 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-772697a4-fa95-42f1-b67b-273286a30277 None None] MFA Rules not processed for user `9c1da59348b84f649d16b53bb4aee402`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:53:31.492087 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-772697a4-fa95-42f1-b67b-273286a30277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:31.563112 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1203/2404] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:53:31 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:53:31.574770 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6a591-a98b-46d6-be19-5076cbd7c90d admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:31.576554 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-ccc6a591-a98b-46d6-be19-5076cbd7c90d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:31.634892 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6a591-a98b-46d6-be19-5076cbd7c90d admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:31.638514 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c2c1f-82f7-4de3-9e34-f1dad76f2e42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:31.639152 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c2c1f-82f7-4de3-9e34-f1dad76f2e42 service cinder] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:31.639431 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c2c1f-82f7-4de3-9e34-f1dad76f2e42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:31.639702 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c2c1f-82f7-4de3-9e34-f1dad76f2e42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:31.699743 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211c2c1f-82f7-4de3-9e34-f1dad76f2e42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:31.701238 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211c2c1f-82f7-4de3-9e34-f1dad76f2e42 service cinder] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:31.712197 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1202/2405] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:53:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:53:33.751034 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772697a4-fa95-42f1-b67b-273286a30277 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:33.751034 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-772697a4-fa95-42f1-b67b-273286a30277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:33.761888 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72045c75-6509-4b58-8875-83de1109b382 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:33.762462 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72045c75-6509-4b58-8875-83de1109b382 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:33.762677 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72045c75-6509-4b58-8875-83de1109b382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:33.765466 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772697a4-fa95-42f1-b67b-273286a30277 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:33.776768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf170db-5a90-4509-8fd6-c4787c0d7182 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:33.782813 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf170db-5a90-4509-8fd6-c4787c0d7182 service cinder] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:33.782813 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf170db-5a90-4509-8fd6-c4787c0d7182 service cinder] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:33.782813 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf170db-5a90-4509-8fd6-c4787c0d7182 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:33.802719 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-72045c75-6509-4b58-8875-83de1109b382 None None] MFA Rules not processed for user `6bea520676244effbbe212aa62b1cc68`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:53:33.804615 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-72045c75-6509-4b58-8875-83de1109b382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:33.842688 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf170db-5a90-4509-8fd6-c4787c0d7182 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:33.844244 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf170db-5a90-4509-8fd6-c4787c0d7182 service cinder] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:33.853619 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1204/2406] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:53:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:53:33.863638 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1203/2407] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Aug 5 02:53:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:53:34.002133 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf170db-5a90-4509-8fd6-c4787c0d7182 service cinder] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:34.003623 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-daf170db-5a90-4509-8fd6-c4787c0d7182 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:34.086341 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf170db-5a90-4509-8fd6-c4787c0d7182 service cinder] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:34.093422 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609c342-fdfd-4be6-be9b-59050e6dfe1e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40f706f1eb2b4137afd367cb5060ced0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:34.094707 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609c342-fdfd-4be6-be9b-59050e6dfe1e service swift] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:34.095058 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609c342-fdfd-4be6-be9b-59050e6dfe1e service swift] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:34.095333 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609c342-fdfd-4be6-be9b-59050e6dfe1e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:34.101429 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:53:34.105118 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a609c342-fdfd-4be6-be9b-59050e6dfe1e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:34.106904 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a609c342-fdfd-4be6-be9b-59050e6dfe1e service swift] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:34.115630 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1205/2408] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 5 02:53:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 02:53:35.434226 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72045c75-6509-4b58-8875-83de1109b382 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:35.453758 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72045c75-6509-4b58-8875-83de1109b382 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:35.460042 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda0188e-ef3a-4e59-b796-03b3c9548d46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:35.461025 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0188e-ef3a-4e59-b796-03b3c9548d46 service cinder] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:35.461554 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0188e-ef3a-4e59-b796-03b3c9548d46 service cinder] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:35.462050 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0188e-ef3a-4e59-b796-03b3c9548d46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:35.476869 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda0188e-ef3a-4e59-b796-03b3c9548d46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:35.478984 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda0188e-ef3a-4e59-b796-03b3c9548d46 service cinder] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:35.492328 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1204/2409] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:53:35 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:53:35.977253 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609c342-fdfd-4be6-be9b-59050e6dfe1e service swift] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:35.978883 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-a609c342-fdfd-4be6-be9b-59050e6dfe1e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:36.062612 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609c342-fdfd-4be6-be9b-59050e6dfe1e service swift] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:36.071191 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d07bec-1288-4862-a07f-91781cba5cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:36.071983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d07bec-1288-4862-a07f-91781cba5cdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:36.072281 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d07bec-1288-4862-a07f-91781cba5cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:36.072561 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d07bec-1288-4862-a07f-91781cba5cdc admin admin] PATH_INFO: `/v3/users/a1fe4b24e4f346d6bcbbeb3afd54450a` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:36.073753 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d07bec-1288-4862-a07f-91781cba5cdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1fe4b24e4f346d6bcbbeb3afd54450a)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:36.075746 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d07bec-1288-4862-a07f-91781cba5cdc admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:36.328627 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-65d07bec-1288-4862-a07f-91781cba5cdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1fe4b24e4f346d6bcbbeb3afd54450a'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:36.386866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-65d07bec-1288-4862-a07f-91781cba5cdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1fe4b24e4f346d6bcbbeb3afd54450a'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:36.398307 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-65d07bec-1288-4862-a07f-91781cba5cdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1fe4b24e4f346d6bcbbeb3afd54450a'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:36.411735 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-65d07bec-1288-4862-a07f-91781cba5cdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1fe4b24e4f346d6bcbbeb3afd54450a'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:36.412635 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-65d07bec-1288-4862-a07f-91781cba5cdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1fe4b24e4f346d6bcbbeb3afd54450a'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:36.423626 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1206/2410] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:53:35 2022] DELETE /identity/v3/users/a1fe4b24e4f346d6bcbbeb3afd54450a => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:53:36.688117 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda0188e-ef3a-4e59-b796-03b3c9548d46 service cinder] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:36.705877 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda0188e-ef3a-4e59-b796-03b3c9548d46 service cinder] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:36.737749 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:53:36.783160 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf244c8e-e7d6-4ae3-bc60-ee3fdd5c42d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:36.784302 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf244c8e-e7d6-4ae3-bc60-ee3fdd5c42d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:36.785152 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf244c8e-e7d6-4ae3-bc60-ee3fdd5c42d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:36.785415 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf244c8e-e7d6-4ae3-bc60-ee3fdd5c42d1 admin admin] PATH_INFO: `/v3/projects/26d5d551156a4ce8a133160cd5d2e33a` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:36.786692 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf244c8e-e7d6-4ae3-bc60-ee3fdd5c42d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26d5d551156a4ce8a133160cd5d2e33a)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:36.793387 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf244c8e-e7d6-4ae3-bc60-ee3fdd5c42d1 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:37.283123 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-bf244c8e-e7d6-4ae3-bc60-ee3fdd5c42d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26d5d551156a4ce8a133160cd5d2e33a', 'request_id': 'req-bf244c8e-e7d6-4ae3-bc60-ee3fdd5c42d1'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:37.434372 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-bf244c8e-e7d6-4ae3-bc60-ee3fdd5c42d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26d5d551156a4ce8a133160cd5d2e33a', 'request_id': 'req-bf244c8e-e7d6-4ae3-bc60-ee3fdd5c42d1'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:37.444143 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-bf244c8e-e7d6-4ae3-bc60-ee3fdd5c42d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26d5d551156a4ce8a133160cd5d2e33a', 'request_id': 'req-bf244c8e-e7d6-4ae3-bc60-ee3fdd5c42d1'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:37.463849 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-bf244c8e-e7d6-4ae3-bc60-ee3fdd5c42d1 admin admin] The token cache is being invalidate because project 26d5d551156a4ce8a133160cd5d2e33a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:53:37.464267 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-bf244c8e-e7d6-4ae3-bc60-ee3fdd5c42d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:37.465184 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-bf244c8e-e7d6-4ae3-bc60-ee3fdd5c42d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:37.467229 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1205/2411] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:53:36 2022] DELETE /identity/v3/projects/26d5d551156a4ce8a133160cd5d2e33a => generated 0 bytes in 780 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:53:37.472640 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95827cfa-7b3d-40ee-9b1e-2a6d40d778e6 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:37.473605 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95827cfa-7b3d-40ee-9b1e-2a6d40d778e6 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:37.474045 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95827cfa-7b3d-40ee-9b1e-2a6d40d778e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:37.495464 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-95827cfa-7b3d-40ee-9b1e-2a6d40d778e6 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:53:37.497007 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-95827cfa-7b3d-40ee-9b1e-2a6d40d778e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:37.573414 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1207/2412] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:53:37.581056 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5d9b0-2ac5-4ceb-80f0-2eaa10fe35fa None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:37.581960 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5d9b0-2ac5-4ceb-80f0-2eaa10fe35fa None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:37.582249 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5d9b0-2ac5-4ceb-80f0-2eaa10fe35fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:37.605649 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-5ee5d9b0-2ac5-4ceb-80f0-2eaa10fe35fa None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:53:37.606898 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-5ee5d9b0-2ac5-4ceb-80f0-2eaa10fe35fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:37.619827 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95827cfa-7b3d-40ee-9b1e-2a6d40d778e6 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:37.623364 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1206/2413] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:53:37.637692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95827cfa-7b3d-40ee-9b1e-2a6d40d778e6 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:37.664862 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b59636-1479-4b05-897d-a1025b36c4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:37.665512 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b59636-1479-4b05-897d-a1025b36c4fd admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:37.665799 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b59636-1479-4b05-897d-a1025b36c4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:37.666073 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b59636-1479-4b05-897d-a1025b36c4fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:37.666783 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b59636-1479-4b05-897d-a1025b36c4fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:53:37.667161 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b59636-1479-4b05-897d-a1025b36c4fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:37.668779 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b59636-1479-4b05-897d-a1025b36c4fd admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:37.685530 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:53:37.690821 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1208/2414] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:53:37.693678 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee5d9b0-2ac5-4ceb-80f0-2eaa10fe35fa None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:37.706595 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee5d9b0-2ac5-4ceb-80f0-2eaa10fe35fa None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:37.725926 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1483324-b5bc-41a7-9df3-11d4fe4f4e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:37.725926 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1483324-b5bc-41a7-9df3-11d4fe4f4e52 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:37.725926 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1483324-b5bc-41a7-9df3-11d4fe4f4e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:37.725926 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1483324-b5bc-41a7-9df3-11d4fe4f4e52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:37.726383 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1483324-b5bc-41a7-9df3-11d4fe4f4e52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:37.726383 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1483324-b5bc-41a7-9df3-11d4fe4f4e52 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:38.442750 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1207/2415] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:53:37 2022] POST /identity/v3/projects => generated 397 bytes in 750 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:53:38.447467 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b59636-1479-4b05-897d-a1025b36c4fd admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:38.460633 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b59636-1479-4b05-897d-a1025b36c4fd admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:38.553430 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7703c-d50f-4efe-91d1-da39590facb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:38.554220 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7703c-d50f-4efe-91d1-da39590facb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:38.554325 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7703c-d50f-4efe-91d1-da39590facb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:38.554604 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7703c-d50f-4efe-91d1-da39590facb2 admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:38.555291 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d7703c-d50f-4efe-91d1-da39590facb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:38.557211 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d7703c-d50f-4efe-91d1-da39590facb2 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:38.628565 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1209/2416] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:53:38 2022] POST /identity/v3/users => generated 299 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:53:38.629963 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1483324-b5bc-41a7-9df3-11d4fe4f4e52 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:38.641298 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1483324-b5bc-41a7-9df3-11d4fe4f4e52 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:38.648935 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595014d-9485-41ab-8e68-3a43aae9b7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:38.649614 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595014d-9485-41ab-8e68-3a43aae9b7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:38.649878 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595014d-9485-41ab-8e68-3a43aae9b7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:38.650219 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595014d-9485-41ab-8e68-3a43aae9b7c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:38.650978 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595014d-9485-41ab-8e68-3a43aae9b7c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:38.652673 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595014d-9485-41ab-8e68-3a43aae9b7c8 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:38.668287 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1208/2417] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:53:38.669934 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7703c-d50f-4efe-91d1-da39590facb2 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:38.681677 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7703c-d50f-4efe-91d1-da39590facb2 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:38.687755 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2238f6f3-5df7-49fc-bb50-fb2e4216e098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:38.688836 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238f6f3-5df7-49fc-bb50-fb2e4216e098 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:38.689065 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238f6f3-5df7-49fc-bb50-fb2e4216e098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:38.689271 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238f6f3-5df7-49fc-bb50-fb2e4216e098 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:38.689967 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2238f6f3-5df7-49fc-bb50-fb2e4216e098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:38.691665 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2238f6f3-5df7-49fc-bb50-fb2e4216e098 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:38.709054 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1210/2418] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:53:38.711914 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595014d-9485-41ab-8e68-3a43aae9b7c8 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:38.725550 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595014d-9485-41ab-8e68-3a43aae9b7c8 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:38.730714 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98d577-218c-4619-927b-a2285fdf9bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:38.731427 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98d577-218c-4619-927b-a2285fdf9bd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:38.731709 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98d577-218c-4619-927b-a2285fdf9bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:38.731993 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98d577-218c-4619-927b-a2285fdf9bd5 admin admin] PATH_INFO: `/v3/projects/3c44baf0f5db4bedb5562a4afcf5a506/users/5b8e93caffff4ab984753b7ee8ee92e3/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:38.751169 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98d577-218c-4619-927b-a2285fdf9bd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c44baf0f5db4bedb5562a4afcf5a506, user_id=5b8e93caffff4ab984753b7ee8ee92e3, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:38.754194 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98d577-218c-4619-927b-a2285fdf9bd5 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:38.858721 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1209/2419] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:53:38 2022] PUT /identity/v3/projects/3c44baf0f5db4bedb5562a4afcf5a506/users/5b8e93caffff4ab984753b7ee8ee92e3/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:53:38.870361 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e64bdc-fb24-4202-b797-33d35d3354a8 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:38.870656 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e64bdc-fb24-4202-b797-33d35d3354a8 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:38.870940 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e64bdc-fb24-4202-b797-33d35d3354a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:38.904029 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-38e64bdc-fb24-4202-b797-33d35d3354a8 None None] MFA Rules not processed for user `5b8e93caffff4ab984753b7ee8ee92e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:53:38.905373 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-38e64bdc-fb24-4202-b797-33d35d3354a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:38.999537 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1211/2420] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:53:38 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:53:39.011280 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98d577-218c-4619-927b-a2285fdf9bd5 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:39.013158 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-3f98d577-218c-4619-927b-a2285fdf9bd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:39.085035 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98d577-218c-4619-927b-a2285fdf9bd5 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:39.091132 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4593f1-bcd0-487a-b535-f7542134173e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:39.091918 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4593f1-bcd0-487a-b535-f7542134173e service cinder] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:39.092295 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4593f1-bcd0-487a-b535-f7542134173e service cinder] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:39.092595 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4593f1-bcd0-487a-b535-f7542134173e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:39.099033 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:53:39.103603 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4593f1-bcd0-487a-b535-f7542134173e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:39.107307 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4593f1-bcd0-487a-b535-f7542134173e service cinder] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:39.116069 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1210/2421] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:53:39 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:53:41.953397 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e64bdc-fb24-4202-b797-33d35d3354a8 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:41.953968 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-38e64bdc-fb24-4202-b797-33d35d3354a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:42.033911 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e64bdc-fb24-4202-b797-33d35d3354a8 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:42.039747 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe7e9ff-d971-4794-aa9e-d8174bbf84f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:42.040527 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7e9ff-d971-4794-aa9e-d8174bbf84f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:42.040889 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7e9ff-d971-4794-aa9e-d8174bbf84f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:42.041243 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7e9ff-d971-4794-aa9e-d8174bbf84f7 admin admin] PATH_INFO: `/v3/users/b8016e0bd2ca4561bcf60b8b6a542a9b` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:42.042619 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe7e9ff-d971-4794-aa9e-d8174bbf84f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8016e0bd2ca4561bcf60b8b6a542a9b)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:42.044680 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe7e9ff-d971-4794-aa9e-d8174bbf84f7 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:42.059251 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:53:42.330833 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-bfe7e9ff-d971-4794-aa9e-d8174bbf84f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8016e0bd2ca4561bcf60b8b6a542a9b'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:42.406603 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-bfe7e9ff-d971-4794-aa9e-d8174bbf84f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8016e0bd2ca4561bcf60b8b6a542a9b'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:42.421772 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-bfe7e9ff-d971-4794-aa9e-d8174bbf84f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8016e0bd2ca4561bcf60b8b6a542a9b'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:42.439198 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-bfe7e9ff-d971-4794-aa9e-d8174bbf84f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8016e0bd2ca4561bcf60b8b6a542a9b'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:42.440193 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-bfe7e9ff-d971-4794-aa9e-d8174bbf84f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8016e0bd2ca4561bcf60b8b6a542a9b'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:42.450249 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1212/2422] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:53:41 2022] DELETE /identity/v3/users/b8016e0bd2ca4561bcf60b8b6a542a9b => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:53:42.454837 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb994e3-58eb-4c3a-90a2-95b6e4cb3b01 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:42.455350 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb994e3-58eb-4c3a-90a2-95b6e4cb3b01 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:42.455447 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb994e3-58eb-4c3a-90a2-95b6e4cb3b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:42.487591 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-7eb994e3-58eb-4c3a-90a2-95b6e4cb3b01 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:53:42.489914 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-7eb994e3-58eb-4c3a-90a2-95b6e4cb3b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:42.575381 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1211/2423] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:53:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:53:42.583091 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe7e9ff-d971-4794-aa9e-d8174bbf84f7 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:42.584581 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-bfe7e9ff-d971-4794-aa9e-d8174bbf84f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:42.653345 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe7e9ff-d971-4794-aa9e-d8174bbf84f7 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:42.658382 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271fa1a3-7f56-48c6-b6b2-fe642c723c90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:42.659141 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fa1a3-7f56-48c6-b6b2-fe642c723c90 service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:42.659484 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fa1a3-7f56-48c6-b6b2-fe642c723c90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:42.659837 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fa1a3-7f56-48c6-b6b2-fe642c723c90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:42.671139 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271fa1a3-7f56-48c6-b6b2-fe642c723c90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:42.672771 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271fa1a3-7f56-48c6-b6b2-fe642c723c90 service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:42.683559 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1213/2424] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:53:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:53:43.198463 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb994e3-58eb-4c3a-90a2-95b6e4cb3b01 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:43.199935 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-7eb994e3-58eb-4c3a-90a2-95b6e4cb3b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:43.224254 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb994e3-58eb-4c3a-90a2-95b6e4cb3b01 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:43.240814 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75ebe4-5924-413c-88f1-f52b2cecb15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:43.240814 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75ebe4-5924-413c-88f1-f52b2cecb15a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:43.240814 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75ebe4-5924-413c-88f1-f52b2cecb15a admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:43.240814 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75ebe4-5924-413c-88f1-f52b2cecb15a admin admin] PATH_INFO: `/v3/projects/cbd8ae043285412d96d0442cca46bb87` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:43.242260 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b75ebe4-5924-413c-88f1-f52b2cecb15a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbd8ae043285412d96d0442cca46bb87)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:43.244258 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b75ebe4-5924-413c-88f1-f52b2cecb15a admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:43.357632 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-1b75ebe4-5924-413c-88f1-f52b2cecb15a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbd8ae043285412d96d0442cca46bb87', 'request_id': 'req-1b75ebe4-5924-413c-88f1-f52b2cecb15a'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:43.435617 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-1b75ebe4-5924-413c-88f1-f52b2cecb15a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbd8ae043285412d96d0442cca46bb87', 'request_id': 'req-1b75ebe4-5924-413c-88f1-f52b2cecb15a'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:43.445899 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-1b75ebe4-5924-413c-88f1-f52b2cecb15a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbd8ae043285412d96d0442cca46bb87', 'request_id': 'req-1b75ebe4-5924-413c-88f1-f52b2cecb15a'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:43.456059 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-1b75ebe4-5924-413c-88f1-f52b2cecb15a admin admin] The token cache is being invalidate because project cbd8ae043285412d96d0442cca46bb87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:53:43.456891 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-1b75ebe4-5924-413c-88f1-f52b2cecb15a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:43.457403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-1b75ebe4-5924-413c-88f1-f52b2cecb15a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:43.459047 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1212/2425] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:53:43 2022] DELETE /identity/v3/projects/cbd8ae043285412d96d0442cca46bb87 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:53:43.463253 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271fa1a3-7f56-48c6-b6b2-fe642c723c90 service neutron] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:43.473738 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271fa1a3-7f56-48c6-b6b2-fe642c723c90 service neutron] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:43.558085 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc96dab-b698-40b1-b571-60b6ca14c82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:43.558751 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc96dab-b698-40b1-b571-60b6ca14c82d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:43.559067 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc96dab-b698-40b1-b571-60b6ca14c82d admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:43.559366 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc96dab-b698-40b1-b571-60b6ca14c82d admin admin] PATH_INFO: `/v3/users/1c5c7e05674042a9958d5a968b3b0997` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:43.560556 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc96dab-b698-40b1-b571-60b6ca14c82d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c5c7e05674042a9958d5a968b3b0997)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:43.562526 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc96dab-b698-40b1-b571-60b6ca14c82d admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:43.877195 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:53:43.893504 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-8cc96dab-b698-40b1-b571-60b6ca14c82d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c5c7e05674042a9958d5a968b3b0997'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:43.984145 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-8cc96dab-b698-40b1-b571-60b6ca14c82d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c5c7e05674042a9958d5a968b3b0997'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:43.995810 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-8cc96dab-b698-40b1-b571-60b6ca14c82d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c5c7e05674042a9958d5a968b3b0997'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:44.011350 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-8cc96dab-b698-40b1-b571-60b6ca14c82d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c5c7e05674042a9958d5a968b3b0997'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:44.012311 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-8cc96dab-b698-40b1-b571-60b6ca14c82d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c5c7e05674042a9958d5a968b3b0997'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:44.020391 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1214/2426] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:53:43 2022] DELETE /identity/v3/users/1c5c7e05674042a9958d5a968b3b0997 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:53:44.487361 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75ebe4-5924-413c-88f1-f52b2cecb15a admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:44.490178 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-1b75ebe4-5924-413c-88f1-f52b2cecb15a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:44.514377 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75ebe4-5924-413c-88f1-f52b2cecb15a admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:44.590132 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b9ce82-d087-45e4-a9f7-0660a0d8ce60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:44.590791 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9ce82-d087-45e4-a9f7-0660a0d8ce60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:44.591113 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9ce82-d087-45e4-a9f7-0660a0d8ce60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:44.591416 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9ce82-d087-45e4-a9f7-0660a0d8ce60 admin admin] PATH_INFO: `/v3/projects/e5539818ec184a27a2126e458edf0423` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:44.592571 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b9ce82-d087-45e4-a9f7-0660a0d8ce60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5539818ec184a27a2126e458edf0423)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:44.594544 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b9ce82-d087-45e4-a9f7-0660a0d8ce60 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:44.616649 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:53:44.783881 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-b2b9ce82-d087-45e4-a9f7-0660a0d8ce60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5539818ec184a27a2126e458edf0423', 'request_id': 'req-b2b9ce82-d087-45e4-a9f7-0660a0d8ce60'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:44.868460 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-b2b9ce82-d087-45e4-a9f7-0660a0d8ce60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5539818ec184a27a2126e458edf0423', 'request_id': 'req-b2b9ce82-d087-45e4-a9f7-0660a0d8ce60'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:44.876221 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-b2b9ce82-d087-45e4-a9f7-0660a0d8ce60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5539818ec184a27a2126e458edf0423', 'request_id': 'req-b2b9ce82-d087-45e4-a9f7-0660a0d8ce60'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:44.887384 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-b2b9ce82-d087-45e4-a9f7-0660a0d8ce60 admin admin] The token cache is being invalidate because project e5539818ec184a27a2126e458edf0423 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:53:44.887674 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-b2b9ce82-d087-45e4-a9f7-0660a0d8ce60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:44.888363 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-b2b9ce82-d087-45e4-a9f7-0660a0d8ce60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:44.889886 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1213/2427] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:53:44 2022] DELETE /identity/v3/projects/e5539818ec184a27a2126e458edf0423 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:53:44.893976 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc96dab-b698-40b1-b571-60b6ca14c82d admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:44.896182 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-8cc96dab-b698-40b1-b571-60b6ca14c82d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:44.908630 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc96dab-b698-40b1-b571-60b6ca14c82d admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:44.970559 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19874aa9-0b76-488a-bfeb-4d4dd72d20d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:44.971271 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19874aa9-0b76-488a-bfeb-4d4dd72d20d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:44.971540 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19874aa9-0b76-488a-bfeb-4d4dd72d20d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:44.971846 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19874aa9-0b76-488a-bfeb-4d4dd72d20d7 admin admin] PATH_INFO: `/v3/users/9c1da59348b84f649d16b53bb4aee402` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:44.973781 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19874aa9-0b76-488a-bfeb-4d4dd72d20d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c1da59348b84f649d16b53bb4aee402)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:44.976191 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19874aa9-0b76-488a-bfeb-4d4dd72d20d7 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:45.155082 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-19874aa9-0b76-488a-bfeb-4d4dd72d20d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c1da59348b84f649d16b53bb4aee402'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:45.245081 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-19874aa9-0b76-488a-bfeb-4d4dd72d20d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c1da59348b84f649d16b53bb4aee402'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:45.252104 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-19874aa9-0b76-488a-bfeb-4d4dd72d20d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c1da59348b84f649d16b53bb4aee402'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:45.263923 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-19874aa9-0b76-488a-bfeb-4d4dd72d20d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c1da59348b84f649d16b53bb4aee402'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:45.264574 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-19874aa9-0b76-488a-bfeb-4d4dd72d20d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c1da59348b84f649d16b53bb4aee402'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:45.270597 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1215/2428] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:53:44 2022] DELETE /identity/v3/users/9c1da59348b84f649d16b53bb4aee402 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:53:45.347795 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b9ce82-d087-45e4-a9f7-0660a0d8ce60 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:45.349838 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-b2b9ce82-d087-45e4-a9f7-0660a0d8ce60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:45.363149 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b9ce82-d087-45e4-a9f7-0660a0d8ce60 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:45.423389 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f646c9-036b-4bb8-b9fd-2cf37adf0d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:45.423389 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f646c9-036b-4bb8-b9fd-2cf37adf0d89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:45.423389 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f646c9-036b-4bb8-b9fd-2cf37adf0d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:45.423389 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f646c9-036b-4bb8-b9fd-2cf37adf0d89 admin admin] PATH_INFO: `/v3/users/5b8e93caffff4ab984753b7ee8ee92e3` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:45.423830 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f646c9-036b-4bb8-b9fd-2cf37adf0d89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b8e93caffff4ab984753b7ee8ee92e3)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:45.425195 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f646c9-036b-4bb8-b9fd-2cf37adf0d89 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:45.613453 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-68f646c9-036b-4bb8-b9fd-2cf37adf0d89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b8e93caffff4ab984753b7ee8ee92e3'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:45.687040 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-68f646c9-036b-4bb8-b9fd-2cf37adf0d89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b8e93caffff4ab984753b7ee8ee92e3'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:45.695530 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-68f646c9-036b-4bb8-b9fd-2cf37adf0d89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b8e93caffff4ab984753b7ee8ee92e3'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:45.695932 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-68f646c9-036b-4bb8-b9fd-2cf37adf0d89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b8e93caffff4ab984753b7ee8ee92e3'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:45.711764 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-68f646c9-036b-4bb8-b9fd-2cf37adf0d89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b8e93caffff4ab984753b7ee8ee92e3'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:45.719837 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1214/2429] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:53:45 2022] DELETE /identity/v3/users/5b8e93caffff4ab984753b7ee8ee92e3 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:53:45.724899 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a8156-a3a6-47e6-8a3d-7ad09cf62ef4 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:45.725194 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a8156-a3a6-47e6-8a3d-7ad09cf62ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:45.725755 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a8156-a3a6-47e6-8a3d-7ad09cf62ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:45.747497 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-cc6a8156-a3a6-47e6-8a3d-7ad09cf62ef4 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:53:45.748723 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-cc6a8156-a3a6-47e6-8a3d-7ad09cf62ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:45.773596 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:53:45.809396 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1216/2430] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:53:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:53:45.824377 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f646c9-036b-4bb8-b9fd-2cf37adf0d89 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:45.827676 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-68f646c9-036b-4bb8-b9fd-2cf37adf0d89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:45.860005 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:53:45.891267 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f646c9-036b-4bb8-b9fd-2cf37adf0d89 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:45.897365 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edaec66-61a8-43f4-888f-b987de5d1e2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:45.898072 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edaec66-61a8-43f4-888f-b987de5d1e2e service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:45.898432 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edaec66-61a8-43f4-888f-b987de5d1e2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:45.898785 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edaec66-61a8-43f4-888f-b987de5d1e2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:45.910300 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edaec66-61a8-43f4-888f-b987de5d1e2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:45.911900 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edaec66-61a8-43f4-888f-b987de5d1e2e service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:45.922916 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1215/2431] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:53:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:53:46.207135 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a8156-a3a6-47e6-8a3d-7ad09cf62ef4 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:46.209380 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-cc6a8156-a3a6-47e6-8a3d-7ad09cf62ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:46.221644 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a8156-a3a6-47e6-8a3d-7ad09cf62ef4 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:46.226508 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07234e-653a-471d-a9d8-3d8a2a237a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:46.227179 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07234e-653a-471d-a9d8-3d8a2a237a64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:46.227467 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07234e-653a-471d-a9d8-3d8a2a237a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:46.227746 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07234e-653a-471d-a9d8-3d8a2a237a64 admin admin] PATH_INFO: `/v3/projects/7bb3f0c9290f48ea84c0fde981749620` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:46.232942 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f07234e-653a-471d-a9d8-3d8a2a237a64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bb3f0c9290f48ea84c0fde981749620)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:46.232942 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f07234e-653a-471d-a9d8-3d8a2a237a64 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:46.356271 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-9f07234e-653a-471d-a9d8-3d8a2a237a64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bb3f0c9290f48ea84c0fde981749620', 'request_id': 'req-9f07234e-653a-471d-a9d8-3d8a2a237a64'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:46.452852 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-9f07234e-653a-471d-a9d8-3d8a2a237a64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bb3f0c9290f48ea84c0fde981749620', 'request_id': 'req-9f07234e-653a-471d-a9d8-3d8a2a237a64'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:46.458861 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-9f07234e-653a-471d-a9d8-3d8a2a237a64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bb3f0c9290f48ea84c0fde981749620', 'request_id': 'req-9f07234e-653a-471d-a9d8-3d8a2a237a64'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:46.472787 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-9f07234e-653a-471d-a9d8-3d8a2a237a64 admin admin] The token cache is being invalidate because project 7bb3f0c9290f48ea84c0fde981749620 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:53:46.483306 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-9f07234e-653a-471d-a9d8-3d8a2a237a64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:46.483306 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-9f07234e-653a-471d-a9d8-3d8a2a237a64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:46.483306 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1217/2432] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:53:46 2022] DELETE /identity/v3/projects/7bb3f0c9290f48ea84c0fde981749620 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:53:46.487864 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf712f30-6534-48d2-8fbb-a53a8fa0baa8 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:46.488223 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf712f30-6534-48d2-8fbb-a53a8fa0baa8 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:46.488571 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf712f30-6534-48d2-8fbb-a53a8fa0baa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:46.511226 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-bf712f30-6534-48d2-8fbb-a53a8fa0baa8 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:53:46.512602 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-bf712f30-6534-48d2-8fbb-a53a8fa0baa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:46.581221 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1216/2433] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:53:46.589334 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad034060-47a7-40cc-9e11-07fe611a2cec None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:46.589625 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad034060-47a7-40cc-9e11-07fe611a2cec None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:46.589937 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad034060-47a7-40cc-9e11-07fe611a2cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:46.609831 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-ad034060-47a7-40cc-9e11-07fe611a2cec None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:53:46.611075 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-ad034060-47a7-40cc-9e11-07fe611a2cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:46.619488 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1218/2434] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:53:46.623779 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf712f30-6534-48d2-8fbb-a53a8fa0baa8 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:46.634304 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf712f30-6534-48d2-8fbb-a53a8fa0baa8 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:46.639119 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a925dae9-d6f4-4807-abb9-b357a21f0bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:46.639748 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925dae9-d6f4-4807-abb9-b357a21f0bfb admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:46.640025 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925dae9-d6f4-4807-abb9-b357a21f0bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:46.640294 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925dae9-d6f4-4807-abb9-b357a21f0bfb admin admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:46.640976 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a925dae9-d6f4-4807-abb9-b357a21f0bfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:53:46.641291 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a925dae9-d6f4-4807-abb9-b357a21f0bfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:46.642878 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a925dae9-d6f4-4807-abb9-b357a21f0bfb admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:46.654262 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1217/2435] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:53:46.658680 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad034060-47a7-40cc-9e11-07fe611a2cec None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:46.667041 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a925dae9-d6f4-4807-abb9-b357a21f0bfb admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:46.668881 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-a925dae9-d6f4-4807-abb9-b357a21f0bfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:46.669590 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad034060-47a7-40cc-9e11-07fe611a2cec None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:46.682509 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a925dae9-d6f4-4807-abb9-b357a21f0bfb admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:46.683858 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e0bc6-f88d-487f-9594-1fde4b578d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:46.683858 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e0bc6-f88d-487f-9594-1fde4b578d32 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:46.684220 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e0bc6-f88d-487f-9594-1fde4b578d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:46.684398 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e0bc6-f88d-487f-9594-1fde4b578d32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:46.685074 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e0bc6-f88d-487f-9594-1fde4b578d32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:46.687211 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e0bc6-f88d-487f-9594-1fde4b578d32 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:46.695075 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23469c-71d8-4bc3-a63e-043fdc795414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:46.695730 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23469c-71d8-4bc3-a63e-043fdc795414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:46.696012 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23469c-71d8-4bc3-a63e-043fdc795414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:46.696280 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23469c-71d8-4bc3-a63e-043fdc795414 admin admin] PATH_INFO: `/v3/projects/3c44baf0f5db4bedb5562a4afcf5a506` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:46.697449 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23469c-71d8-4bc3-a63e-043fdc795414 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c44baf0f5db4bedb5562a4afcf5a506)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:46.699430 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23469c-71d8-4bc3-a63e-043fdc795414 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:46.783823 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1219/2436] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:53:46 2022] POST /identity/v3/projects => generated 367 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:53:46.788292 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e0bc6-f88d-487f-9594-1fde4b578d32 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:46.822899 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-9f23469c-71d8-4bc3-a63e-043fdc795414 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c44baf0f5db4bedb5562a4afcf5a506', 'request_id': 'req-9f23469c-71d8-4bc3-a63e-043fdc795414'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:46.854466 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e0bc6-f88d-487f-9594-1fde4b578d32 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:46.884426 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:53:46.904099 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-9f23469c-71d8-4bc3-a63e-043fdc795414 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c44baf0f5db4bedb5562a4afcf5a506', 'request_id': 'req-9f23469c-71d8-4bc3-a63e-043fdc795414'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:46.910314 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-9f23469c-71d8-4bc3-a63e-043fdc795414 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c44baf0f5db4bedb5562a4afcf5a506', 'request_id': 'req-9f23469c-71d8-4bc3-a63e-043fdc795414'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:46.911911 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839cf2f6-379f-44d3-87b7-0603226e92e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:46.912538 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cf2f6-379f-44d3-87b7-0603226e92e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:46.912819 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cf2f6-379f-44d3-87b7-0603226e92e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:46.913099 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cf2f6-379f-44d3-87b7-0603226e92e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:46.913757 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839cf2f6-379f-44d3-87b7-0603226e92e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:46.915730 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839cf2f6-379f-44d3-87b7-0603226e92e1 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:46.922902 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-9f23469c-71d8-4bc3-a63e-043fdc795414 admin admin] The token cache is being invalidate because project 3c44baf0f5db4bedb5562a4afcf5a506 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:53:46.923246 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-9f23469c-71d8-4bc3-a63e-043fdc795414 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:46.924007 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-9f23469c-71d8-4bc3-a63e-043fdc795414 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:53:46.925837 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1218/2437] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:53:46 2022] DELETE /identity/v3/projects/3c44baf0f5db4bedb5562a4afcf5a506 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:53:47.020940 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1220/2438] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:53:46 2022] POST /identity/v3/users => generated 284 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:53:47.025771 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23469c-71d8-4bc3-a63e-043fdc795414 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:47.027384 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-9f23469c-71d8-4bc3-a63e-043fdc795414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:47.041951 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23469c-71d8-4bc3-a63e-043fdc795414 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:47.047140 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea108fb-8fe5-4c7b-a5e9-c3ecad431cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:47.047775 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea108fb-8fe5-4c7b-a5e9-c3ecad431cfd admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:47.048211 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea108fb-8fe5-4c7b-a5e9-c3ecad431cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:47.048494 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea108fb-8fe5-4c7b-a5e9-c3ecad431cfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:47.049196 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea108fb-8fe5-4c7b-a5e9-c3ecad431cfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:47.050832 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea108fb-8fe5-4c7b-a5e9-c3ecad431cfd admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:47.062867 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1219/2439] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:53:47.066842 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839cf2f6-379f-44d3-87b7-0603226e92e1 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:47.077928 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839cf2f6-379f-44d3-87b7-0603226e92e1 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:47.083592 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3439499-0152-40bb-a8cb-88a2785f0562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:47.084224 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3439499-0152-40bb-a8cb-88a2785f0562 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:47.084648 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3439499-0152-40bb-a8cb-88a2785f0562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:47.084928 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3439499-0152-40bb-a8cb-88a2785f0562 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:47.085752 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3439499-0152-40bb-a8cb-88a2785f0562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:47.087428 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3439499-0152-40bb-a8cb-88a2785f0562 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:47.099562 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1221/2440] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:53:47.104254 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea108fb-8fe5-4c7b-a5e9-c3ecad431cfd admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:47.114436 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea108fb-8fe5-4c7b-a5e9-c3ecad431cfd admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:47.118973 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a0ad9a-71c8-450e-9f79-ab4af5aeb2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:47.119641 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0ad9a-71c8-450e-9f79-ab4af5aeb2ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:47.119918 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0ad9a-71c8-450e-9f79-ab4af5aeb2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:47.120190 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0ad9a-71c8-450e-9f79-ab4af5aeb2ec admin admin] PATH_INFO: `/v3/projects/402565dbfbe44033ad8e50de9a996810/users/357906927b3043e88aab29925b262e8e/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:47.134594 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a0ad9a-71c8-450e-9f79-ab4af5aeb2ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=402565dbfbe44033ad8e50de9a996810, user_id=357906927b3043e88aab29925b262e8e, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:47.137311 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a0ad9a-71c8-450e-9f79-ab4af5aeb2ec admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:47.202300 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1220/2441] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:53:47 2022] PUT /identity/v3/projects/402565dbfbe44033ad8e50de9a996810/users/357906927b3043e88aab29925b262e8e/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:53:47.214279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a792e-e970-40f1-bd58-515b9081aeb6 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:47.214833 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a792e-e970-40f1-bd58-515b9081aeb6 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:47.214833 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a792e-e970-40f1-bd58-515b9081aeb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:47.243275 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-104a792e-e970-40f1-bd58-515b9081aeb6 None None] MFA Rules not processed for user `357906927b3043e88aab29925b262e8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:53:47.244524 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-104a792e-e970-40f1-bd58-515b9081aeb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:47.311312 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1222/2442] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:53:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:53:47.322626 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a0ad9a-71c8-450e-9f79-ab4af5aeb2ec admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:47.324341 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-d4a0ad9a-71c8-450e-9f79-ab4af5aeb2ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:47.330828 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:53:47.386943 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a0ad9a-71c8-450e-9f79-ab4af5aeb2ec admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:47.390652 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf03cb0-fd5c-401e-aec5-21aa1f3c69ca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '116f66d7dd7b42878f71bd29dc55729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:47.391291 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf03cb0-fd5c-401e-aec5-21aa1f3c69ca service glance] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:47.391585 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf03cb0-fd5c-401e-aec5-21aa1f3c69ca service glance] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:47.391854 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf03cb0-fd5c-401e-aec5-21aa1f3c69ca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:47.402852 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf03cb0-fd5c-401e-aec5-21aa1f3c69ca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:47.402852 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf03cb0-fd5c-401e-aec5-21aa1f3c69ca service glance] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:47.410860 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1221/2443] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:53:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:53:49.581393 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a792e-e970-40f1-bd58-515b9081aeb6 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:49.583691 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-104a792e-e970-40f1-bd58-515b9081aeb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:49.688939 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a792e-e970-40f1-bd58-515b9081aeb6 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:49.698805 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655570ba-9894-493b-a6f4-80cf012844a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:49.699469 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655570ba-9894-493b-a6f4-80cf012844a4 service nova] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:49.699755 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655570ba-9894-493b-a6f4-80cf012844a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:49.700038 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655570ba-9894-493b-a6f4-80cf012844a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:49.701815 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-655570ba-9894-493b-a6f4-80cf012844a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:49.716613 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655570ba-9894-493b-a6f4-80cf012844a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:49.718269 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655570ba-9894-493b-a6f4-80cf012844a4 service nova] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:49.729814 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1223/2444] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:53:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:53:50.396330 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf03cb0-fd5c-401e-aec5-21aa1f3c69ca service glance] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:50.397734 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-6cf03cb0-fd5c-401e-aec5-21aa1f3c69ca service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:50.414931 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf03cb0-fd5c-401e-aec5-21aa1f3c69ca service glance] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:50.420600 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3c406-d07b-47c1-a402-27fe9afb43c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:50.421219 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3c406-d07b-47c1-a402-27fe9afb43c4 service nova] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:50.421498 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3c406-d07b-47c1-a402-27fe9afb43c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:50.421771 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3c406-d07b-47c1-a402-27fe9afb43c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:50.423554 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-6ab3c406-d07b-47c1-a402-27fe9afb43c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:50.483621 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab3c406-d07b-47c1-a402-27fe9afb43c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:50.485195 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab3c406-d07b-47c1-a402-27fe9afb43c4 service nova] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:50.494516 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1222/2445] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:53:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:53:50.799515 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87282f5f-efe3-4afa-bc6d-c1ce442e6a83 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:50.800112 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87282f5f-efe3-4afa-bc6d-c1ce442e6a83 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:50.800112 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87282f5f-efe3-4afa-bc6d-c1ce442e6a83 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:50.801539 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1224/2446] 10.222.0.42 () {54 vars in 921 bytes} [Fri Aug 5 02:53:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:53:50.808265 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af027a9-3b88-4d99-8ab8-c36a2d18d0bf None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:50.808551 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af027a9-3b88-4d99-8ab8-c36a2d18d0bf None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:50.808830 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af027a9-3b88-4d99-8ab8-c36a2d18d0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:50.831015 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-8af027a9-3b88-4d99-8ab8-c36a2d18d0bf None None] MFA Rules not processed for user `55374d3bccd541c9a8f82da9b21c2fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:53:50.832317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-8af027a9-3b88-4d99-8ab8-c36a2d18d0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:50.846994 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1223/2447] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Aug 5 02:53:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:53:50.855821 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87282f5f-efe3-4afa-bc6d-c1ce442e6a83 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:50.871193 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87282f5f-efe3-4afa-bc6d-c1ce442e6a83 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:50.875054 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222096be-1eb0-4650-b4a8-a5a8f4b076cd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '116f66d7dd7b42878f71bd29dc55729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:50.875751 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222096be-1eb0-4650-b4a8-a5a8f4b076cd service glance] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:50.876124 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222096be-1eb0-4650-b4a8-a5a8f4b076cd service glance] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:50.876407 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222096be-1eb0-4650-b4a8-a5a8f4b076cd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:50.895187 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222096be-1eb0-4650-b4a8-a5a8f4b076cd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:50.896748 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222096be-1eb0-4650-b4a8-a5a8f4b076cd service glance] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:50.918379 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1225/2448] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:53:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:53:51.116441 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e306de-4cb8-4172-a468-9be31ffb2389 None None] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:51.116727 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e306de-4cb8-4172-a468-9be31ffb2389 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:51.117002 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e306de-4cb8-4172-a468-9be31ffb2389 None None] PATH_INFO: `/` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:51.118752 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1224/2449] 10.222.0.42 () {54 vars in 921 bytes} [Fri Aug 5 02:53:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:53:51.125801 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77a49d-136a-45f4-9c11-34dea14cbe51 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:51.126097 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77a49d-136a-45f4-9c11-34dea14cbe51 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:51.126430 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77a49d-136a-45f4-9c11-34dea14cbe51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:51.147226 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-1a77a49d-136a-45f4-9c11-34dea14cbe51 None None] MFA Rules not processed for user `a0035fcd8b06400bb7946f7ac37393a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:53:51.148468 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-1a77a49d-136a-45f4-9c11-34dea14cbe51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:51.154385 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:53:51.201769 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1226/2450] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Aug 5 02:53:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:53:51.214724 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e306de-4cb8-4172-a468-9be31ffb2389 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:51.216436 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-79e306de-4cb8-4172-a468-9be31ffb2389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:51.230571 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e306de-4cb8-4172-a468-9be31ffb2389 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:51.234170 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9ae75-ac58-4138-9609-83341d384390 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:51.235168 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9ae75-ac58-4138-9609-83341d384390 service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:51.235456 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9ae75-ac58-4138-9609-83341d384390 service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:51.235755 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9ae75-ac58-4138-9609-83341d384390 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:51.244813 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e9ae75-ac58-4138-9609-83341d384390 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:51.246345 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e9ae75-ac58-4138-9609-83341d384390 service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:51.254640 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1225/2451] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:53:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:53:51.339353 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2378a-cead-4968-95cd-904bddc55410 None None] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:51.339567 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2378a-cead-4968-95cd-904bddc55410 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:51.339854 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2378a-cead-4968-95cd-904bddc55410 None None] PATH_INFO: `/` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:51.341243 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1227/2452] 10.222.0.42 () {54 vars in 921 bytes} [Fri Aug 5 02:53:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:53:51.346906 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a93c58-44a7-4295-a27e-e139fa835efa None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:51.347287 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a93c58-44a7-4295-a27e-e139fa835efa None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:51.347571 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a93c58-44a7-4295-a27e-e139fa835efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:51.368404 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-77a93c58-44a7-4295-a27e-e139fa835efa None None] MFA Rules not processed for user `55374d3bccd541c9a8f82da9b21c2fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:53:51.369597 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-77a93c58-44a7-4295-a27e-e139fa835efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:51.380746 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1226/2453] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Aug 5 02:53:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:53:51.391422 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2378a-cead-4968-95cd-904bddc55410 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:51.393253 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-1ff2378a-cead-4968-95cd-904bddc55410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:51.408836 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2378a-cead-4968-95cd-904bddc55410 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:51.413881 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04458016-b1c8-4db5-830b-a3e9e26977e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:51.414659 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04458016-b1c8-4db5-830b-a3e9e26977e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:51.415111 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04458016-b1c8-4db5-830b-a3e9e26977e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:51.415457 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04458016-b1c8-4db5-830b-a3e9e26977e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:51.426481 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04458016-b1c8-4db5-830b-a3e9e26977e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:51.428743 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04458016-b1c8-4db5-830b-a3e9e26977e8 service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:51.443998 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1228/2454] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:53:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:53:51.509236 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a93c58-44a7-4295-a27e-e139fa835efa None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:51.509236 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-77a93c58-44a7-4295-a27e-e139fa835efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:51.573501 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a93c58-44a7-4295-a27e-e139fa835efa None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:51.580015 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c21958-0fe1-4759-b46d-1c634ee570c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647f2cb18a41d6a9e124e886faa994', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:51.580629 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c21958-0fe1-4759-b46d-1c634ee570c2 service placement] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:51.580908 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c21958-0fe1-4759-b46d-1c634ee570c2 service placement] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:51.581180 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c21958-0fe1-4759-b46d-1c634ee570c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:51.582938 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-01c21958-0fe1-4759-b46d-1c634ee570c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:51.595060 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c21958-0fe1-4759-b46d-1c634ee570c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:51.596689 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c21958-0fe1-4759-b46d-1c634ee570c2 service placement] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:51.608501 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1227/2455] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:53:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:53:54.116152 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb847e25-24e0-41cb-9da9-be97aff90926 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:54.121180 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb847e25-24e0-41cb-9da9-be97aff90926 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:54.121180 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb847e25-24e0-41cb-9da9-be97aff90926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:54.136031 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-fb847e25-24e0-41cb-9da9-be97aff90926 None None] MFA Rules not processed for user `6bea520676244effbbe212aa62b1cc68`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:53:54.137321 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-fb847e25-24e0-41cb-9da9-be97aff90926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:54.213378 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1229/2456] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Aug 5 02:53:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:53:54.225232 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c21958-0fe1-4759-b46d-1c634ee570c2 service placement] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:53:54.226973 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-01c21958-0fe1-4759-b46d-1c634ee570c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:53:54.237591 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:53:54.296771 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c21958-0fe1-4759-b46d-1c634ee570c2 service placement] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:53:54.301738 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeec4b3-c904-48a4-956c-9ae3013329cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40f706f1eb2b4137afd367cb5060ced0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:53:54.302357 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeec4b3-c904-48a4-956c-9ae3013329cc service swift] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:53:54.302639 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeec4b3-c904-48a4-956c-9ae3013329cc service swift] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:53:54.303474 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeec4b3-c904-48a4-956c-9ae3013329cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:53:54.311558 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeec4b3-c904-48a4-956c-9ae3013329cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:53:54.313141 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeec4b3-c904-48a4-956c-9ae3013329cc service swift] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:53:54.321647 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1228/2457] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 5 02:53:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 02:54:04.206610 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=49 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:54:04.317875 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=28 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:54:12.358061 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a758b5-6aea-4a48-94b6-db14ac25a6a7 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:12.358614 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a758b5-6aea-4a48-94b6-db14ac25a6a7 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:12.358706 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a758b5-6aea-4a48-94b6-db14ac25a6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:12.379737 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-c3a758b5-6aea-4a48-94b6-db14ac25a6a7 None None] MFA Rules not processed for user `6bea520676244effbbe212aa62b1cc68`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:54:12.381237 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-c3a758b5-6aea-4a48-94b6-db14ac25a6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:12.390356 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1230/2458] 10.222.0.42 () {58 vars in 967 bytes} [Fri Aug 5 02:54:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:54:12.406688 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeec4b3-c904-48a4-956c-9ae3013329cc service swift] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:12.413695 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeec4b3-c904-48a4-956c-9ae3013329cc service swift] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:12.419115 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30fe570-1e97-46a6-a98e-75fea3edc81c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40f706f1eb2b4137afd367cb5060ced0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:12.419745 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fe570-1e97-46a6-a98e-75fea3edc81c service swift] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:12.420028 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fe570-1e97-46a6-a98e-75fea3edc81c service swift] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:12.420303 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fe570-1e97-46a6-a98e-75fea3edc81c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:12.428490 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30fe570-1e97-46a6-a98e-75fea3edc81c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:12.430052 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30fe570-1e97-46a6-a98e-75fea3edc81c service swift] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:12.438431 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1229/2459] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 5 02:54:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 02:54:14.428534 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a758b5-6aea-4a48-94b6-db14ac25a6a7 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:14.444477 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a758b5-6aea-4a48-94b6-db14ac25a6a7 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:14.451079 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c44eac-c82b-4bc0-b394-6488914586e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:14.451980 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c44eac-c82b-4bc0-b394-6488914586e7 service nova] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:14.452407 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c44eac-c82b-4bc0-b394-6488914586e7 service nova] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:14.452888 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c44eac-c82b-4bc0-b394-6488914586e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:14.454893 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-13c44eac-c82b-4bc0-b394-6488914586e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:14.469239 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c44eac-c82b-4bc0-b394-6488914586e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:14.471311 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c44eac-c82b-4bc0-b394-6488914586e7 service nova] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:14.485666 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1231/2460] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:54:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:54:15.705246 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30fe570-1e97-46a6-a98e-75fea3edc81c service swift] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:15.770846 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30fe570-1e97-46a6-a98e-75fea3edc81c service swift] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:15.775461 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135ab94-60ad-4399-9806-2bde963d1ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:15.776119 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135ab94-60ad-4399-9806-2bde963d1ce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:15.776396 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135ab94-60ad-4399-9806-2bde963d1ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:15.776667 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135ab94-60ad-4399-9806-2bde963d1ce7 admin admin] PATH_INFO: `/v3/users/357906927b3043e88aab29925b262e8e` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:15.777837 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3135ab94-60ad-4399-9806-2bde963d1ce7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=357906927b3043e88aab29925b262e8e)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:15.779848 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3135ab94-60ad-4399-9806-2bde963d1ce7 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:15.994403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-3135ab94-60ad-4399-9806-2bde963d1ce7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '357906927b3043e88aab29925b262e8e'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:16.060237 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-3135ab94-60ad-4399-9806-2bde963d1ce7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '357906927b3043e88aab29925b262e8e'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:16.067719 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-3135ab94-60ad-4399-9806-2bde963d1ce7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '357906927b3043e88aab29925b262e8e'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:16.068383 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-3135ab94-60ad-4399-9806-2bde963d1ce7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '357906927b3043e88aab29925b262e8e'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:16.080537 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-3135ab94-60ad-4399-9806-2bde963d1ce7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '357906927b3043e88aab29925b262e8e'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:16.086628 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1230/2461] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:54:15 2022] DELETE /identity/v3/users/357906927b3043e88aab29925b262e8e => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:54:16.091848 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5e18b-f8ee-4736-9a31-b8d71c658aaf None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:16.092379 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5e18b-f8ee-4736-9a31-b8d71c658aaf None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:16.092489 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5e18b-f8ee-4736-9a31-b8d71c658aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:16.113941 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-8ea5e18b-f8ee-4736-9a31-b8d71c658aaf None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:54:16.115170 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-8ea5e18b-f8ee-4736-9a31-b8d71c658aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:16.175252 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1232/2462] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:54:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:54:16.188993 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135ab94-60ad-4399-9806-2bde963d1ce7 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:16.190420 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-3135ab94-60ad-4399-9806-2bde963d1ce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:16.248966 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135ab94-60ad-4399-9806-2bde963d1ce7 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:16.252640 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680f87b-f8eb-4ad2-87be-aa80499067b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:16.253321 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680f87b-f8eb-4ad2-87be-aa80499067b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:16.253610 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680f87b-f8eb-4ad2-87be-aa80499067b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:16.253891 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680f87b-f8eb-4ad2-87be-aa80499067b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:16.266522 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680f87b-f8eb-4ad2-87be-aa80499067b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:16.266522 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680f87b-f8eb-4ad2-87be-aa80499067b8 service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:16.275054 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1231/2463] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:54:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:54:16.755414 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5e18b-f8ee-4736-9a31-b8d71c658aaf None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:16.757046 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-8ea5e18b-f8ee-4736-9a31-b8d71c658aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:16.769450 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5e18b-f8ee-4736-9a31-b8d71c658aaf None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:16.773872 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8103d7c-bcc7-400e-8202-fbc818a1b14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:16.774522 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8103d7c-bcc7-400e-8202-fbc818a1b14c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:16.774789 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8103d7c-bcc7-400e-8202-fbc818a1b14c admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:16.775097 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8103d7c-bcc7-400e-8202-fbc818a1b14c admin admin] PATH_INFO: `/v3/projects/402565dbfbe44033ad8e50de9a996810` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:16.776284 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8103d7c-bcc7-400e-8202-fbc818a1b14c admin admin] RBAC: Authorizing `identity:delete_project(project_id=402565dbfbe44033ad8e50de9a996810)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:16.778146 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8103d7c-bcc7-400e-8202-fbc818a1b14c admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:16.953660 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-e8103d7c-bcc7-400e-8202-fbc818a1b14c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '402565dbfbe44033ad8e50de9a996810', 'request_id': 'req-e8103d7c-bcc7-400e-8202-fbc818a1b14c'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:17.044922 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-e8103d7c-bcc7-400e-8202-fbc818a1b14c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '402565dbfbe44033ad8e50de9a996810', 'request_id': 'req-e8103d7c-bcc7-400e-8202-fbc818a1b14c'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:17.053050 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-e8103d7c-bcc7-400e-8202-fbc818a1b14c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '402565dbfbe44033ad8e50de9a996810', 'request_id': 'req-e8103d7c-bcc7-400e-8202-fbc818a1b14c'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:17.070558 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-e8103d7c-bcc7-400e-8202-fbc818a1b14c admin admin] The token cache is being invalidate because project 402565dbfbe44033ad8e50de9a996810 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:54:17.070877 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-e8103d7c-bcc7-400e-8202-fbc818a1b14c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:17.071619 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-e8103d7c-bcc7-400e-8202-fbc818a1b14c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:17.073160 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1233/2464] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:54:16 2022] DELETE /identity/v3/projects/402565dbfbe44033ad8e50de9a996810 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:54:17.082197 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84f956-5fc2-4644-accd-a6bf5cef0799 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:17.082197 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84f956-5fc2-4644-accd-a6bf5cef0799 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:17.082197 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84f956-5fc2-4644-accd-a6bf5cef0799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:17.098701 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-1c84f956-5fc2-4644-accd-a6bf5cef0799 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:54:17.099940 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-1c84f956-5fc2-4644-accd-a6bf5cef0799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:17.104713 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:54:17.161140 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1232/2465] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:54:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:54:17.169562 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fa272-7e99-4779-b806-f6a8b5804e46 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:17.170039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fa272-7e99-4779-b806-f6a8b5804e46 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:17.170138 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fa272-7e99-4779-b806-f6a8b5804e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:17.191611 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-643fa272-7e99-4779-b806-f6a8b5804e46 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:54:17.192822 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-643fa272-7e99-4779-b806-f6a8b5804e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:17.201005 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1234/2466] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:54:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:54:17.205324 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84f956-5fc2-4644-accd-a6bf5cef0799 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:17.216469 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84f956-5fc2-4644-accd-a6bf5cef0799 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:17.219917 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2449eb6-7a72-4ca0-94c4-6d426be3a92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:17.220578 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2449eb6-7a72-4ca0-94c4-6d426be3a92a admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:17.220848 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2449eb6-7a72-4ca0-94c4-6d426be3a92a admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:17.221123 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2449eb6-7a72-4ca0-94c4-6d426be3a92a admin admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:17.221815 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2449eb6-7a72-4ca0-94c4-6d426be3a92a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:54:17.222118 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2449eb6-7a72-4ca0-94c4-6d426be3a92a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:17.223760 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2449eb6-7a72-4ca0-94c4-6d426be3a92a admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:17.236960 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1233/2467] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:54:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:54:17.241364 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643fa272-7e99-4779-b806-f6a8b5804e46 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:17.251873 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643fa272-7e99-4779-b806-f6a8b5804e46 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:17.259084 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709f11a-3bfe-4ceb-a39c-041c7e12c253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:17.259957 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709f11a-3bfe-4ceb-a39c-041c7e12c253 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:17.260211 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709f11a-3bfe-4ceb-a39c-041c7e12c253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:17.260490 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709f11a-3bfe-4ceb-a39c-041c7e12c253 admin admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:17.261466 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9709f11a-3bfe-4ceb-a39c-041c7e12c253 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:17.263245 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9709f11a-3bfe-4ceb-a39c-041c7e12c253 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:17.351564 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1235/2468] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:54:17 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:54:17.356441 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2449eb6-7a72-4ca0-94c4-6d426be3a92a admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:17.367860 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2449eb6-7a72-4ca0-94c4-6d426be3a92a admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:17.426477 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b8fbe-4832-40a2-8755-0cb17453dd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:17.427316 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b8fbe-4832-40a2-8755-0cb17453dd3b admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:17.427603 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b8fbe-4832-40a2-8755-0cb17453dd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:17.427883 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b8fbe-4832-40a2-8755-0cb17453dd3b admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:17.428843 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193b8fbe-4832-40a2-8755-0cb17453dd3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:17.430940 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193b8fbe-4832-40a2-8755-0cb17453dd3b admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:17.532165 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1234/2469] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:54:17 2022] POST /identity/v3/users => generated 291 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:54:17.535434 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709f11a-3bfe-4ceb-a39c-041c7e12c253 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:17.546372 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709f11a-3bfe-4ceb-a39c-041c7e12c253 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:17.550976 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347a60c-078c-4cc8-8294-ef08c80649da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:17.551609 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347a60c-078c-4cc8-8294-ef08c80649da admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:17.551889 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347a60c-078c-4cc8-8294-ef08c80649da admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:17.552166 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347a60c-078c-4cc8-8294-ef08c80649da admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:17.552851 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347a60c-078c-4cc8-8294-ef08c80649da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:17.554445 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347a60c-078c-4cc8-8294-ef08c80649da admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:17.565087 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1236/2470] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:54:17.569118 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b8fbe-4832-40a2-8755-0cb17453dd3b admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:17.579496 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b8fbe-4832-40a2-8755-0cb17453dd3b admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:17.584201 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40150fd6-f365-4bbc-85a2-cb6a954de9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:17.584826 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40150fd6-f365-4bbc-85a2-cb6a954de9af admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:17.585117 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40150fd6-f365-4bbc-85a2-cb6a954de9af admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:17.585393 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40150fd6-f365-4bbc-85a2-cb6a954de9af admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:17.586088 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40150fd6-f365-4bbc-85a2-cb6a954de9af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:17.587787 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40150fd6-f365-4bbc-85a2-cb6a954de9af admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:17.603650 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1235/2471] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:54:17.608614 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347a60c-078c-4cc8-8294-ef08c80649da admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:17.618555 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347a60c-078c-4cc8-8294-ef08c80649da admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:17.623248 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd52fb-26f5-42bf-8fd9-0ad10e30527c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:17.623910 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd52fb-26f5-42bf-8fd9-0ad10e30527c admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:17.624193 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd52fb-26f5-42bf-8fd9-0ad10e30527c admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:17.624479 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd52fb-26f5-42bf-8fd9-0ad10e30527c admin admin] PATH_INFO: `/v3/projects/6d6344ad91c1497cb3d26fbce7c1c9f4/users/0adef2d09f6142e194d18b3581697032/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:17.639259 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebd52fb-26f5-42bf-8fd9-0ad10e30527c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d6344ad91c1497cb3d26fbce7c1c9f4, user_id=0adef2d09f6142e194d18b3581697032, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:17.641969 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebd52fb-26f5-42bf-8fd9-0ad10e30527c admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:17.738311 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:54:17.745175 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1237/2472] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:54:17 2022] PUT /identity/v3/projects/6d6344ad91c1497cb3d26fbce7c1c9f4/users/0adef2d09f6142e194d18b3581697032/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:54:17.756526 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b127b-e0db-49f9-adac-14237e489f19 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:17.756881 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b127b-e0db-49f9-adac-14237e489f19 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:17.757073 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b127b-e0db-49f9-adac-14237e489f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:17.786151 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-925b127b-e0db-49f9-adac-14237e489f19 None None] MFA Rules not processed for user `0adef2d09f6142e194d18b3581697032`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:54:17.787310 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-925b127b-e0db-49f9-adac-14237e489f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:17.854575 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1236/2473] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:54:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:54:17.866292 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd52fb-26f5-42bf-8fd9-0ad10e30527c admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:17.868137 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-cebd52fb-26f5-42bf-8fd9-0ad10e30527c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:17.925217 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd52fb-26f5-42bf-8fd9-0ad10e30527c admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:17.929014 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633b34b-1457-4821-98cc-445bbd8ef109 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:17.929846 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633b34b-1457-4821-98cc-445bbd8ef109 service cinder] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:17.930293 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633b34b-1457-4821-98cc-445bbd8ef109 service cinder] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:17.930945 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633b34b-1457-4821-98cc-445bbd8ef109 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:17.939861 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2633b34b-1457-4821-98cc-445bbd8ef109 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:17.941305 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2633b34b-1457-4821-98cc-445bbd8ef109 service cinder] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:17.951446 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1238/2474] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:54:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:54:21.201014 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b127b-e0db-49f9-adac-14237e489f19 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:21.206474 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:54:21.264697 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b127b-e0db-49f9-adac-14237e489f19 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:21.272967 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd06360-9b0a-4d75-bdb0-e938b709a45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:21.274049 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd06360-9b0a-4d75-bdb0-e938b709a45c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:21.274049 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd06360-9b0a-4d75-bdb0-e938b709a45c admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:21.274272 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd06360-9b0a-4d75-bdb0-e938b709a45c admin admin] PATH_INFO: `/v3/users/0adef2d09f6142e194d18b3581697032` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:21.275975 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd06360-9b0a-4d75-bdb0-e938b709a45c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0adef2d09f6142e194d18b3581697032)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:21.278386 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd06360-9b0a-4d75-bdb0-e938b709a45c admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:21.498321 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-9bd06360-9b0a-4d75-bdb0-e938b709a45c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0adef2d09f6142e194d18b3581697032'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:21.582111 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-9bd06360-9b0a-4d75-bdb0-e938b709a45c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0adef2d09f6142e194d18b3581697032'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:21.590361 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-9bd06360-9b0a-4d75-bdb0-e938b709a45c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0adef2d09f6142e194d18b3581697032'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:21.591058 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-9bd06360-9b0a-4d75-bdb0-e938b709a45c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0adef2d09f6142e194d18b3581697032'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:21.611556 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-9bd06360-9b0a-4d75-bdb0-e938b709a45c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0adef2d09f6142e194d18b3581697032'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:21.617607 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1237/2475] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:54:21 2022] DELETE /identity/v3/users/0adef2d09f6142e194d18b3581697032 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:54:21.622234 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e13cb-f0fb-471c-8287-54001d577d60 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:21.622748 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e13cb-f0fb-471c-8287-54001d577d60 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:21.622846 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e13cb-f0fb-471c-8287-54001d577d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:21.644760 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-8b4e13cb-f0fb-471c-8287-54001d577d60 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:54:21.646002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-8b4e13cb-f0fb-471c-8287-54001d577d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:21.733090 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1239/2476] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:54:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:54:21.742485 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd06360-9b0a-4d75-bdb0-e938b709a45c admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:21.742485 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-9bd06360-9b0a-4d75-bdb0-e938b709a45c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:21.749261 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e13cb-f0fb-471c-8287-54001d577d60 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:21.750668 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-8b4e13cb-f0fb-471c-8287-54001d577d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:21.802497 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd06360-9b0a-4d75-bdb0-e938b709a45c admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:21.806321 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0235c0a-253f-4ef8-930d-23652412231b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:21.807088 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0235c0a-253f-4ef8-930d-23652412231b service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:21.807478 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0235c0a-253f-4ef8-930d-23652412231b service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:21.807860 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0235c0a-253f-4ef8-930d-23652412231b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:21.812325 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e13cb-f0fb-471c-8287-54001d577d60 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:21.817527 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30d3ce-9b8e-44bb-b31d-2a2118ff4e00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:21.818190 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30d3ce-9b8e-44bb-b31d-2a2118ff4e00 service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:21.818472 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30d3ce-9b8e-44bb-b31d-2a2118ff4e00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:21.818749 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30d3ce-9b8e-44bb-b31d-2a2118ff4e00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:21.820578 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-ba30d3ce-9b8e-44bb-b31d-2a2118ff4e00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:21.823079 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0235c0a-253f-4ef8-930d-23652412231b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:21.825311 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0235c0a-253f-4ef8-930d-23652412231b service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:21.833635 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba30d3ce-9b8e-44bb-b31d-2a2118ff4e00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:21.835230 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba30d3ce-9b8e-44bb-b31d-2a2118ff4e00 service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:21.835380 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1238/2477] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:54:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:54:21.846497 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1240/2478] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:54:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:54:22.464225 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0235c0a-253f-4ef8-930d-23652412231b service neutron] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:22.465817 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-b0235c0a-253f-4ef8-930d-23652412231b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:22.482181 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0235c0a-253f-4ef8-930d-23652412231b service neutron] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:22.489344 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce51332-3997-472e-8ea1-1405d3bba3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:22.489989 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce51332-3997-472e-8ea1-1405d3bba3a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:22.490269 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce51332-3997-472e-8ea1-1405d3bba3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:22.490544 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce51332-3997-472e-8ea1-1405d3bba3a7 admin admin] PATH_INFO: `/v3/projects/6d6344ad91c1497cb3d26fbce7c1c9f4` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:22.491831 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce51332-3997-472e-8ea1-1405d3bba3a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d6344ad91c1497cb3d26fbce7c1c9f4)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:22.493683 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce51332-3997-472e-8ea1-1405d3bba3a7 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:22.518723 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:54:22.618010 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-3ce51332-3997-472e-8ea1-1405d3bba3a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d6344ad91c1497cb3d26fbce7c1c9f4', 'request_id': 'req-3ce51332-3997-472e-8ea1-1405d3bba3a7'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:22.672250 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-3ce51332-3997-472e-8ea1-1405d3bba3a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d6344ad91c1497cb3d26fbce7c1c9f4', 'request_id': 'req-3ce51332-3997-472e-8ea1-1405d3bba3a7'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:22.678114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-3ce51332-3997-472e-8ea1-1405d3bba3a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d6344ad91c1497cb3d26fbce7c1c9f4', 'request_id': 'req-3ce51332-3997-472e-8ea1-1405d3bba3a7'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:22.689136 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-3ce51332-3997-472e-8ea1-1405d3bba3a7 admin admin] The token cache is being invalidate because project 6d6344ad91c1497cb3d26fbce7c1c9f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:54:22.689424 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-3ce51332-3997-472e-8ea1-1405d3bba3a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:22.690069 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-3ce51332-3997-472e-8ea1-1405d3bba3a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:22.691609 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1239/2479] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:54:22 2022] DELETE /identity/v3/projects/6d6344ad91c1497cb3d26fbce7c1c9f4 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:54:25.188697 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30d3ce-9b8e-44bb-b31d-2a2118ff4e00 service neutron] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:25.190096 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-ba30d3ce-9b8e-44bb-b31d-2a2118ff4e00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:25.239075 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:54:25.258974 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30d3ce-9b8e-44bb-b31d-2a2118ff4e00 service neutron] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:25.311245 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce51332-3997-472e-8ea1-1405d3bba3a7 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:25.314460 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-3ce51332-3997-472e-8ea1-1405d3bba3a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:25.327103 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc275ca6-480a-42b4-b95c-e56d04b8769b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647f2cb18a41d6a9e124e886faa994', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:25.327733 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc275ca6-480a-42b4-b95c-e56d04b8769b service placement] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:25.330921 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc275ca6-480a-42b4-b95c-e56d04b8769b service placement] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:25.330921 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc275ca6-480a-42b4-b95c-e56d04b8769b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:25.330921 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-fc275ca6-480a-42b4-b95c-e56d04b8769b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:25.342282 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc275ca6-480a-42b4-b95c-e56d04b8769b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:25.343953 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc275ca6-480a-42b4-b95c-e56d04b8769b service placement] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:25.354450 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1241/2480] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:54:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:54:25.384360 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce51332-3997-472e-8ea1-1405d3bba3a7 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:25.389637 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209a009-76bb-435a-b153-5632ea9a5d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:25.390276 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209a009-76bb-435a-b153-5632ea9a5d38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:25.390557 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209a009-76bb-435a-b153-5632ea9a5d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:25.390833 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209a009-76bb-435a-b153-5632ea9a5d38 admin admin] PATH_INFO: `/v3/users/4033953c81e5494ea03a7031df9ddcc1` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:25.392107 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d209a009-76bb-435a-b153-5632ea9a5d38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4033953c81e5494ea03a7031df9ddcc1)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:25.394045 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d209a009-76bb-435a-b153-5632ea9a5d38 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:25.574528 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-d209a009-76bb-435a-b153-5632ea9a5d38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4033953c81e5494ea03a7031df9ddcc1'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:25.633734 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-d209a009-76bb-435a-b153-5632ea9a5d38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4033953c81e5494ea03a7031df9ddcc1'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:25.633886 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc275ca6-480a-42b4-b95c-e56d04b8769b service placement] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:25.635327 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-fc275ca6-480a-42b4-b95c-e56d04b8769b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:25.641553 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-d209a009-76bb-435a-b153-5632ea9a5d38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4033953c81e5494ea03a7031df9ddcc1'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:25.643639 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-d209a009-76bb-435a-b153-5632ea9a5d38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4033953c81e5494ea03a7031df9ddcc1'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:25.655337 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-d209a009-76bb-435a-b153-5632ea9a5d38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4033953c81e5494ea03a7031df9ddcc1'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:25.662604 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1240/2481] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:54:25 2022] DELETE /identity/v3/users/4033953c81e5494ea03a7031df9ddcc1 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:54:25.697009 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc275ca6-480a-42b4-b95c-e56d04b8769b service placement] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:25.754868 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271de53-8700-4bba-9ab2-0efedd9e1c8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:25.755538 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271de53-8700-4bba-9ab2-0efedd9e1c8f service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:25.756011 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271de53-8700-4bba-9ab2-0efedd9e1c8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:25.756296 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271de53-8700-4bba-9ab2-0efedd9e1c8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:25.758132 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-b271de53-8700-4bba-9ab2-0efedd9e1c8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:25.808134 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:54:25.825104 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b271de53-8700-4bba-9ab2-0efedd9e1c8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:25.827128 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b271de53-8700-4bba-9ab2-0efedd9e1c8f service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:25.837168 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1242/2482] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:54:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:54:26.236354 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209a009-76bb-435a-b153-5632ea9a5d38 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:26.237848 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-d209a009-76bb-435a-b153-5632ea9a5d38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:26.251648 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209a009-76bb-435a-b153-5632ea9a5d38 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:26.256781 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2afaa-d506-4971-bb97-d56f642baa98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:26.257437 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2afaa-d506-4971-bb97-d56f642baa98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:26.257722 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2afaa-d506-4971-bb97-d56f642baa98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:26.258001 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2afaa-d506-4971-bb97-d56f642baa98 admin admin] PATH_INFO: `/v3/projects/16788fd11e7f4259ae2219d0fa1bc01e` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:26.259501 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2afaa-d506-4971-bb97-d56f642baa98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16788fd11e7f4259ae2219d0fa1bc01e)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:26.261933 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2afaa-d506-4971-bb97-d56f642baa98 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:26.297211 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:54:26.398806 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-6aa2afaa-d506-4971-bb97-d56f642baa98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16788fd11e7f4259ae2219d0fa1bc01e', 'request_id': 'req-6aa2afaa-d506-4971-bb97-d56f642baa98'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:26.513569 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-6aa2afaa-d506-4971-bb97-d56f642baa98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16788fd11e7f4259ae2219d0fa1bc01e', 'request_id': 'req-6aa2afaa-d506-4971-bb97-d56f642baa98'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:26.519593 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-6aa2afaa-d506-4971-bb97-d56f642baa98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16788fd11e7f4259ae2219d0fa1bc01e', 'request_id': 'req-6aa2afaa-d506-4971-bb97-d56f642baa98'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:26.531334 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-6aa2afaa-d506-4971-bb97-d56f642baa98 admin admin] The token cache is being invalidate because project 16788fd11e7f4259ae2219d0fa1bc01e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:54:26.531648 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-6aa2afaa-d506-4971-bb97-d56f642baa98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:26.532443 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-6aa2afaa-d506-4971-bb97-d56f642baa98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:26.534086 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1241/2483] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:54:26 2022] DELETE /identity/v3/projects/16788fd11e7f4259ae2219d0fa1bc01e => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:54:26.539139 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36351ccb-fc56-4281-977f-254b5725798f None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:26.539634 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36351ccb-fc56-4281-977f-254b5725798f None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:26.539840 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36351ccb-fc56-4281-977f-254b5725798f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:26.562237 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-36351ccb-fc56-4281-977f-254b5725798f None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:54:26.563491 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-36351ccb-fc56-4281-977f-254b5725798f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:26.624687 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1243/2484] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:54:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:54:26.633448 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7715b-b782-446a-92ea-e9670a7d833d None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:26.633742 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7715b-b782-446a-92ea-e9670a7d833d None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:26.634026 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7715b-b782-446a-92ea-e9670a7d833d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:26.654960 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-7df7715b-b782-446a-92ea-e9670a7d833d None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:54:26.656202 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-7df7715b-b782-446a-92ea-e9670a7d833d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:26.664114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1242/2485] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:54:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:54:26.668345 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36351ccb-fc56-4281-977f-254b5725798f None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:26.677842 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36351ccb-fc56-4281-977f-254b5725798f None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:26.682304 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8184433-3426-454d-87f0-6515930df7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:26.682919 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8184433-3426-454d-87f0-6515930df7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:26.683225 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8184433-3426-454d-87f0-6515930df7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:26.684002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8184433-3426-454d-87f0-6515930df7f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:26.684692 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8184433-3426-454d-87f0-6515930df7f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:54:26.684992 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8184433-3426-454d-87f0-6515930df7f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:26.686588 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8184433-3426-454d-87f0-6515930df7f4 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:26.698094 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1244/2486] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:54:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:54:26.702916 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7715b-b782-446a-92ea-e9670a7d833d None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:26.712250 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7715b-b782-446a-92ea-e9670a7d833d None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:26.718138 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c72a7-8d8a-4cc7-b494-369348dc802b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:26.719197 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c72a7-8d8a-4cc7-b494-369348dc802b admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:26.719691 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c72a7-8d8a-4cc7-b494-369348dc802b admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:26.720193 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c72a7-8d8a-4cc7-b494-369348dc802b admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:26.721091 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c72a7-8d8a-4cc7-b494-369348dc802b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:26.723338 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c72a7-8d8a-4cc7-b494-369348dc802b admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:26.798037 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1243/2487] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:54:26 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:54:26.802152 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8184433-3426-454d-87f0-6515930df7f4 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:26.812740 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8184433-3426-454d-87f0-6515930df7f4 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:26.870410 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb782c-dab3-41a3-8245-1d13b4824f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:26.871593 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb782c-dab3-41a3-8245-1d13b4824f0f admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:26.871872 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb782c-dab3-41a3-8245-1d13b4824f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:26.872214 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb782c-dab3-41a3-8245-1d13b4824f0f admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:26.872952 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb782c-dab3-41a3-8245-1d13b4824f0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:26.874926 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb782c-dab3-41a3-8245-1d13b4824f0f admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:26.951089 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1245/2488] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:54:26 2022] POST /identity/v3/users => generated 287 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:54:26.952468 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c72a7-8d8a-4cc7-b494-369348dc802b admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:26.967147 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c72a7-8d8a-4cc7-b494-369348dc802b admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:26.973777 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d3a32-3d0a-4710-97fb-af18c92e1e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:26.974413 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d3a32-3d0a-4710-97fb-af18c92e1e8d admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:26.974696 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d3a32-3d0a-4710-97fb-af18c92e1e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:26.975025 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d3a32-3d0a-4710-97fb-af18c92e1e8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:26.978122 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d3a32-3d0a-4710-97fb-af18c92e1e8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:26.979812 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d3a32-3d0a-4710-97fb-af18c92e1e8d admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:26.995093 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1244/2489] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:54:26.997424 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb782c-dab3-41a3-8245-1d13b4824f0f admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:27.009116 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb782c-dab3-41a3-8245-1d13b4824f0f admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:27.014081 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c5ea35-b384-4b63-8ddf-a3030354e919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:27.015150 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5ea35-b384-4b63-8ddf-a3030354e919 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:27.015433 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5ea35-b384-4b63-8ddf-a3030354e919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:27.015734 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5ea35-b384-4b63-8ddf-a3030354e919 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:27.016590 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c5ea35-b384-4b63-8ddf-a3030354e919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:27.018472 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c5ea35-b384-4b63-8ddf-a3030354e919 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:27.036567 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1246/2490] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:54:27.038030 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d3a32-3d0a-4710-97fb-af18c92e1e8d admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:27.051856 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d3a32-3d0a-4710-97fb-af18c92e1e8d admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:27.057007 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984682c-9a32-4539-8805-32399e9fd2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:27.057726 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984682c-9a32-4539-8805-32399e9fd2e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:27.057968 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984682c-9a32-4539-8805-32399e9fd2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:27.058243 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984682c-9a32-4539-8805-32399e9fd2e9 admin admin] PATH_INFO: `/v3/projects/c46eaf8f0c0943029f57ba0399ebf9c2/users/68ef0dcbd66b4e808943b1b93a095870/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:27.077179 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6984682c-9a32-4539-8805-32399e9fd2e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c46eaf8f0c0943029f57ba0399ebf9c2, user_id=68ef0dcbd66b4e808943b1b93a095870, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:27.080419 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6984682c-9a32-4539-8805-32399e9fd2e9 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:27.160672 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1245/2491] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:54:27 2022] PUT /identity/v3/projects/c46eaf8f0c0943029f57ba0399ebf9c2/users/68ef0dcbd66b4e808943b1b93a095870/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:54:27.171788 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a26dd-59db-4c89-8d60-a15812af1cd1 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:27.172274 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a26dd-59db-4c89-8d60-a15812af1cd1 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:27.172561 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a26dd-59db-4c89-8d60-a15812af1cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:27.200132 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-f96a26dd-59db-4c89-8d60-a15812af1cd1 None None] MFA Rules not processed for user `68ef0dcbd66b4e808943b1b93a095870`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:54:27.201368 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-f96a26dd-59db-4c89-8d60-a15812af1cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:27.243892 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:54:27.267496 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1247/2492] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:54:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:54:27.279292 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984682c-9a32-4539-8805-32399e9fd2e9 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:27.281077 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-6984682c-9a32-4539-8805-32399e9fd2e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:27.357240 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984682c-9a32-4539-8805-32399e9fd2e9 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:27.362886 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15427923-bd6f-452b-9eeb-f91cd18a1ebd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:27.363540 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15427923-bd6f-452b-9eeb-f91cd18a1ebd service nova] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:27.363820 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15427923-bd6f-452b-9eeb-f91cd18a1ebd service nova] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:27.364093 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15427923-bd6f-452b-9eeb-f91cd18a1ebd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:27.372068 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15427923-bd6f-452b-9eeb-f91cd18a1ebd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:27.373651 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15427923-bd6f-452b-9eeb-f91cd18a1ebd service nova] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:27.382628 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1246/2493] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:54:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:54:29.487197 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a26dd-59db-4c89-8d60-a15812af1cd1 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:29.487197 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-f96a26dd-59db-4c89-8d60-a15812af1cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:29.584646 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a26dd-59db-4c89-8d60-a15812af1cd1 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:29.585354 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f63c3ff-f1ec-4a33-83dc-c9024fad6c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:29.586075 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63c3ff-f1ec-4a33-83dc-c9024fad6c3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:29.586362 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63c3ff-f1ec-4a33-83dc-c9024fad6c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:29.586642 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63c3ff-f1ec-4a33-83dc-c9024fad6c3b admin admin] PATH_INFO: `/v3/users/526cd8eb496f4389a52dd557306dd314` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:29.587890 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f63c3ff-f1ec-4a33-83dc-c9024fad6c3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=526cd8eb496f4389a52dd557306dd314)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:29.589883 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f63c3ff-f1ec-4a33-83dc-c9024fad6c3b admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:29.773175 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-4f63c3ff-f1ec-4a33-83dc-c9024fad6c3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '526cd8eb496f4389a52dd557306dd314'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:29.857571 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-4f63c3ff-f1ec-4a33-83dc-c9024fad6c3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '526cd8eb496f4389a52dd557306dd314'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:29.866734 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-4f63c3ff-f1ec-4a33-83dc-c9024fad6c3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '526cd8eb496f4389a52dd557306dd314'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:29.880169 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-4f63c3ff-f1ec-4a33-83dc-c9024fad6c3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '526cd8eb496f4389a52dd557306dd314'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:29.880877 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-4f63c3ff-f1ec-4a33-83dc-c9024fad6c3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '526cd8eb496f4389a52dd557306dd314'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:29.886722 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1248/2494] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:54:29 2022] DELETE /identity/v3/users/526cd8eb496f4389a52dd557306dd314 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:54:30.104144 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15427923-bd6f-452b-9eeb-f91cd18a1ebd service nova] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:30.116773 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15427923-bd6f-452b-9eeb-f91cd18a1ebd service nova] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:30.147317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:54:30.173678 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e1d3f9-8e1d-489b-98f6-84bf7dc890b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:30.174339 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1d3f9-8e1d-489b-98f6-84bf7dc890b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:30.174617 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1d3f9-8e1d-489b-98f6-84bf7dc890b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:30.174888 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1d3f9-8e1d-489b-98f6-84bf7dc890b9 admin admin] PATH_INFO: `/v3/projects/ff2eb7aa621e45c79fafe9e61516ff08` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:30.176088 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e1d3f9-8e1d-489b-98f6-84bf7dc890b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff2eb7aa621e45c79fafe9e61516ff08)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:30.178001 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e1d3f9-8e1d-489b-98f6-84bf7dc890b9 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:30.302744 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-f8e1d3f9-8e1d-489b-98f6-84bf7dc890b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff2eb7aa621e45c79fafe9e61516ff08', 'request_id': 'req-f8e1d3f9-8e1d-489b-98f6-84bf7dc890b9'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:30.376774 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-f8e1d3f9-8e1d-489b-98f6-84bf7dc890b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff2eb7aa621e45c79fafe9e61516ff08', 'request_id': 'req-f8e1d3f9-8e1d-489b-98f6-84bf7dc890b9'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:30.382551 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-f8e1d3f9-8e1d-489b-98f6-84bf7dc890b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff2eb7aa621e45c79fafe9e61516ff08', 'request_id': 'req-f8e1d3f9-8e1d-489b-98f6-84bf7dc890b9'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:30.394534 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-f8e1d3f9-8e1d-489b-98f6-84bf7dc890b9 admin admin] The token cache is being invalidate because project ff2eb7aa621e45c79fafe9e61516ff08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:54:30.394846 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-f8e1d3f9-8e1d-489b-98f6-84bf7dc890b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:30.395499 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-f8e1d3f9-8e1d-489b-98f6-84bf7dc890b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:30.396990 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1247/2495] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:54:30 2022] DELETE /identity/v3/projects/ff2eb7aa621e45c79fafe9e61516ff08 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:54:30.401868 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f318ec2-938d-4f99-8ac0-1bd9cb2d472c None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:30.402231 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f318ec2-938d-4f99-8ac0-1bd9cb2d472c None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:30.402510 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f318ec2-938d-4f99-8ac0-1bd9cb2d472c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:30.421528 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-2f318ec2-938d-4f99-8ac0-1bd9cb2d472c None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:54:30.422709 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-2f318ec2-938d-4f99-8ac0-1bd9cb2d472c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:30.472669 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:54:30.481395 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1249/2496] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:54:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:54:30.489574 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d0a15-4059-4146-a15b-4a0902cee4af None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:30.489866 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d0a15-4059-4146-a15b-4a0902cee4af None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:30.490149 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d0a15-4059-4146-a15b-4a0902cee4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:30.510550 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-ac9d0a15-4059-4146-a15b-4a0902cee4af None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:54:30.511791 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-ac9d0a15-4059-4146-a15b-4a0902cee4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:30.519809 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1248/2497] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:54:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:54:30.523911 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f318ec2-938d-4f99-8ac0-1bd9cb2d472c None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:30.533401 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f318ec2-938d-4f99-8ac0-1bd9cb2d472c None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:30.537974 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e807637-5f51-4487-bb18-9ee299d88bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:30.538578 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e807637-5f51-4487-bb18-9ee299d88bdf admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:30.538858 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e807637-5f51-4487-bb18-9ee299d88bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:30.539161 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e807637-5f51-4487-bb18-9ee299d88bdf admin admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:30.539853 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e807637-5f51-4487-bb18-9ee299d88bdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:54:30.540184 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e807637-5f51-4487-bb18-9ee299d88bdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:30.541778 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e807637-5f51-4487-bb18-9ee299d88bdf admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:30.554023 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1250/2498] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:54:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:54:30.558126 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d0a15-4059-4146-a15b-4a0902cee4af None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:30.568114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d0a15-4059-4146-a15b-4a0902cee4af None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:30.572751 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c91e0f6-c2f3-4e61-8bd1-920a5d605fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:30.573354 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91e0f6-c2f3-4e61-8bd1-920a5d605fa0 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:30.573637 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91e0f6-c2f3-4e61-8bd1-920a5d605fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:30.573911 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91e0f6-c2f3-4e61-8bd1-920a5d605fa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:30.574578 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c91e0f6-c2f3-4e61-8bd1-920a5d605fa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:30.576587 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c91e0f6-c2f3-4e61-8bd1-920a5d605fa0 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:30.630738 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e807637-5f51-4487-bb18-9ee299d88bdf admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:30.630738 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-0e807637-5f51-4487-bb18-9ee299d88bdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:30.644005 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1249/2499] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:54:30 2022] POST /identity/v3/projects => generated 369 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:54:30.644183 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e807637-5f51-4487-bb18-9ee299d88bdf admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:30.649364 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c91e0f6-c2f3-4e61-8bd1-920a5d605fa0 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:30.701542 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b92107-c8e8-42f2-aea6-b47269c64574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:30.702225 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b92107-c8e8-42f2-aea6-b47269c64574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:30.702510 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b92107-c8e8-42f2-aea6-b47269c64574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:30.702794 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b92107-c8e8-42f2-aea6-b47269c64574 admin admin] PATH_INFO: `/v3/users/68ef0dcbd66b4e808943b1b93a095870` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:30.704016 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b92107-c8e8-42f2-aea6-b47269c64574 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68ef0dcbd66b4e808943b1b93a095870)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:30.705949 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b92107-c8e8-42f2-aea6-b47269c64574 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:30.712788 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c91e0f6-c2f3-4e61-8bd1-920a5d605fa0 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:30.717442 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17e1b6-9e27-43e2-a523-588dfa258ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:30.718052 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17e1b6-9e27-43e2-a523-588dfa258ac3 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:30.718332 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17e1b6-9e27-43e2-a523-588dfa258ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:30.718607 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17e1b6-9e27-43e2-a523-588dfa258ac3 admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:30.719290 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b17e1b6-9e27-43e2-a523-588dfa258ac3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:30.721247 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b17e1b6-9e27-43e2-a523-588dfa258ac3 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:30.857844 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1250/2500] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:54:30 2022] POST /identity/v3/users => generated 285 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:54:30.862225 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17e1b6-9e27-43e2-a523-588dfa258ac3 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:30.871716 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17e1b6-9e27-43e2-a523-588dfa258ac3 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:30.876346 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ac782-2369-44b9-a3a1-8667e77dacac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:30.876822 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-92b92107-c8e8-42f2-aea6-b47269c64574 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68ef0dcbd66b4e808943b1b93a095870'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:30.876944 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ac782-2369-44b9-a3a1-8667e77dacac admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:30.877205 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ac782-2369-44b9-a3a1-8667e77dacac admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:30.877478 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ac782-2369-44b9-a3a1-8667e77dacac admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:30.878206 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ac782-2369-44b9-a3a1-8667e77dacac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:30.879785 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ac782-2369-44b9-a3a1-8667e77dacac admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:30.889957 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1251/2501] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:54:30.893877 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ac782-2369-44b9-a3a1-8667e77dacac admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:30.903790 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ac782-2369-44b9-a3a1-8667e77dacac admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:30.908454 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cdd182-84ae-408c-a6a1-b06cb9bb811d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:30.909016 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cdd182-84ae-408c-a6a1-b06cb9bb811d admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:30.909297 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cdd182-84ae-408c-a6a1-b06cb9bb811d admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:30.909573 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cdd182-84ae-408c-a6a1-b06cb9bb811d admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:30.910297 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cdd182-84ae-408c-a6a1-b06cb9bb811d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:30.911810 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cdd182-84ae-408c-a6a1-b06cb9bb811d admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:30.923683 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1252/2502] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:54:30.927540 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cdd182-84ae-408c-a6a1-b06cb9bb811d admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:30.932231 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:54:30.937183 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-92b92107-c8e8-42f2-aea6-b47269c64574 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68ef0dcbd66b4e808943b1b93a095870'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:30.937395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cdd182-84ae-408c-a6a1-b06cb9bb811d admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:30.942187 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641af9cf-c985-4c70-bd8a-4cab2e85c0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:30.942842 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641af9cf-c985-4c70-bd8a-4cab2e85c0e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:30.943160 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641af9cf-c985-4c70-bd8a-4cab2e85c0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:30.943435 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641af9cf-c985-4c70-bd8a-4cab2e85c0e8 admin admin] PATH_INFO: `/v3/projects/8aaf61eb38e1414392f7a665a1abd074/users/fc429a680c774638b9959a41262eff93/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:30.944958 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-92b92107-c8e8-42f2-aea6-b47269c64574 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68ef0dcbd66b4e808943b1b93a095870'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:30.957857 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-92b92107-c8e8-42f2-aea6-b47269c64574 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68ef0dcbd66b4e808943b1b93a095870'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:30.958140 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641af9cf-c985-4c70-bd8a-4cab2e85c0e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aaf61eb38e1414392f7a665a1abd074, user_id=fc429a680c774638b9959a41262eff93, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:30.958884 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-92b92107-c8e8-42f2-aea6-b47269c64574 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68ef0dcbd66b4e808943b1b93a095870'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:30.960841 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641af9cf-c985-4c70-bd8a-4cab2e85c0e8 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:30.964823 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1251/2503] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:54:30 2022] DELETE /identity/v3/users/68ef0dcbd66b4e808943b1b93a095870 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:54:30.969741 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcb4dd-78a3-4280-925a-93351edef9d4 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:30.970037 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcb4dd-78a3-4280-925a-93351edef9d4 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:30.970314 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcb4dd-78a3-4280-925a-93351edef9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:30.990545 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-6adcb4dd-78a3-4280-925a-93351edef9d4 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:54:30.991771 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-6adcb4dd-78a3-4280-925a-93351edef9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:31.049531 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1252/2504] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:54:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:54:31.059307 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adcb4dd-78a3-4280-925a-93351edef9d4 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:31.060614 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-6adcb4dd-78a3-4280-925a-93351edef9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:31.069947 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:54:31.075279 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1253/2505] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:54:30 2022] PUT /identity/v3/projects/8aaf61eb38e1414392f7a665a1abd074/users/fc429a680c774638b9959a41262eff93/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:54:31.085304 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d0afe-8883-4926-91d2-ef2d2ef53753 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:31.085677 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d0afe-8883-4926-91d2-ef2d2ef53753 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:31.086041 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d0afe-8883-4926-91d2-ef2d2ef53753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:31.114907 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-ff4d0afe-8883-4926-91d2-ef2d2ef53753 None None] MFA Rules not processed for user `fc429a680c774638b9959a41262eff93`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:54:31.116141 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-ff4d0afe-8883-4926-91d2-ef2d2ef53753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:31.117946 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adcb4dd-78a3-4280-925a-93351edef9d4 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:31.166969 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e03591-0375-4b2d-8d24-75ac86f7d22a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:31.167721 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e03591-0375-4b2d-8d24-75ac86f7d22a service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:31.168008 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e03591-0375-4b2d-8d24-75ac86f7d22a service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:31.168929 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e03591-0375-4b2d-8d24-75ac86f7d22a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:31.181706 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1254/2506] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:54:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:54:31.186168 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d0afe-8883-4926-91d2-ef2d2ef53753 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:31.187502 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-ff4d0afe-8883-4926-91d2-ef2d2ef53753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:31.232004 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e03591-0375-4b2d-8d24-75ac86f7d22a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:31.233445 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e03591-0375-4b2d-8d24-75ac86f7d22a service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:31.243076 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1253/2507] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:54:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:54:31.251615 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d0afe-8883-4926-91d2-ef2d2ef53753 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:31.256238 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e8e68-6e8c-42a4-8bf8-dc946723ff9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:31.256863 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e8e68-6e8c-42a4-8bf8-dc946723ff9f admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:31.257291 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e8e68-6e8c-42a4-8bf8-dc946723ff9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:31.257417 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e8e68-6e8c-42a4-8bf8-dc946723ff9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:31.258080 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5e8e68-6e8c-42a4-8bf8-dc946723ff9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:31.260046 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5e8e68-6e8c-42a4-8bf8-dc946723ff9f admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:31.345116 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1255/2508] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:54:31 2022] POST /identity/v3/projects => generated 367 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:54:31.349203 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e03591-0375-4b2d-8d24-75ac86f7d22a service neutron] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:31.359062 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e03591-0375-4b2d-8d24-75ac86f7d22a service neutron] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:31.415832 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d9323-2eb5-4d6a-b8b8-a5514a2745a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:31.416470 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d9323-2eb5-4d6a-b8b8-a5514a2745a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:31.416759 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d9323-2eb5-4d6a-b8b8-a5514a2745a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:31.417087 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d9323-2eb5-4d6a-b8b8-a5514a2745a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:31.417705 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d9323-2eb5-4d6a-b8b8-a5514a2745a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:31.419695 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d9323-2eb5-4d6a-b8b8-a5514a2745a4 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:31.515712 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1254/2509] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:54:31 2022] POST /identity/v3/users => generated 290 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:54:31.519621 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e8e68-6e8c-42a4-8bf8-dc946723ff9f admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:31.530703 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e8e68-6e8c-42a4-8bf8-dc946723ff9f admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:31.535339 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a157e-3b45-4a51-ab9c-61464aff3b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:31.535946 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a157e-3b45-4a51-ab9c-61464aff3b13 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:31.536225 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a157e-3b45-4a51-ab9c-61464aff3b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:31.536494 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a157e-3b45-4a51-ab9c-61464aff3b13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:31.537177 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a157e-3b45-4a51-ab9c-61464aff3b13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:31.538771 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a157e-3b45-4a51-ab9c-61464aff3b13 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:31.549783 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1256/2510] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:54:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:54:31.553830 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d9323-2eb5-4d6a-b8b8-a5514a2745a4 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:31.559056 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:54:31.564779 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d9323-2eb5-4d6a-b8b8-a5514a2745a4 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:31.569688 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd47a98-22e6-4ade-ad8b-6a863678bea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:31.570356 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd47a98-22e6-4ade-ad8b-6a863678bea9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:31.570638 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd47a98-22e6-4ade-ad8b-6a863678bea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:31.570911 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd47a98-22e6-4ade-ad8b-6a863678bea9 admin admin] PATH_INFO: `/v3/projects/ab8deec4dc204a5289c8fb3dff823d2d/users/e9de13e23e6e4e0fadff7fc7a7f78b72/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:31.586162 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd47a98-22e6-4ade-ad8b-6a863678bea9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab8deec4dc204a5289c8fb3dff823d2d, user_id=e9de13e23e6e4e0fadff7fc7a7f78b72, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:31.588978 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd47a98-22e6-4ade-ad8b-6a863678bea9 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:31.663655 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a157e-3b45-4a51-ab9c-61464aff3b13 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:31.665770 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-567a157e-3b45-4a51-ab9c-61464aff3b13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:31.678766 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a157e-3b45-4a51-ab9c-61464aff3b13 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:31.684408 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec5fb4-7676-461c-91ff-40263f025b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:31.685162 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec5fb4-7676-461c-91ff-40263f025b48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:31.685439 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec5fb4-7676-461c-91ff-40263f025b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:31.688586 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec5fb4-7676-461c-91ff-40263f025b48 admin admin] PATH_INFO: `/v3/projects/c46eaf8f0c0943029f57ba0399ebf9c2` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:31.688586 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ec5fb4-7676-461c-91ff-40263f025b48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c46eaf8f0c0943029f57ba0399ebf9c2)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:31.688896 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ec5fb4-7676-461c-91ff-40263f025b48 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:31.692902 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1255/2511] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:54:31 2022] PUT /identity/v3/projects/ab8deec4dc204a5289c8fb3dff823d2d/users/e9de13e23e6e4e0fadff7fc7a7f78b72/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:54:31.696788 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd47a98-22e6-4ade-ad8b-6a863678bea9 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:31.761787 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd47a98-22e6-4ade-ad8b-6a863678bea9 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:31.767161 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc8104-9546-42a4-84ac-f5a821ae3435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:31.767781 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc8104-9546-42a4-84ac-f5a821ae3435 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:31.768064 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc8104-9546-42a4-84ac-f5a821ae3435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:31.768341 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc8104-9546-42a4-84ac-f5a821ae3435 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:31.769037 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc8104-9546-42a4-84ac-f5a821ae3435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:31.770693 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc8104-9546-42a4-84ac-f5a821ae3435 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:31.780389 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1256/2512] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:54:31 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:54:31.784691 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc8104-9546-42a4-84ac-f5a821ae3435 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:31.792387 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:54:31.794280 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc8104-9546-42a4-84ac-f5a821ae3435 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:31.800782 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-67ec5fb4-7676-461c-91ff-40263f025b48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c46eaf8f0c0943029f57ba0399ebf9c2', 'request_id': 'req-67ec5fb4-7676-461c-91ff-40263f025b48'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:31.850655 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c791f09-dc4c-4eeb-ae42-97c4d292a43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:31.851354 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c791f09-dc4c-4eeb-ae42-97c4d292a43e admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:31.851659 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c791f09-dc4c-4eeb-ae42-97c4d292a43e admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:31.851935 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c791f09-dc4c-4eeb-ae42-97c4d292a43e admin admin] PATH_INFO: `/v3/projects/ab8deec4dc204a5289c8fb3dff823d2d/users/e9de13e23e6e4e0fadff7fc7a7f78b72/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:31.853945 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c791f09-dc4c-4eeb-ae42-97c4d292a43e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab8deec4dc204a5289c8fb3dff823d2d, user_id=e9de13e23e6e4e0fadff7fc7a7f78b72, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:31.857016 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c791f09-dc4c-4eeb-ae42-97c4d292a43e admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:31.866863 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1257/2513] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:54:31 2022] PUT /identity/v3/projects/ab8deec4dc204a5289c8fb3dff823d2d/users/e9de13e23e6e4e0fadff7fc7a7f78b72/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:54:31.878935 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ef070-d2ec-4584-9432-f996952e7d25 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:31.879252 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ef070-d2ec-4584-9432-f996952e7d25 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:31.879532 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ef070-d2ec-4584-9432-f996952e7d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:31.897085 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-67ec5fb4-7676-461c-91ff-40263f025b48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c46eaf8f0c0943029f57ba0399ebf9c2', 'request_id': 'req-67ec5fb4-7676-461c-91ff-40263f025b48'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:31.903352 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-67ec5fb4-7676-461c-91ff-40263f025b48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c46eaf8f0c0943029f57ba0399ebf9c2', 'request_id': 'req-67ec5fb4-7676-461c-91ff-40263f025b48'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:31.908210 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-cc4ef070-d2ec-4584-9432-f996952e7d25 None None] MFA Rules not processed for user `e9de13e23e6e4e0fadff7fc7a7f78b72`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:54:31.909425 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-cc4ef070-d2ec-4584-9432-f996952e7d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:31.915621 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-67ec5fb4-7676-461c-91ff-40263f025b48 admin admin] The token cache is being invalidate because project c46eaf8f0c0943029f57ba0399ebf9c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:54:31.915910 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-67ec5fb4-7676-461c-91ff-40263f025b48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:31.916566 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-67ec5fb4-7676-461c-91ff-40263f025b48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:31.918091 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1257/2514] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:54:31 2022] DELETE /identity/v3/projects/c46eaf8f0c0943029f57ba0399ebf9c2 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:54:31.925280 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee8572-45ae-4d08-a431-d6bc2aa6a3e1 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:31.925280 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee8572-45ae-4d08-a431-d6bc2aa6a3e1 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:31.925280 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee8572-45ae-4d08-a431-d6bc2aa6a3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:31.943128 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-8bee8572-45ae-4d08-a431-d6bc2aa6a3e1 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:54:31.944747 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-8bee8572-45ae-4d08-a431-d6bc2aa6a3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:31.970453 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:54:31.980221 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1258/2515] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:54:31 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:54:31.992806 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ef070-d2ec-4584-9432-f996952e7d25 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:31.994275 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-cc4ef070-d2ec-4584-9432-f996952e7d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:32.005335 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1258/2516] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:54:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:54:32.029469 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ed34a-e617-46c2-9607-e16866974344 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:32.029756 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ed34a-e617-46c2-9607-e16866974344 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:32.030030 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ed34a-e617-46c2-9607-e16866974344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:32.049728 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-284ed34a-e617-46c2-9607-e16866974344 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:54:32.050913 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-284ed34a-e617-46c2-9607-e16866974344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:32.051685 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ef070-d2ec-4584-9432-f996952e7d25 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:32.055437 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61c38c-6607-41fa-a989-b1a90354d6c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:32.056054 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61c38c-6607-41fa-a989-b1a90354d6c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:32.056338 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61c38c-6607-41fa-a989-b1a90354d6c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:32.056615 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61c38c-6607-41fa-a989-b1a90354d6c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:32.058822 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1259/2517] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:54:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:54:32.063013 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ed34a-e617-46c2-9607-e16866974344 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:32.066426 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd61c38c-6607-41fa-a989-b1a90354d6c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:32.067986 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd61c38c-6607-41fa-a989-b1a90354d6c7 service cinder] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:32.072126 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ed34a-e617-46c2-9607-e16866974344 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:32.077489 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb2239-a12c-4162-ad63-6ee738e060b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:32.078085 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb2239-a12c-4162-ad63-6ee738e060b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:32.078370 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb2239-a12c-4162-ad63-6ee738e060b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:32.078502 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1259/2518] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:54:31 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:54:32.078643 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb2239-a12c-4162-ad63-6ee738e060b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:32.079394 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb2239-a12c-4162-ad63-6ee738e060b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:54:32.079698 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb2239-a12c-4162-ad63-6ee738e060b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:32.081294 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb2239-a12c-4162-ad63-6ee738e060b8 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:32.093956 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1260/2519] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:54:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:54:32.098500 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61c38c-6607-41fa-a989-b1a90354d6c7 service cinder] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:32.108949 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61c38c-6607-41fa-a989-b1a90354d6c7 service cinder] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:32.113446 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e7c12-4236-4f8f-b5b8-48eab65f7b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:32.114049 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e7c12-4236-4f8f-b5b8-48eab65f7b38 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:32.114331 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e7c12-4236-4f8f-b5b8-48eab65f7b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:32.117250 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e7c12-4236-4f8f-b5b8-48eab65f7b38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:32.117250 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e7c12-4236-4f8f-b5b8-48eab65f7b38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:32.117250 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e7c12-4236-4f8f-b5b8-48eab65f7b38 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:32.208703 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb2239-a12c-4162-ad63-6ee738e060b8 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:32.210437 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-a1fb2239-a12c-4162-ad63-6ee738e060b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:32.222231 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1260/2520] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:54:32 2022] POST /identity/v3/projects => generated 375 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:54:32.223257 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e7c12-4236-4f8f-b5b8-48eab65f7b38 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:32.224924 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb2239-a12c-4162-ad63-6ee738e060b8 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:32.275746 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d4834-c437-49d3-a8fd-060e3245b3e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:32.276907 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d4834-c437-49d3-a8fd-060e3245b3e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:32.277188 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d4834-c437-49d3-a8fd-060e3245b3e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:32.277465 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d4834-c437-49d3-a8fd-060e3245b3e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:32.280580 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-b06d4834-c437-49d3-a8fd-060e3245b3e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:32.287825 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e7c12-4236-4f8f-b5b8-48eab65f7b38 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:32.292550 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87850fca-851a-426e-969b-c76eef787df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:32.293201 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87850fca-851a-426e-969b-c76eef787df4 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:32.293487 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87850fca-851a-426e-969b-c76eef787df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:32.293768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87850fca-851a-426e-969b-c76eef787df4 admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:32.294522 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87850fca-851a-426e-969b-c76eef787df4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:32.296487 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87850fca-851a-426e-969b-c76eef787df4 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:32.338250 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d4834-c437-49d3-a8fd-060e3245b3e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:32.339741 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d4834-c437-49d3-a8fd-060e3245b3e0 service cinder] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:32.344863 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:54:32.349573 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1261/2521] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:54:32 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:54:32.382832 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1261/2522] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:54:32 2022] POST /identity/v3/users => generated 288 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:54:32.387977 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d4834-c437-49d3-a8fd-060e3245b3e0 service cinder] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:32.398537 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d4834-c437-49d3-a8fd-060e3245b3e0 service cinder] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:32.404059 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2d1d4-288f-486b-866d-1814073bfdde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:32.404670 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2d1d4-288f-486b-866d-1814073bfdde admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:32.404951 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2d1d4-288f-486b-866d-1814073bfdde admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:32.405225 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2d1d4-288f-486b-866d-1814073bfdde admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:32.405915 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb2d1d4-288f-486b-866d-1814073bfdde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:32.407567 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb2d1d4-288f-486b-866d-1814073bfdde admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:32.417680 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1262/2523] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:54:32.421831 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87850fca-851a-426e-969b-c76eef787df4 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:32.431817 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87850fca-851a-426e-969b-c76eef787df4 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:32.437000 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a892d-2387-4c71-8677-7dd4e7bca177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:32.437619 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a892d-2387-4c71-8677-7dd4e7bca177 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:32.443629 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a892d-2387-4c71-8677-7dd4e7bca177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:32.443629 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a892d-2387-4c71-8677-7dd4e7bca177 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:32.443629 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a892d-2387-4c71-8677-7dd4e7bca177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:32.443629 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a892d-2387-4c71-8677-7dd4e7bca177 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:32.452255 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1262/2524] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:54:32.455339 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2d1d4-288f-486b-866d-1814073bfdde admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:32.466463 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2d1d4-288f-486b-866d-1814073bfdde admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:32.471554 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca8522b-f26e-4605-b353-2c6d0e3fe980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:32.472224 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8522b-f26e-4605-b353-2c6d0e3fe980 admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:32.472506 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8522b-f26e-4605-b353-2c6d0e3fe980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:32.472788 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8522b-f26e-4605-b353-2c6d0e3fe980 admin admin] PATH_INFO: `/v3/projects/39e6a3e0e11849f2b8f17e285b956d90/users/a37f9814047045a9aa46a71bb3765c31/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:32.488634 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca8522b-f26e-4605-b353-2c6d0e3fe980 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39e6a3e0e11849f2b8f17e285b956d90, user_id=a37f9814047045a9aa46a71bb3765c31, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:32.491352 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca8522b-f26e-4605-b353-2c6d0e3fe980 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:32.560911 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1263/2525] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:54:32 2022] PUT /identity/v3/projects/39e6a3e0e11849f2b8f17e285b956d90/users/a37f9814047045a9aa46a71bb3765c31/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:54:32.572620 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1a3fb-bebe-404c-a336-eea7e66131e6 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:32.573115 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1a3fb-bebe-404c-a336-eea7e66131e6 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:32.573210 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1a3fb-bebe-404c-a336-eea7e66131e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:32.600996 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-b8d1a3fb-bebe-404c-a336-eea7e66131e6 None None] MFA Rules not processed for user `a37f9814047045a9aa46a71bb3765c31`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:54:32.602221 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-b8d1a3fb-bebe-404c-a336-eea7e66131e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:32.645920 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:54:32.667457 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1263/2526] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:54:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:54:32.672059 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca8522b-f26e-4605-b353-2c6d0e3fe980 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:32.735676 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca8522b-f26e-4605-b353-2c6d0e3fe980 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:32.740404 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0a32b-0fad-4c80-a3ce-0bbd47687d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:32.741011 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0a32b-0fad-4c80-a3ce-0bbd47687d8b admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:32.741288 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0a32b-0fad-4c80-a3ce-0bbd47687d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:32.741559 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0a32b-0fad-4c80-a3ce-0bbd47687d8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:32.742209 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e0a32b-0fad-4c80-a3ce-0bbd47687d8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:32.744148 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e0a32b-0fad-4c80-a3ce-0bbd47687d8b admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:32.834822 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1264/2527] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:54:32 2022] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:54:32.838827 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d1a3fb-bebe-404c-a336-eea7e66131e6 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:32.849691 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d1a3fb-bebe-404c-a336-eea7e66131e6 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:32.908828 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38dcac-ed0b-47b6-be51-388c3d13bf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:32.911340 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38dcac-ed0b-47b6-be51-388c3d13bf71 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:32.911340 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38dcac-ed0b-47b6-be51-388c3d13bf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:32.911340 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38dcac-ed0b-47b6-be51-388c3d13bf71 admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:32.911340 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca38dcac-ed0b-47b6-be51-388c3d13bf71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:32.912713 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca38dcac-ed0b-47b6-be51-388c3d13bf71 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:33.045659 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1264/2528] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:54:32 2022] POST /identity/v3/users => generated 295 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:54:33.049775 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0a32b-0fad-4c80-a3ce-0bbd47687d8b admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:33.060666 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0a32b-0fad-4c80-a3ce-0bbd47687d8b admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:33.065171 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e176e-1293-47b9-8a86-a2363830d7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:33.065765 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e176e-1293-47b9-8a86-a2363830d7f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:33.066150 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e176e-1293-47b9-8a86-a2363830d7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:33.066423 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e176e-1293-47b9-8a86-a2363830d7f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:33.067147 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41e176e-1293-47b9-8a86-a2363830d7f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:33.071976 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41e176e-1293-47b9-8a86-a2363830d7f7 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:33.079096 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1265/2529] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:54:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:54:33.083154 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38dcac-ed0b-47b6-be51-388c3d13bf71 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:33.094809 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38dcac-ed0b-47b6-be51-388c3d13bf71 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:33.101641 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f24ae8-ba29-49d3-98ea-eefec294e113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:33.106616 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f24ae8-ba29-49d3-98ea-eefec294e113 admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:33.106616 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f24ae8-ba29-49d3-98ea-eefec294e113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:33.106616 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f24ae8-ba29-49d3-98ea-eefec294e113 admin admin] PATH_INFO: `/v3/projects/808a3f2554034df2b5ea436852f02418/users/b8e5bbf87c2543cdad073d99894b1ccb/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:33.120015 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f24ae8-ba29-49d3-98ea-eefec294e113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=808a3f2554034df2b5ea436852f02418, user_id=b8e5bbf87c2543cdad073d99894b1ccb, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:33.122680 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f24ae8-ba29-49d3-98ea-eefec294e113 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:33.189018 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1265/2530] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:54:33 2022] PUT /identity/v3/projects/808a3f2554034df2b5ea436852f02418/users/b8e5bbf87c2543cdad073d99894b1ccb/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:54:33.193013 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e176e-1293-47b9-8a86-a2363830d7f7 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:33.203199 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e176e-1293-47b9-8a86-a2363830d7f7 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:33.260292 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29890f-2e26-4143-ab08-63a504aaf287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:33.260897 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29890f-2e26-4143-ab08-63a504aaf287 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:33.261159 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29890f-2e26-4143-ab08-63a504aaf287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:33.261425 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29890f-2e26-4143-ab08-63a504aaf287 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:33.262112 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29890f-2e26-4143-ab08-63a504aaf287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:33.263750 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29890f-2e26-4143-ab08-63a504aaf287 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:33.273512 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1266/2531] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:54:33 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:54:33.278192 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f24ae8-ba29-49d3-98ea-eefec294e113 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:33.288637 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f24ae8-ba29-49d3-98ea-eefec294e113 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:33.293951 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04894f8d-544b-4fcc-8c7e-04c2a4fe2fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:33.294622 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04894f8d-544b-4fcc-8c7e-04c2a4fe2fed admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:33.297738 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04894f8d-544b-4fcc-8c7e-04c2a4fe2fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:33.297738 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04894f8d-544b-4fcc-8c7e-04c2a4fe2fed admin admin] PATH_INFO: `/v3/projects/808a3f2554034df2b5ea436852f02418/users/b8e5bbf87c2543cdad073d99894b1ccb/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:33.297738 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04894f8d-544b-4fcc-8c7e-04c2a4fe2fed admin admin] RBAC: Authorizing `identity:create_grant(project_id=808a3f2554034df2b5ea436852f02418, user_id=b8e5bbf87c2543cdad073d99894b1ccb, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:33.299823 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04894f8d-544b-4fcc-8c7e-04c2a4fe2fed admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:33.309877 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1266/2532] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:54:33 2022] PUT /identity/v3/projects/808a3f2554034df2b5ea436852f02418/users/b8e5bbf87c2543cdad073d99894b1ccb/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:54:33.320198 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c68d2e-e381-4ef8-8772-4d042995dc9a None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:33.320494 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c68d2e-e381-4ef8-8772-4d042995dc9a None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:33.320805 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c68d2e-e381-4ef8-8772-4d042995dc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:33.348613 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-96c68d2e-e381-4ef8-8772-4d042995dc9a None None] MFA Rules not processed for user `b8e5bbf87c2543cdad073d99894b1ccb`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:54:33.349834 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-96c68d2e-e381-4ef8-8772-4d042995dc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:33.373771 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:54:33.417033 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1267/2533] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:54:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:54:33.428675 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04894f8d-544b-4fcc-8c7e-04c2a4fe2fed admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:33.496174 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04894f8d-544b-4fcc-8c7e-04c2a4fe2fed admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:33.501403 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd78e6-7dff-44f6-b5a9-fa201d8e4421 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:33.502316 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd78e6-7dff-44f6-b5a9-fa201d8e4421 service cinder] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:33.502744 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd78e6-7dff-44f6-b5a9-fa201d8e4421 service cinder] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:33.503117 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd78e6-7dff-44f6-b5a9-fa201d8e4421 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:33.551010 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:54:33.560475 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd78e6-7dff-44f6-b5a9-fa201d8e4421 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:33.561977 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd78e6-7dff-44f6-b5a9-fa201d8e4421 service cinder] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:33.570810 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1267/2534] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:54:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:54:36.931362 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c68d2e-e381-4ef8-8772-4d042995dc9a None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:36.942243 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c68d2e-e381-4ef8-8772-4d042995dc9a None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:36.945780 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a10ab91-f9be-45b7-850d-7e46e93871f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:36.946397 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10ab91-f9be-45b7-850d-7e46e93871f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:36.946678 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10ab91-f9be-45b7-850d-7e46e93871f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:36.946973 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10ab91-f9be-45b7-850d-7e46e93871f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:36.957005 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a10ab91-f9be-45b7-850d-7e46e93871f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:36.958942 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a10ab91-f9be-45b7-850d-7e46e93871f2 service cinder] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:36.961821 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd78e6-7dff-44f6-b5a9-fa201d8e4421 service cinder] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:36.963260 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-68cd78e6-7dff-44f6-b5a9-fa201d8e4421 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:36.968758 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1268/2535] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:54:36 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:54:37.029580 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd78e6-7dff-44f6-b5a9-fa201d8e4421 service cinder] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:37.034168 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56167624-83d1-4e22-b625-6a7b37a44691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:37.034809 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56167624-83d1-4e22-b625-6a7b37a44691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:37.035127 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56167624-83d1-4e22-b625-6a7b37a44691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:37.035407 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56167624-83d1-4e22-b625-6a7b37a44691 admin admin] PATH_INFO: `/v3/users/fc429a680c774638b9959a41262eff93` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:37.036576 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56167624-83d1-4e22-b625-6a7b37a44691 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc429a680c774638b9959a41262eff93)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:37.038503 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56167624-83d1-4e22-b625-6a7b37a44691 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:37.214305 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-56167624-83d1-4e22-b625-6a7b37a44691 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc429a680c774638b9959a41262eff93'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:37.279312 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-56167624-83d1-4e22-b625-6a7b37a44691 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc429a680c774638b9959a41262eff93'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:37.286684 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-56167624-83d1-4e22-b625-6a7b37a44691 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc429a680c774638b9959a41262eff93'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:37.299549 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-56167624-83d1-4e22-b625-6a7b37a44691 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc429a680c774638b9959a41262eff93'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:37.300256 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-56167624-83d1-4e22-b625-6a7b37a44691 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc429a680c774638b9959a41262eff93'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:37.307168 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1268/2536] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:54:36 2022] DELETE /identity/v3/users/fc429a680c774638b9959a41262eff93 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:54:37.315478 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ad1c8-3615-4a23-92ea-5d732e8e7272 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:37.315941 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ad1c8-3615-4a23-92ea-5d732e8e7272 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:37.316373 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ad1c8-3615-4a23-92ea-5d732e8e7272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:37.335013 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-b59ad1c8-3615-4a23-92ea-5d732e8e7272 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:54:37.336211 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-b59ad1c8-3615-4a23-92ea-5d732e8e7272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:37.395292 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1269/2537] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:54:37.404996 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56167624-83d1-4e22-b625-6a7b37a44691 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:37.406510 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-56167624-83d1-4e22-b625-6a7b37a44691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:37.466233 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56167624-83d1-4e22-b625-6a7b37a44691 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:37.469886 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7881d8a-0d45-4b93-9ce5-9a3e26702c26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:37.470522 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7881d8a-0d45-4b93-9ce5-9a3e26702c26 service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:37.470784 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7881d8a-0d45-4b93-9ce5-9a3e26702c26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:37.471094 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7881d8a-0d45-4b93-9ce5-9a3e26702c26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:37.480117 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7881d8a-0d45-4b93-9ce5-9a3e26702c26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:37.482232 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7881d8a-0d45-4b93-9ce5-9a3e26702c26 service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:37.492038 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1269/2538] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:54:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:54:37.888520 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ad1c8-3615-4a23-92ea-5d732e8e7272 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:37.890108 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-b59ad1c8-3615-4a23-92ea-5d732e8e7272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:37.903047 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ad1c8-3615-4a23-92ea-5d732e8e7272 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:37.909317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36191b-4425-4d1a-bdca-dd7502236d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:37.910074 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36191b-4425-4d1a-bdca-dd7502236d64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:37.910458 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36191b-4425-4d1a-bdca-dd7502236d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:37.910832 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36191b-4425-4d1a-bdca-dd7502236d64 admin admin] PATH_INFO: `/v3/projects/8aaf61eb38e1414392f7a665a1abd074` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:37.912119 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36191b-4425-4d1a-bdca-dd7502236d64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8aaf61eb38e1414392f7a665a1abd074)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:37.914046 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36191b-4425-4d1a-bdca-dd7502236d64 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:38.016492 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-6b36191b-4425-4d1a-bdca-dd7502236d64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8aaf61eb38e1414392f7a665a1abd074', 'request_id': 'req-6b36191b-4425-4d1a-bdca-dd7502236d64'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:38.062989 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-6b36191b-4425-4d1a-bdca-dd7502236d64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8aaf61eb38e1414392f7a665a1abd074', 'request_id': 'req-6b36191b-4425-4d1a-bdca-dd7502236d64'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:38.068556 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-6b36191b-4425-4d1a-bdca-dd7502236d64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8aaf61eb38e1414392f7a665a1abd074', 'request_id': 'req-6b36191b-4425-4d1a-bdca-dd7502236d64'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:38.079943 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-6b36191b-4425-4d1a-bdca-dd7502236d64 admin admin] The token cache is being invalidate because project 8aaf61eb38e1414392f7a665a1abd074 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:54:38.080232 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-6b36191b-4425-4d1a-bdca-dd7502236d64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:38.080850 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-6b36191b-4425-4d1a-bdca-dd7502236d64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:38.082330 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1270/2539] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:54:37 2022] DELETE /identity/v3/projects/8aaf61eb38e1414392f7a665a1abd074 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:54:38.086446 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7881d8a-0d45-4b93-9ce5-9a3e26702c26 service neutron] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:38.096835 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7881d8a-0d45-4b93-9ce5-9a3e26702c26 service neutron] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:38.104530 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:54:38.153900 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb9610-ee3d-48d0-9d7c-7584bd7d782c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:38.154539 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb9610-ee3d-48d0-9d7c-7584bd7d782c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:38.154818 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb9610-ee3d-48d0-9d7c-7584bd7d782c admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:38.155122 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb9610-ee3d-48d0-9d7c-7584bd7d782c admin admin] PATH_INFO: `/v3/users/e9de13e23e6e4e0fadff7fc7a7f78b72` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:38.156267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb9610-ee3d-48d0-9d7c-7584bd7d782c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9de13e23e6e4e0fadff7fc7a7f78b72)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:38.158235 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb9610-ee3d-48d0-9d7c-7584bd7d782c admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:38.333914 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-72eb9610-ee3d-48d0-9d7c-7584bd7d782c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9de13e23e6e4e0fadff7fc7a7f78b72'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:38.395063 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-72eb9610-ee3d-48d0-9d7c-7584bd7d782c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9de13e23e6e4e0fadff7fc7a7f78b72'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:38.402436 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-72eb9610-ee3d-48d0-9d7c-7584bd7d782c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9de13e23e6e4e0fadff7fc7a7f78b72'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:38.414095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-72eb9610-ee3d-48d0-9d7c-7584bd7d782c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9de13e23e6e4e0fadff7fc7a7f78b72'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:38.414752 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-72eb9610-ee3d-48d0-9d7c-7584bd7d782c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9de13e23e6e4e0fadff7fc7a7f78b72'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:38.420606 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1270/2540] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:54:38 2022] DELETE /identity/v3/users/e9de13e23e6e4e0fadff7fc7a7f78b72 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:54:38.785988 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36191b-4425-4d1a-bdca-dd7502236d64 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:38.787458 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-6b36191b-4425-4d1a-bdca-dd7502236d64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:38.801152 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36191b-4425-4d1a-bdca-dd7502236d64 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:38.833400 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:54:38.862308 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91986e0c-de58-487d-bc9c-cb736c21f596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:38.862969 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91986e0c-de58-487d-bc9c-cb736c21f596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:38.863259 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91986e0c-de58-487d-bc9c-cb736c21f596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:38.863536 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91986e0c-de58-487d-bc9c-cb736c21f596 admin admin] PATH_INFO: `/v3/projects/ab8deec4dc204a5289c8fb3dff823d2d` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:38.864703 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91986e0c-de58-487d-bc9c-cb736c21f596 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab8deec4dc204a5289c8fb3dff823d2d)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:38.866607 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91986e0c-de58-487d-bc9c-cb736c21f596 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:38.994485 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-91986e0c-de58-487d-bc9c-cb736c21f596 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab8deec4dc204a5289c8fb3dff823d2d', 'request_id': 'req-91986e0c-de58-487d-bc9c-cb736c21f596'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:39.085704 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-91986e0c-de58-487d-bc9c-cb736c21f596 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab8deec4dc204a5289c8fb3dff823d2d', 'request_id': 'req-91986e0c-de58-487d-bc9c-cb736c21f596'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:39.092226 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-91986e0c-de58-487d-bc9c-cb736c21f596 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab8deec4dc204a5289c8fb3dff823d2d', 'request_id': 'req-91986e0c-de58-487d-bc9c-cb736c21f596'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:39.103337 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-91986e0c-de58-487d-bc9c-cb736c21f596 admin admin] The token cache is being invalidate because project ab8deec4dc204a5289c8fb3dff823d2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:54:39.103618 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-91986e0c-de58-487d-bc9c-cb736c21f596 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:39.104248 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-91986e0c-de58-487d-bc9c-cb736c21f596 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:39.105771 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1271/2541] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:54:38 2022] DELETE /identity/v3/projects/ab8deec4dc204a5289c8fb3dff823d2d => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:54:39.112251 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cf982-2ba1-46d5-9eab-fc120f5ebfc0 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:39.112725 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cf982-2ba1-46d5-9eab-fc120f5ebfc0 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:39.112830 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cf982-2ba1-46d5-9eab-fc120f5ebfc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:39.132653 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-371cf982-2ba1-46d5-9eab-fc120f5ebfc0 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:54:39.133833 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-371cf982-2ba1-46d5-9eab-fc120f5ebfc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:39.190968 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1271/2542] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:54:39.202011 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49e003-91ed-44df-a7f0-b095ad0d2517 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:39.202306 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49e003-91ed-44df-a7f0-b095ad0d2517 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:39.202584 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49e003-91ed-44df-a7f0-b095ad0d2517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:39.222278 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-dd49e003-91ed-44df-a7f0-b095ad0d2517 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:54:39.223537 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-dd49e003-91ed-44df-a7f0-b095ad0d2517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:39.231307 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1272/2543] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:54:39.236361 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371cf982-2ba1-46d5-9eab-fc120f5ebfc0 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:39.246202 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371cf982-2ba1-46d5-9eab-fc120f5ebfc0 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:39.250920 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7351ff-1aab-4a46-8db2-4f4a77495772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:39.251562 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7351ff-1aab-4a46-8db2-4f4a77495772 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:39.251847 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7351ff-1aab-4a46-8db2-4f4a77495772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:39.252126 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7351ff-1aab-4a46-8db2-4f4a77495772 admin admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:39.252831 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7351ff-1aab-4a46-8db2-4f4a77495772 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:54:39.253138 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7351ff-1aab-4a46-8db2-4f4a77495772 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:39.254746 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7351ff-1aab-4a46-8db2-4f4a77495772 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:39.266267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1272/2544] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:54:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:54:39.270579 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49e003-91ed-44df-a7f0-b095ad0d2517 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:39.280574 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49e003-91ed-44df-a7f0-b095ad0d2517 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:39.285173 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb5eeb-837b-46a8-a70e-52ea70073059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:39.285815 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb5eeb-837b-46a8-a70e-52ea70073059 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:39.286091 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb5eeb-837b-46a8-a70e-52ea70073059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:39.286363 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb5eeb-837b-46a8-a70e-52ea70073059 admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:39.287086 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeb5eeb-837b-46a8-a70e-52ea70073059 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:39.288993 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeb5eeb-837b-46a8-a70e-52ea70073059 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:39.385087 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1273/2545] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:54:39 2022] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:54:39.389432 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7351ff-1aab-4a46-8db2-4f4a77495772 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:39.399226 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7351ff-1aab-4a46-8db2-4f4a77495772 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:39.411629 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:54:39.455075 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aad385-c0fb-45fc-b0d7-5696be8484d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:39.455701 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aad385-c0fb-45fc-b0d7-5696be8484d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:39.455984 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aad385-c0fb-45fc-b0d7-5696be8484d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:39.456264 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aad385-c0fb-45fc-b0d7-5696be8484d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:39.456929 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aad385-c0fb-45fc-b0d7-5696be8484d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:39.459033 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aad385-c0fb-45fc-b0d7-5696be8484d0 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:39.555286 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1273/2546] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:54:39 2022] POST /identity/v3/users => generated 288 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:54:39.559542 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb5eeb-837b-46a8-a70e-52ea70073059 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:39.569880 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb5eeb-837b-46a8-a70e-52ea70073059 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:39.574682 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ea125-01ce-400c-b73d-0096db8a4c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:39.575828 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ea125-01ce-400c-b73d-0096db8a4c4b admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:39.576108 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ea125-01ce-400c-b73d-0096db8a4c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:39.576408 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ea125-01ce-400c-b73d-0096db8a4c4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:39.577094 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ea125-01ce-400c-b73d-0096db8a4c4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:39.578755 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ea125-01ce-400c-b73d-0096db8a4c4b admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:39.588596 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1274/2547] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:54:39.595574 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aad385-c0fb-45fc-b0d7-5696be8484d0 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:39.603132 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aad385-c0fb-45fc-b0d7-5696be8484d0 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:39.608037 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76903466-7d72-4c1d-be3e-d40f80c1bc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:39.608642 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76903466-7d72-4c1d-be3e-d40f80c1bc42 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:39.608926 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76903466-7d72-4c1d-be3e-d40f80c1bc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:39.609205 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76903466-7d72-4c1d-be3e-d40f80c1bc42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:39.609895 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76903466-7d72-4c1d-be3e-d40f80c1bc42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:39.611525 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76903466-7d72-4c1d-be3e-d40f80c1bc42 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:39.621839 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1274/2548] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:54:39.625791 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ea125-01ce-400c-b73d-0096db8a4c4b admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:39.636143 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ea125-01ce-400c-b73d-0096db8a4c4b admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:39.641444 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3529c599-b9af-4d53-92f9-6baa89e50ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:39.642096 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529c599-b9af-4d53-92f9-6baa89e50ded admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:39.642403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529c599-b9af-4d53-92f9-6baa89e50ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:39.642677 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529c599-b9af-4d53-92f9-6baa89e50ded admin admin] PATH_INFO: `/v3/projects/23918a14e60c4b65828d9fa129c67522/users/f6a81f39a85146adaf212bd1e6c2a334/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:39.657604 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3529c599-b9af-4d53-92f9-6baa89e50ded admin admin] RBAC: Authorizing `identity:create_grant(project_id=23918a14e60c4b65828d9fa129c67522, user_id=f6a81f39a85146adaf212bd1e6c2a334, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:39.660333 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3529c599-b9af-4d53-92f9-6baa89e50ded admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:39.744044 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1275/2549] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:54:39 2022] PUT /identity/v3/projects/23918a14e60c4b65828d9fa129c67522/users/f6a81f39a85146adaf212bd1e6c2a334/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:54:39.756290 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7e224-64b3-4003-ab69-3a8e8661a51e None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:39.756578 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7e224-64b3-4003-ab69-3a8e8661a51e None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:39.756858 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7e224-64b3-4003-ab69-3a8e8661a51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:39.784031 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-50d7e224-64b3-4003-ab69-3a8e8661a51e None None] MFA Rules not processed for user `f6a81f39a85146adaf212bd1e6c2a334`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:54:39.785235 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-50d7e224-64b3-4003-ab69-3a8e8661a51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:39.849538 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1275/2550] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:54:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:54:39.854186 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3529c599-b9af-4d53-92f9-6baa89e50ded admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:39.912748 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:54:39.916726 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3529c599-b9af-4d53-92f9-6baa89e50ded admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:39.922184 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f2284-6569-4b3b-a927-931e95baa18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:39.922821 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f2284-6569-4b3b-a927-931e95baa18a admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:39.923137 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f2284-6569-4b3b-a927-931e95baa18a admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:39.923415 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f2284-6569-4b3b-a927-931e95baa18a admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:39.924073 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39f2284-6569-4b3b-a927-931e95baa18a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:39.925993 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39f2284-6569-4b3b-a927-931e95baa18a admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:40.042616 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1276/2551] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:54:39 2022] POST /identity/v3/projects => generated 377 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:54:40.047184 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7e224-64b3-4003-ab69-3a8e8661a51e None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:40.058002 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7e224-64b3-4003-ab69-3a8e8661a51e None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:40.116558 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da6c71-3788-448c-b2e5-ba34a78891c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:40.117182 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da6c71-3788-448c-b2e5-ba34a78891c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:40.117448 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da6c71-3788-448c-b2e5-ba34a78891c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:40.117722 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da6c71-3788-448c-b2e5-ba34a78891c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:40.118377 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da6c71-3788-448c-b2e5-ba34a78891c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:40.120405 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da6c71-3788-448c-b2e5-ba34a78891c7 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:40.229674 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1276/2552] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:54:40 2022] POST /identity/v3/users => generated 295 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:54:40.234701 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f2284-6569-4b3b-a927-931e95baa18a admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:40.245056 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f2284-6569-4b3b-a927-931e95baa18a admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:40.249685 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a1f59-b3ba-4572-b120-eef54807572b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:40.250290 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a1f59-b3ba-4572-b120-eef54807572b admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:40.250584 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a1f59-b3ba-4572-b120-eef54807572b admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:40.250835 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a1f59-b3ba-4572-b120-eef54807572b admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:40.251554 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a1f59-b3ba-4572-b120-eef54807572b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:40.253147 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a1f59-b3ba-4572-b120-eef54807572b admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:40.263552 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1277/2553] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:54:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:54:40.267648 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da6c71-3788-448c-b2e5-ba34a78891c7 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:40.280894 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da6c71-3788-448c-b2e5-ba34a78891c7 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:40.285573 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af67289-4423-4fb6-b99f-84d32bf2a9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:40.286231 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af67289-4423-4fb6-b99f-84d32bf2a9cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:40.287676 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af67289-4423-4fb6-b99f-84d32bf2a9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:40.287676 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af67289-4423-4fb6-b99f-84d32bf2a9cf admin admin] PATH_INFO: `/v3/projects/e123eab707614aa685099fade6647246/users/010d383a142344d2b90d92070f00ea10/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:40.299022 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:54:40.302107 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af67289-4423-4fb6-b99f-84d32bf2a9cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e123eab707614aa685099fade6647246, user_id=010d383a142344d2b90d92070f00ea10, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:40.304884 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af67289-4423-4fb6-b99f-84d32bf2a9cf admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:40.354957 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1277/2554] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:54:40 2022] PUT /identity/v3/projects/e123eab707614aa685099fade6647246/users/010d383a142344d2b90d92070f00ea10/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:54:40.359227 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a1f59-b3ba-4572-b120-eef54807572b admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:40.369246 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a1f59-b3ba-4572-b120-eef54807572b admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:40.428009 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528bd57-de57-4d02-b1a7-a9d7cb531c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:40.428546 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528bd57-de57-4d02-b1a7-a9d7cb531c9f admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:40.428826 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528bd57-de57-4d02-b1a7-a9d7cb531c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:40.429097 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528bd57-de57-4d02-b1a7-a9d7cb531c9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:40.429768 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3528bd57-de57-4d02-b1a7-a9d7cb531c9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:40.431411 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3528bd57-de57-4d02-b1a7-a9d7cb531c9f admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:40.440771 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1278/2555] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:54:40 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:54:40.445039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af67289-4423-4fb6-b99f-84d32bf2a9cf admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:40.455876 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af67289-4423-4fb6-b99f-84d32bf2a9cf admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:40.460532 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9fbc9-8fe7-47c1-a62b-a4caa2b79bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:40.461178 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9fbc9-8fe7-47c1-a62b-a4caa2b79bed admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:40.461458 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9fbc9-8fe7-47c1-a62b-a4caa2b79bed admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:40.464421 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9fbc9-8fe7-47c1-a62b-a4caa2b79bed admin admin] PATH_INFO: `/v3/projects/e123eab707614aa685099fade6647246/users/010d383a142344d2b90d92070f00ea10/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:40.464421 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d9fbc9-8fe7-47c1-a62b-a4caa2b79bed admin admin] RBAC: Authorizing `identity:create_grant(project_id=e123eab707614aa685099fade6647246, user_id=010d383a142344d2b90d92070f00ea10, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:40.467554 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d9fbc9-8fe7-47c1-a62b-a4caa2b79bed admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:40.489378 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1278/2556] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:54:40 2022] PUT /identity/v3/projects/e123eab707614aa685099fade6647246/users/010d383a142344d2b90d92070f00ea10/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:54:40.508105 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73978e62-35ca-49a2-8736-965e61704498 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:40.508396 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73978e62-35ca-49a2-8736-965e61704498 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:40.508676 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73978e62-35ca-49a2-8736-965e61704498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:40.537856 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-73978e62-35ca-49a2-8736-965e61704498 None None] MFA Rules not processed for user `010d383a142344d2b90d92070f00ea10`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:54:40.539111 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-73978e62-35ca-49a2-8736-965e61704498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:40.606035 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1279/2557] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:54:40 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:54:40.617805 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9fbc9-8fe7-47c1-a62b-a4caa2b79bed admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:40.619552 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-61d9fbc9-8fe7-47c1-a62b-a4caa2b79bed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:40.676638 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9fbc9-8fe7-47c1-a62b-a4caa2b79bed admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:40.680400 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13fe78c-0229-48b4-bbac-173f6e223619 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:40.680950 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fe78c-0229-48b4-bbac-173f6e223619 service cinder] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:40.681233 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fe78c-0229-48b4-bbac-173f6e223619 service cinder] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:40.681508 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fe78c-0229-48b4-bbac-173f6e223619 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:40.738509 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13fe78c-0229-48b4-bbac-173f6e223619 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:40.739976 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13fe78c-0229-48b4-bbac-173f6e223619 service cinder] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:40.749584 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1279/2558] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:54:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:54:42.322632 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73978e62-35ca-49a2-8736-965e61704498 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:42.332913 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73978e62-35ca-49a2-8736-965e61704498 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:42.336460 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6877c9-bdca-4b27-b5e1-11801a16c2ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:42.337065 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6877c9-bdca-4b27-b5e1-11801a16c2ac service cinder] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:42.337345 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6877c9-bdca-4b27-b5e1-11801a16c2ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:42.337620 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6877c9-bdca-4b27-b5e1-11801a16c2ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:42.346372 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6877c9-bdca-4b27-b5e1-11801a16c2ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:42.347836 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6877c9-bdca-4b27-b5e1-11801a16c2ac service cinder] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:42.357089 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1280/2559] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:54:42 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:54:46.595496 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13fe78c-0229-48b4-bbac-173f6e223619 service cinder] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:46.661733 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13fe78c-0229-48b4-bbac-173f6e223619 service cinder] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:46.666289 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b042c-ec50-4521-b028-cbf52f48532b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:46.666989 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b042c-ec50-4521-b028-cbf52f48532b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:46.667283 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b042c-ec50-4521-b028-cbf52f48532b admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:46.667561 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b042c-ec50-4521-b028-cbf52f48532b admin admin] PATH_INFO: `/v3/users/f6a81f39a85146adaf212bd1e6c2a334` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:46.668745 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b042c-ec50-4521-b028-cbf52f48532b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6a81f39a85146adaf212bd1e6c2a334)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:46.671387 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b042c-ec50-4521-b028-cbf52f48532b admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:46.972238 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:54:46.981231 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-228b042c-ec50-4521-b028-cbf52f48532b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6a81f39a85146adaf212bd1e6c2a334'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:47.052299 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-228b042c-ec50-4521-b028-cbf52f48532b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6a81f39a85146adaf212bd1e6c2a334'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:47.059224 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-228b042c-ec50-4521-b028-cbf52f48532b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6a81f39a85146adaf212bd1e6c2a334'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:47.070979 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-228b042c-ec50-4521-b028-cbf52f48532b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6a81f39a85146adaf212bd1e6c2a334'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:47.071598 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-228b042c-ec50-4521-b028-cbf52f48532b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6a81f39a85146adaf212bd1e6c2a334'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:47.078029 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1280/2560] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:54:46 2022] DELETE /identity/v3/users/f6a81f39a85146adaf212bd1e6c2a334 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:54:47.082636 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36003c65-5398-49c7-bd89-2e8477c64896 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:47.083153 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36003c65-5398-49c7-bd89-2e8477c64896 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:47.083246 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36003c65-5398-49c7-bd89-2e8477c64896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:47.103001 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-36003c65-5398-49c7-bd89-2e8477c64896 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:54:47.104446 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-36003c65-5398-49c7-bd89-2e8477c64896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:47.142551 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:54:47.168773 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1281/2561] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:54:47.178612 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b042c-ec50-4521-b028-cbf52f48532b admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:47.180097 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-228b042c-ec50-4521-b028-cbf52f48532b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:47.238483 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b042c-ec50-4521-b028-cbf52f48532b admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:47.243202 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b5ee6-a4bb-41f0-bde0-48c03c35471a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:47.243824 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b5ee6-a4bb-41f0-bde0-48c03c35471a service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:47.244102 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b5ee6-a4bb-41f0-bde0-48c03c35471a service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:47.244494 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b5ee6-a4bb-41f0-bde0-48c03c35471a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:47.256742 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b5ee6-a4bb-41f0-bde0-48c03c35471a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:47.256742 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b5ee6-a4bb-41f0-bde0-48c03c35471a service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:47.265680 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1281/2562] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:54:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:54:47.648687 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36003c65-5398-49c7-bd89-2e8477c64896 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:47.650200 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-36003c65-5398-49c7-bd89-2e8477c64896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:47.663241 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36003c65-5398-49c7-bd89-2e8477c64896 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:47.668658 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95e80e-162c-4a1d-8ce5-d9d139cdc765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:47.669495 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95e80e-162c-4a1d-8ce5-d9d139cdc765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:47.669776 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95e80e-162c-4a1d-8ce5-d9d139cdc765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:47.670110 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95e80e-162c-4a1d-8ce5-d9d139cdc765 admin admin] PATH_INFO: `/v3/projects/23918a14e60c4b65828d9fa129c67522` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:47.671408 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f95e80e-162c-4a1d-8ce5-d9d139cdc765 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23918a14e60c4b65828d9fa129c67522)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:47.673354 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f95e80e-162c-4a1d-8ce5-d9d139cdc765 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:47.784984 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-3f95e80e-162c-4a1d-8ce5-d9d139cdc765 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23918a14e60c4b65828d9fa129c67522', 'request_id': 'req-3f95e80e-162c-4a1d-8ce5-d9d139cdc765'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:47.864444 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-3f95e80e-162c-4a1d-8ce5-d9d139cdc765 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23918a14e60c4b65828d9fa129c67522', 'request_id': 'req-3f95e80e-162c-4a1d-8ce5-d9d139cdc765'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:47.870711 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-3f95e80e-162c-4a1d-8ce5-d9d139cdc765 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23918a14e60c4b65828d9fa129c67522', 'request_id': 'req-3f95e80e-162c-4a1d-8ce5-d9d139cdc765'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:47.882664 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-3f95e80e-162c-4a1d-8ce5-d9d139cdc765 admin admin] The token cache is being invalidate because project 23918a14e60c4b65828d9fa129c67522 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:54:47.883036 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-3f95e80e-162c-4a1d-8ce5-d9d139cdc765 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:47.883677 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-3f95e80e-162c-4a1d-8ce5-d9d139cdc765 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:47.885168 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1282/2563] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:54:47 2022] DELETE /identity/v3/projects/23918a14e60c4b65828d9fa129c67522 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:54:47.889216 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b5ee6-a4bb-41f0-bde0-48c03c35471a service neutron] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:47.898938 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b5ee6-a4bb-41f0-bde0-48c03c35471a service neutron] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:47.956615 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e7a62-3a10-42bb-b6c1-11849852c532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:47.957256 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e7a62-3a10-42bb-b6c1-11849852c532 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:47.957534 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e7a62-3a10-42bb-b6c1-11849852c532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:47.957805 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e7a62-3a10-42bb-b6c1-11849852c532 admin admin] PATH_INFO: `/v3/users/010d383a142344d2b90d92070f00ea10` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:47.958996 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9e7a62-3a10-42bb-b6c1-11849852c532 admin admin] RBAC: Authorizing `identity:delete_user(user_id=010d383a142344d2b90d92070f00ea10)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:47.960903 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9e7a62-3a10-42bb-b6c1-11849852c532 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:48.118180 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-7c9e7a62-3a10-42bb-b6c1-11849852c532 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '010d383a142344d2b90d92070f00ea10'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:48.184271 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-7c9e7a62-3a10-42bb-b6c1-11849852c532 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '010d383a142344d2b90d92070f00ea10'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:48.187222 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:54:48.193548 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-7c9e7a62-3a10-42bb-b6c1-11849852c532 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '010d383a142344d2b90d92070f00ea10'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:48.205925 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-7c9e7a62-3a10-42bb-b6c1-11849852c532 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '010d383a142344d2b90d92070f00ea10'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:48.206672 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-7c9e7a62-3a10-42bb-b6c1-11849852c532 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '010d383a142344d2b90d92070f00ea10'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:48.212531 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1282/2564] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:54:47 2022] DELETE /identity/v3/users/010d383a142344d2b90d92070f00ea10 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:54:48.661076 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95e80e-162c-4a1d-8ce5-d9d139cdc765 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:48.662663 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-3f95e80e-162c-4a1d-8ce5-d9d139cdc765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:48.678146 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95e80e-162c-4a1d-8ce5-d9d139cdc765 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:48.754577 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37f272-5c35-4c64-bdb8-6a18205aaad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:48.755339 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37f272-5c35-4c64-bdb8-6a18205aaad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:48.755790 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37f272-5c35-4c64-bdb8-6a18205aaad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:48.756066 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37f272-5c35-4c64-bdb8-6a18205aaad6 admin admin] PATH_INFO: `/v3/projects/e123eab707614aa685099fade6647246` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:48.757257 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a37f272-5c35-4c64-bdb8-6a18205aaad6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e123eab707614aa685099fade6647246)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:48.760255 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a37f272-5c35-4c64-bdb8-6a18205aaad6 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:48.884181 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-1a37f272-5c35-4c64-bdb8-6a18205aaad6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e123eab707614aa685099fade6647246', 'request_id': 'req-1a37f272-5c35-4c64-bdb8-6a18205aaad6'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:48.974746 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-1a37f272-5c35-4c64-bdb8-6a18205aaad6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e123eab707614aa685099fade6647246', 'request_id': 'req-1a37f272-5c35-4c64-bdb8-6a18205aaad6'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:48.984254 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-1a37f272-5c35-4c64-bdb8-6a18205aaad6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e123eab707614aa685099fade6647246', 'request_id': 'req-1a37f272-5c35-4c64-bdb8-6a18205aaad6'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:48.985825 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:54:48.997359 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-1a37f272-5c35-4c64-bdb8-6a18205aaad6 admin admin] The token cache is being invalidate because project e123eab707614aa685099fade6647246 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:54:48.997659 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-1a37f272-5c35-4c64-bdb8-6a18205aaad6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:48.998689 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-1a37f272-5c35-4c64-bdb8-6a18205aaad6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:49.004047 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1283/2565] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:54:48 2022] DELETE /identity/v3/projects/e123eab707614aa685099fade6647246 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:54:49.005479 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b24c85-a93b-4704-83eb-055091f76556 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:49.005961 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b24c85-a93b-4704-83eb-055091f76556 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:49.006060 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b24c85-a93b-4704-83eb-055091f76556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:49.033559 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-30b24c85-a93b-4704-83eb-055091f76556 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:54:49.035101 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-30b24c85-a93b-4704-83eb-055091f76556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:49.157890 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1283/2566] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:54:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:54:49.167826 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9146558-4b00-4a10-baaf-c023e3297a72 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:49.168760 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9146558-4b00-4a10-baaf-c023e3297a72 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:49.169056 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9146558-4b00-4a10-baaf-c023e3297a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:49.218755 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-f9146558-4b00-4a10-baaf-c023e3297a72 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:54:49.218755 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-f9146558-4b00-4a10-baaf-c023e3297a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:49.225645 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1284/2567] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:54:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:54:49.229034 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b24c85-a93b-4704-83eb-055091f76556 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:49.242119 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b24c85-a93b-4704-83eb-055091f76556 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:49.246982 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd058c-a7fd-47b9-a788-b590637e5301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:49.247624 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd058c-a7fd-47b9-a788-b590637e5301 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:49.247942 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd058c-a7fd-47b9-a788-b590637e5301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:49.248222 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd058c-a7fd-47b9-a788-b590637e5301 admin admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:49.248932 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd058c-a7fd-47b9-a788-b590637e5301 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:54:49.249234 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd058c-a7fd-47b9-a788-b590637e5301 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:49.250860 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd058c-a7fd-47b9-a788-b590637e5301 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:49.267014 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1284/2568] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:54:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:54:49.268217 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9146558-4b00-4a10-baaf-c023e3297a72 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:49.280759 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9146558-4b00-4a10-baaf-c023e3297a72 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:49.285746 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50679856-12b3-491f-836f-bb7f2984bc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:49.286367 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50679856-12b3-491f-836f-bb7f2984bc67 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:49.286649 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50679856-12b3-491f-836f-bb7f2984bc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:49.286921 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50679856-12b3-491f-836f-bb7f2984bc67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:49.287620 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50679856-12b3-491f-836f-bb7f2984bc67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:49.289527 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50679856-12b3-491f-836f-bb7f2984bc67 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:49.427602 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1285/2569] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:54:49 2022] POST /identity/v3/projects => generated 409 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:54:49.431604 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd058c-a7fd-47b9-a788-b590637e5301 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:49.442605 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd058c-a7fd-47b9-a788-b590637e5301 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:49.502704 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b61bb-839d-4ec8-9410-941ec4f31af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:49.503488 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b61bb-839d-4ec8-9410-941ec4f31af7 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:49.503764 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b61bb-839d-4ec8-9410-941ec4f31af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:49.504039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b61bb-839d-4ec8-9410-941ec4f31af7 admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:49.504712 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b61bb-839d-4ec8-9410-941ec4f31af7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:49.506617 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b61bb-839d-4ec8-9410-941ec4f31af7 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:49.605669 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1285/2570] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:54:49 2022] POST /identity/v3/users => generated 305 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:54:49.607095 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50679856-12b3-491f-836f-bb7f2984bc67 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:49.620601 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50679856-12b3-491f-836f-bb7f2984bc67 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:49.625942 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac0492b-e2c5-4b5a-81d9-7748355e4080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:49.626563 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0492b-e2c5-4b5a-81d9-7748355e4080 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:49.626842 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0492b-e2c5-4b5a-81d9-7748355e4080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:49.627148 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0492b-e2c5-4b5a-81d9-7748355e4080 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:49.627923 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac0492b-e2c5-4b5a-81d9-7748355e4080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:49.629590 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac0492b-e2c5-4b5a-81d9-7748355e4080 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:49.641388 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1286/2571] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:54:49.645500 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b61bb-839d-4ec8-9410-941ec4f31af7 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:49.656268 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b61bb-839d-4ec8-9410-941ec4f31af7 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:49.661212 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1ade5-944b-4989-b35f-6f4979d8db6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:49.661943 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1ade5-944b-4989-b35f-6f4979d8db6b admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:49.662285 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1ade5-944b-4989-b35f-6f4979d8db6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:49.662566 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1ade5-944b-4989-b35f-6f4979d8db6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:49.663295 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba1ade5-944b-4989-b35f-6f4979d8db6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:49.664922 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba1ade5-944b-4989-b35f-6f4979d8db6b admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:49.676653 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1286/2572] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:54:49.680917 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac0492b-e2c5-4b5a-81d9-7748355e4080 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:49.692345 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac0492b-e2c5-4b5a-81d9-7748355e4080 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:49.697177 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f08e30-43e0-4ea2-a952-543a397e4b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:49.697872 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f08e30-43e0-4ea2-a952-543a397e4b7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:49.698155 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f08e30-43e0-4ea2-a952-543a397e4b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:49.698431 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f08e30-43e0-4ea2-a952-543a397e4b7f admin admin] PATH_INFO: `/v3/projects/6622f49d72cf4c37bb978fcc6eaacb48/users/4c29ed76cff142eb9b277ea9635e65d3/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:49.714050 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f08e30-43e0-4ea2-a952-543a397e4b7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6622f49d72cf4c37bb978fcc6eaacb48, user_id=4c29ed76cff142eb9b277ea9635e65d3, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:49.716855 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f08e30-43e0-4ea2-a952-543a397e4b7f admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:49.790550 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1287/2573] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:54:49 2022] PUT /identity/v3/projects/6622f49d72cf4c37bb978fcc6eaacb48/users/4c29ed76cff142eb9b277ea9635e65d3/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:54:49.802838 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f0bcb-53f0-4b4f-8459-3db249e5c02a None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:49.803165 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f0bcb-53f0-4b4f-8459-3db249e5c02a None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:49.803468 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f0bcb-53f0-4b4f-8459-3db249e5c02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:49.836539 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-c46f0bcb-53f0-4b4f-8459-3db249e5c02a None None] MFA Rules not processed for user `4c29ed76cff142eb9b277ea9635e65d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:54:49.837761 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-c46f0bcb-53f0-4b4f-8459-3db249e5c02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:49.867254 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:54:49.902599 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1287/2574] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:54:49 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:54:49.907242 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f08e30-43e0-4ea2-a952-543a397e4b7f admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:49.969597 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f08e30-43e0-4ea2-a952-543a397e4b7f admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:49.974308 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e3a4d-e35e-4bc7-b9a4-115ae5aed83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:49.974926 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e3a4d-e35e-4bc7-b9a4-115ae5aed83e admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:49.975303 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e3a4d-e35e-4bc7-b9a4-115ae5aed83e admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:49.975582 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e3a4d-e35e-4bc7-b9a4-115ae5aed83e admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:49.976238 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e3a4d-e35e-4bc7-b9a4-115ae5aed83e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:49.978200 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e3a4d-e35e-4bc7-b9a4-115ae5aed83e admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:50.082906 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1288/2575] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:54:49 2022] POST /identity/v3/projects => generated 409 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:54:50.083060 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f0bcb-53f0-4b4f-8459-3db249e5c02a None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:50.093017 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f0bcb-53f0-4b4f-8459-3db249e5c02a None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:50.149537 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddad8ac-ecab-4083-8a1b-242ff9f89015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:50.150151 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddad8ac-ecab-4083-8a1b-242ff9f89015 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:50.150433 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddad8ac-ecab-4083-8a1b-242ff9f89015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:50.150706 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddad8ac-ecab-4083-8a1b-242ff9f89015 admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:50.151412 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddad8ac-ecab-4083-8a1b-242ff9f89015 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:50.153370 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddad8ac-ecab-4083-8a1b-242ff9f89015 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:50.254172 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1288/2576] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:54:50 2022] POST /identity/v3/users => generated 311 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:54:50.258106 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e3a4d-e35e-4bc7-b9a4-115ae5aed83e admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:50.268453 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e3a4d-e35e-4bc7-b9a4-115ae5aed83e admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:50.273533 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e12ea9-fbea-478c-89cb-f8b8f3285984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:50.274508 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e12ea9-fbea-478c-89cb-f8b8f3285984 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:50.274676 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e12ea9-fbea-478c-89cb-f8b8f3285984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:50.274968 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e12ea9-fbea-478c-89cb-f8b8f3285984 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:50.275674 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e12ea9-fbea-478c-89cb-f8b8f3285984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:50.277362 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e12ea9-fbea-478c-89cb-f8b8f3285984 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:50.288453 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1289/2577] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:54:50.292604 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddad8ac-ecab-4083-8a1b-242ff9f89015 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:50.303007 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddad8ac-ecab-4083-8a1b-242ff9f89015 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:50.307550 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469878c1-33de-4cfb-970b-7a651a9df574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:50.308210 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469878c1-33de-4cfb-970b-7a651a9df574 admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:50.308494 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469878c1-33de-4cfb-970b-7a651a9df574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:50.308773 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469878c1-33de-4cfb-970b-7a651a9df574 admin admin] PATH_INFO: `/v3/projects/f5dc678e1c3e4007ab8845b590045c3e/users/2431e143c8cf4dae9d48784e26366380/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:50.324173 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469878c1-33de-4cfb-970b-7a651a9df574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5dc678e1c3e4007ab8845b590045c3e, user_id=2431e143c8cf4dae9d48784e26366380, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:50.326887 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469878c1-33de-4cfb-970b-7a651a9df574 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:50.403957 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1289/2578] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:54:50 2022] PUT /identity/v3/projects/f5dc678e1c3e4007ab8845b590045c3e/users/2431e143c8cf4dae9d48784e26366380/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:54:50.408115 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e12ea9-fbea-478c-89cb-f8b8f3285984 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:50.423747 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e12ea9-fbea-478c-89cb-f8b8f3285984 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:50.494639 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb6e0f-0062-4b0b-a901-16633365aac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:50.495446 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb6e0f-0062-4b0b-a901-16633365aac2 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:50.501529 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb6e0f-0062-4b0b-a901-16633365aac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:50.501529 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb6e0f-0062-4b0b-a901-16633365aac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:50.501529 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eb6e0f-0062-4b0b-a901-16633365aac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:50.501529 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eb6e0f-0062-4b0b-a901-16633365aac2 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:50.503933 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:54:50.508943 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1290/2579] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:54:50.513365 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469878c1-33de-4cfb-970b-7a651a9df574 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:50.525100 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469878c1-33de-4cfb-970b-7a651a9df574 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:50.530351 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190afe5-6bec-4ed8-b694-e8e17110f749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:50.531054 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190afe5-6bec-4ed8-b694-e8e17110f749 admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:50.531332 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190afe5-6bec-4ed8-b694-e8e17110f749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:50.531604 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190afe5-6bec-4ed8-b694-e8e17110f749 admin admin] PATH_INFO: `/v3/projects/f5dc678e1c3e4007ab8845b590045c3e/users/2431e143c8cf4dae9d48784e26366380/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:50.533551 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2190afe5-6bec-4ed8-b694-e8e17110f749 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5dc678e1c3e4007ab8845b590045c3e, user_id=2431e143c8cf4dae9d48784e26366380, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:50.536204 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2190afe5-6bec-4ed8-b694-e8e17110f749 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:50.547001 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1290/2580] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:54:50 2022] PUT /identity/v3/projects/f5dc678e1c3e4007ab8845b590045c3e/users/2431e143c8cf4dae9d48784e26366380/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:54:50.557428 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c46752-585e-41b4-99b9-4109c2f36606 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:50.564094 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c46752-585e-41b4-99b9-4109c2f36606 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:50.565211 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c46752-585e-41b4-99b9-4109c2f36606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:50.599414 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-67c46752-585e-41b4-99b9-4109c2f36606 None None] MFA Rules not processed for user `2431e143c8cf4dae9d48784e26366380`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:54:50.600656 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-67c46752-585e-41b4-99b9-4109c2f36606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:50.679600 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1291/2581] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:54:50 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:54:50.690415 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190afe5-6bec-4ed8-b694-e8e17110f749 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:50.692223 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-2190afe5-6bec-4ed8-b694-e8e17110f749 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:50.755916 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190afe5-6bec-4ed8-b694-e8e17110f749 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:50.761142 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a49bb-cc78-407a-aaf7-2513ae01292d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:50.761936 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a49bb-cc78-407a-aaf7-2513ae01292d service cinder] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:50.762198 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a49bb-cc78-407a-aaf7-2513ae01292d service cinder] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:50.762468 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a49bb-cc78-407a-aaf7-2513ae01292d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:50.773783 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a49bb-cc78-407a-aaf7-2513ae01292d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:50.777697 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a49bb-cc78-407a-aaf7-2513ae01292d service cinder] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:50.786720 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1291/2582] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:54:50 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:54:51.171604 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c46752-585e-41b4-99b9-4109c2f36606 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:51.173207 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-67c46752-585e-41b4-99b9-4109c2f36606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:51.186346 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c46752-585e-41b4-99b9-4109c2f36606 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:51.190107 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c62c2-6776-4540-ab48-f8d015cf91f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:51.190847 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c62c2-6776-4540-ab48-f8d015cf91f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:51.191223 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c62c2-6776-4540-ab48-f8d015cf91f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:51.191572 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c62c2-6776-4540-ab48-f8d015cf91f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:51.254209 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8c62c2-6776-4540-ab48-f8d015cf91f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:51.255830 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8c62c2-6776-4540-ab48-f8d015cf91f4 service cinder] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:51.266241 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1292/2583] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:54:51 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:54:51.699813 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a49bb-cc78-407a-aaf7-2513ae01292d service cinder] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:51.701281 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-f38a49bb-cc78-407a-aaf7-2513ae01292d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:51.729198 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:54:51.766447 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a49bb-cc78-407a-aaf7-2513ae01292d service cinder] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:51.770983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b093f6-71ba-4729-be38-cff615a6f6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:51.771702 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b093f6-71ba-4729-be38-cff615a6f6e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:51.771980 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b093f6-71ba-4729-be38-cff615a6f6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:51.772254 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b093f6-71ba-4729-be38-cff615a6f6e0 admin admin] PATH_INFO: `/v3/users/a37f9814047045a9aa46a71bb3765c31` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:51.773414 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b093f6-71ba-4729-be38-cff615a6f6e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a37f9814047045a9aa46a71bb3765c31)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:51.775366 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b093f6-71ba-4729-be38-cff615a6f6e0 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:52.000212 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-84b093f6-71ba-4729-be38-cff615a6f6e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a37f9814047045a9aa46a71bb3765c31'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:52.088345 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-84b093f6-71ba-4729-be38-cff615a6f6e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a37f9814047045a9aa46a71bb3765c31'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:52.095331 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-84b093f6-71ba-4729-be38-cff615a6f6e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a37f9814047045a9aa46a71bb3765c31'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:52.108217 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-84b093f6-71ba-4729-be38-cff615a6f6e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a37f9814047045a9aa46a71bb3765c31'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:52.108955 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-84b093f6-71ba-4729-be38-cff615a6f6e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a37f9814047045a9aa46a71bb3765c31'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:52.115108 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1292/2584] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:54:51 2022] DELETE /identity/v3/users/a37f9814047045a9aa46a71bb3765c31 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:54:52.119660 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597a724-239a-4a65-8809-8ebe7c006e87 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:52.119953 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597a724-239a-4a65-8809-8ebe7c006e87 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:52.120231 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597a724-239a-4a65-8809-8ebe7c006e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:52.141783 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-1597a724-239a-4a65-8809-8ebe7c006e87 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:54:52.141783 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-1597a724-239a-4a65-8809-8ebe7c006e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:52.197584 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1293/2585] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:54:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:54:52.207314 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b093f6-71ba-4729-be38-cff615a6f6e0 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:52.208739 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-84b093f6-71ba-4729-be38-cff615a6f6e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:52.266153 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b093f6-71ba-4729-be38-cff615a6f6e0 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:52.270053 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ff0c3-27c3-4992-89d0-43e0e496acef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:52.270673 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ff0c3-27c3-4992-89d0-43e0e496acef service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:52.270971 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ff0c3-27c3-4992-89d0-43e0e496acef service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:52.271247 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ff0c3-27c3-4992-89d0-43e0e496acef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:52.281350 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ff0c3-27c3-4992-89d0-43e0e496acef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:52.282776 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ff0c3-27c3-4992-89d0-43e0e496acef service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:52.292218 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1293/2586] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:54:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:54:52.975033 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597a724-239a-4a65-8809-8ebe7c006e87 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:52.976461 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-1597a724-239a-4a65-8809-8ebe7c006e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:52.990398 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597a724-239a-4a65-8809-8ebe7c006e87 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:52.995218 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922f43c-1d94-42cc-ab6a-fe6105c99337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:52.995861 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922f43c-1d94-42cc-ab6a-fe6105c99337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:52.996138 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922f43c-1d94-42cc-ab6a-fe6105c99337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:52.996414 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922f43c-1d94-42cc-ab6a-fe6105c99337 admin admin] PATH_INFO: `/v3/projects/39e6a3e0e11849f2b8f17e285b956d90` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:52.997582 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922f43c-1d94-42cc-ab6a-fe6105c99337 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39e6a3e0e11849f2b8f17e285b956d90)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:53.005014 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922f43c-1d94-42cc-ab6a-fe6105c99337 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:53.021112 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:54:53.129858 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-4922f43c-1d94-42cc-ab6a-fe6105c99337 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39e6a3e0e11849f2b8f17e285b956d90', 'request_id': 'req-4922f43c-1d94-42cc-ab6a-fe6105c99337'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:53.224730 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-4922f43c-1d94-42cc-ab6a-fe6105c99337 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39e6a3e0e11849f2b8f17e285b956d90', 'request_id': 'req-4922f43c-1d94-42cc-ab6a-fe6105c99337'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:53.230636 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-4922f43c-1d94-42cc-ab6a-fe6105c99337 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39e6a3e0e11849f2b8f17e285b956d90', 'request_id': 'req-4922f43c-1d94-42cc-ab6a-fe6105c99337'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:53.242451 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-4922f43c-1d94-42cc-ab6a-fe6105c99337 admin admin] The token cache is being invalidate because project 39e6a3e0e11849f2b8f17e285b956d90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:54:53.242739 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-4922f43c-1d94-42cc-ab6a-fe6105c99337 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:53.243385 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-4922f43c-1d94-42cc-ab6a-fe6105c99337 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:53.244887 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1294/2587] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:54:52 2022] DELETE /identity/v3/projects/39e6a3e0e11849f2b8f17e285b956d90 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:54:53.249438 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ff0c3-27c3-4992-89d0-43e0e496acef service neutron] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:53.258920 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ff0c3-27c3-4992-89d0-43e0e496acef service neutron] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:53.302905 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:54:53.315864 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb1426-b20d-4013-9081-f71133ed99c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:53.316506 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb1426-b20d-4013-9081-f71133ed99c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:53.316789 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb1426-b20d-4013-9081-f71133ed99c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:53.317070 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb1426-b20d-4013-9081-f71133ed99c7 admin admin] PATH_INFO: `/v3/users/b8e5bbf87c2543cdad073d99894b1ccb` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:53.318232 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb1426-b20d-4013-9081-f71133ed99c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8e5bbf87c2543cdad073d99894b1ccb)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:53.320159 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb1426-b20d-4013-9081-f71133ed99c7 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:53.491405 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-eecb1426-b20d-4013-9081-f71133ed99c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8e5bbf87c2543cdad073d99894b1ccb'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:53.572961 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-eecb1426-b20d-4013-9081-f71133ed99c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8e5bbf87c2543cdad073d99894b1ccb'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:53.580291 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-eecb1426-b20d-4013-9081-f71133ed99c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8e5bbf87c2543cdad073d99894b1ccb'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:53.592892 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-eecb1426-b20d-4013-9081-f71133ed99c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8e5bbf87c2543cdad073d99894b1ccb'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:53.594345 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-eecb1426-b20d-4013-9081-f71133ed99c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8e5bbf87c2543cdad073d99894b1ccb'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:53.604244 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1294/2588] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:54:53 2022] DELETE /identity/v3/users/b8e5bbf87c2543cdad073d99894b1ccb => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:54:53.871532 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922f43c-1d94-42cc-ab6a-fe6105c99337 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:53.873033 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-4922f43c-1d94-42cc-ab6a-fe6105c99337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:53.937800 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922f43c-1d94-42cc-ab6a-fe6105c99337 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:53.990155 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92a45e8-45c8-4a24-b9fb-6411ef3d14a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:53.990779 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a45e8-45c8-4a24-b9fb-6411ef3d14a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:53.991096 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a45e8-45c8-4a24-b9fb-6411ef3d14a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:53.991372 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a45e8-45c8-4a24-b9fb-6411ef3d14a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:53.993108 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-f92a45e8-45c8-4a24-b9fb-6411ef3d14a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:54.050588 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb1426-b20d-4013-9081-f71133ed99c7 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:54.052130 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-eecb1426-b20d-4013-9081-f71133ed99c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:54.061875 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92a45e8-45c8-4a24-b9fb-6411ef3d14a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:54.063168 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92a45e8-45c8-4a24-b9fb-6411ef3d14a7 service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:54.067061 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb1426-b20d-4013-9081-f71133ed99c7 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:54.074565 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1295/2589] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:54:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:54:54.075341 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e0cce-ac97-4907-8162-3ddd00dfa8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:54.076005 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e0cce-ac97-4907-8162-3ddd00dfa8ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:54.076866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e0cce-ac97-4907-8162-3ddd00dfa8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:54.077327 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e0cce-ac97-4907-8162-3ddd00dfa8ae admin admin] PATH_INFO: `/v3/projects/808a3f2554034df2b5ea436852f02418` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:54.078559 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928e0cce-ac97-4907-8162-3ddd00dfa8ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=808a3f2554034df2b5ea436852f02418)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:54.082570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928e0cce-ac97-4907-8162-3ddd00dfa8ae admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:54.229702 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-928e0cce-ac97-4907-8162-3ddd00dfa8ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '808a3f2554034df2b5ea436852f02418', 'request_id': 'req-928e0cce-ac97-4907-8162-3ddd00dfa8ae'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:54.287565 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-928e0cce-ac97-4907-8162-3ddd00dfa8ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '808a3f2554034df2b5ea436852f02418', 'request_id': 'req-928e0cce-ac97-4907-8162-3ddd00dfa8ae'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:54.299799 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-928e0cce-ac97-4907-8162-3ddd00dfa8ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '808a3f2554034df2b5ea436852f02418', 'request_id': 'req-928e0cce-ac97-4907-8162-3ddd00dfa8ae'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:54.305579 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-928e0cce-ac97-4907-8162-3ddd00dfa8ae admin admin] The token cache is being invalidate because project 808a3f2554034df2b5ea436852f02418 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:54:54.305875 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-928e0cce-ac97-4907-8162-3ddd00dfa8ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:54.306527 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-928e0cce-ac97-4907-8162-3ddd00dfa8ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:54.308060 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1295/2590] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:54:54 2022] DELETE /identity/v3/projects/808a3f2554034df2b5ea436852f02418 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:54:54.313600 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b5d0e-3af5-49ef-a6c0-402757a08ebb None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:54.314097 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b5d0e-3af5-49ef-a6c0-402757a08ebb None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:54.314197 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b5d0e-3af5-49ef-a6c0-402757a08ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:54.334711 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-f62b5d0e-3af5-49ef-a6c0-402757a08ebb None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:54:54.336045 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-f62b5d0e-3af5-49ef-a6c0-402757a08ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:54.344518 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:54:54.394531 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1296/2591] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:54:54.403543 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb4a81-8d18-4541-a9a8-a825db566233 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:54.403825 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb4a81-8d18-4541-a9a8-a825db566233 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:54.404099 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb4a81-8d18-4541-a9a8-a825db566233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:54.423820 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-a4eb4a81-8d18-4541-a9a8-a825db566233 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:54:54.425069 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-a4eb4a81-8d18-4541-a9a8-a825db566233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:54.433258 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1296/2592] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:54:54.438118 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b5d0e-3af5-49ef-a6c0-402757a08ebb None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:54.448460 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b5d0e-3af5-49ef-a6c0-402757a08ebb None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:54.453709 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2b98a-8d73-4111-a6f2-6b88fb88f64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:54.454317 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2b98a-8d73-4111-a6f2-6b88fb88f64c admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:54.454593 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2b98a-8d73-4111-a6f2-6b88fb88f64c admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:54.454860 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2b98a-8d73-4111-a6f2-6b88fb88f64c admin admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:54.455643 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f2b98a-8d73-4111-a6f2-6b88fb88f64c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:54:54.455944 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f2b98a-8d73-4111-a6f2-6b88fb88f64c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:54.457560 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f2b98a-8d73-4111-a6f2-6b88fb88f64c admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:54.468992 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1297/2593] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:54:54.473433 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb4a81-8d18-4541-a9a8-a825db566233 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:54.483427 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb4a81-8d18-4541-a9a8-a825db566233 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:54.488443 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb557b9-9d02-42b3-a6fa-fc321b5b5bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:54.489053 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb557b9-9d02-42b3-a6fa-fc321b5b5bfc admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:54.489330 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb557b9-9d02-42b3-a6fa-fc321b5b5bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:54.489605 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb557b9-9d02-42b3-a6fa-fc321b5b5bfc admin admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:54.490273 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb557b9-9d02-42b3-a6fa-fc321b5b5bfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:54.492202 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb557b9-9d02-42b3-a6fa-fc321b5b5bfc admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:54.557876 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1297/2594] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:54:54 2022] POST /identity/v3/projects => generated 379 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:54:54.563359 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2b98a-8d73-4111-a6f2-6b88fb88f64c admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:54.574100 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2b98a-8d73-4111-a6f2-6b88fb88f64c admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:54.636027 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb8374-072d-416a-a92e-dc0337063a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:54.636322 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb8374-072d-416a-a92e-dc0337063a27 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:54.636613 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb8374-072d-416a-a92e-dc0337063a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:54.636893 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb8374-072d-416a-a92e-dc0337063a27 admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:54.637570 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb8374-072d-416a-a92e-dc0337063a27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:54.639582 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb8374-072d-416a-a92e-dc0337063a27 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:54.713576 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1298/2595] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:54:54 2022] POST /identity/v3/users => generated 290 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:54:54.717867 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb557b9-9d02-42b3-a6fa-fc321b5b5bfc admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:54.731637 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb557b9-9d02-42b3-a6fa-fc321b5b5bfc admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:54.737406 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c255479-9cef-4edb-be22-7ab9f59f0641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:54.738051 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c255479-9cef-4edb-be22-7ab9f59f0641 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:54.738334 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c255479-9cef-4edb-be22-7ab9f59f0641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:54.738714 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c255479-9cef-4edb-be22-7ab9f59f0641 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:54.739460 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c255479-9cef-4edb-be22-7ab9f59f0641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:54.741056 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c255479-9cef-4edb-be22-7ab9f59f0641 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:54.752311 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1298/2596] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:54:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:54:54.756927 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb8374-072d-416a-a92e-dc0337063a27 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:54.767354 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb8374-072d-416a-a92e-dc0337063a27 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:54.771994 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b8feb-ba42-47af-aab9-6c5319360047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:54.772603 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b8feb-ba42-47af-aab9-6c5319360047 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:54.772886 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b8feb-ba42-47af-aab9-6c5319360047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:54.773161 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b8feb-ba42-47af-aab9-6c5319360047 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:54.773848 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75b8feb-ba42-47af-aab9-6c5319360047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:54.775486 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75b8feb-ba42-47af-aab9-6c5319360047 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:54.787618 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1299/2597] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:54:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:54:54.792997 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c255479-9cef-4edb-be22-7ab9f59f0641 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:54.804013 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c255479-9cef-4edb-be22-7ab9f59f0641 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:54.819803 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6829873-bb2b-4b8b-b461-3fc647ff4796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:54.819803 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6829873-bb2b-4b8b-b461-3fc647ff4796 admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:54.819803 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6829873-bb2b-4b8b-b461-3fc647ff4796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:54.819803 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6829873-bb2b-4b8b-b461-3fc647ff4796 admin admin] PATH_INFO: `/v3/projects/8ae967175cb0469b89bef23a39caf2aa/users/0ac4e1556298408c8f024fca923da13c/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:54.820240 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:54:54.827489 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6829873-bb2b-4b8b-b461-3fc647ff4796 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ae967175cb0469b89bef23a39caf2aa, user_id=0ac4e1556298408c8f024fca923da13c, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:54.830140 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6829873-bb2b-4b8b-b461-3fc647ff4796 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:54.900136 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1299/2598] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:54:54 2022] PUT /identity/v3/projects/8ae967175cb0469b89bef23a39caf2aa/users/0ac4e1556298408c8f024fca923da13c/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:54:54.911178 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157edea-2b30-4757-8094-5e288b8d97fc None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:54.911473 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157edea-2b30-4757-8094-5e288b8d97fc None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:54.911751 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157edea-2b30-4757-8094-5e288b8d97fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:54.941147 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-5157edea-2b30-4757-8094-5e288b8d97fc None None] MFA Rules not processed for user `0ac4e1556298408c8f024fca923da13c`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:54:54.942590 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-5157edea-2b30-4757-8094-5e288b8d97fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:55.015818 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1300/2599] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:54:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:54:55.020237 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6829873-bb2b-4b8b-b461-3fc647ff4796 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:55.099670 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6829873-bb2b-4b8b-b461-3fc647ff4796 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:55.104856 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f7af6d-c211-4ca3-bf3f-4926b8fb2301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:55.108774 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7af6d-c211-4ca3-bf3f-4926b8fb2301 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:55.108774 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7af6d-c211-4ca3-bf3f-4926b8fb2301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:55.108774 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7af6d-c211-4ca3-bf3f-4926b8fb2301 admin admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:55.108774 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f7af6d-c211-4ca3-bf3f-4926b8fb2301 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:55.109447 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f7af6d-c211-4ca3-bf3f-4926b8fb2301 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:55.215485 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1300/2600] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:54:55 2022] POST /identity/v3/projects => generated 379 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:54:55.220211 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5157edea-2b30-4757-8094-5e288b8d97fc None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:55.232473 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5157edea-2b30-4757-8094-5e288b8d97fc None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:55.244893 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:54:55.318748 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848d699-d0b8-4c76-93ad-9cc49c8f5fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:55.319460 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848d699-d0b8-4c76-93ad-9cc49c8f5fcf admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:55.320075 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848d699-d0b8-4c76-93ad-9cc49c8f5fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:55.320429 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848d699-d0b8-4c76-93ad-9cc49c8f5fcf admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:55.321087 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e848d699-d0b8-4c76-93ad-9cc49c8f5fcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:55.324402 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e848d699-d0b8-4c76-93ad-9cc49c8f5fcf admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:55.441641 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1301/2601] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:54:55 2022] POST /identity/v3/users => generated 290 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:54:55.442395 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f7af6d-c211-4ca3-bf3f-4926b8fb2301 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:55.459362 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f7af6d-c211-4ca3-bf3f-4926b8fb2301 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:55.472017 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bf203-c038-4f47-b45b-e5b387faaff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:55.473045 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bf203-c038-4f47-b45b-e5b387faaff6 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:55.473344 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bf203-c038-4f47-b45b-e5b387faaff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:55.473626 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bf203-c038-4f47-b45b-e5b387faaff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:55.474695 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978bf203-c038-4f47-b45b-e5b387faaff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:55.476528 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978bf203-c038-4f47-b45b-e5b387faaff6 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:55.493411 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1301/2602] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:54:55.494744 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848d699-d0b8-4c76-93ad-9cc49c8f5fcf admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:55.511085 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848d699-d0b8-4c76-93ad-9cc49c8f5fcf admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:55.518230 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413f10f-446b-4411-9bb3-d3a097c6f053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:55.518902 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413f10f-446b-4411-9bb3-d3a097c6f053 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:55.519234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413f10f-446b-4411-9bb3-d3a097c6f053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:55.519514 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413f10f-446b-4411-9bb3-d3a097c6f053 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:55.520230 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413f10f-446b-4411-9bb3-d3a097c6f053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:55.521896 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413f10f-446b-4411-9bb3-d3a097c6f053 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:55.533412 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1302/2603] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:54:55.537738 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bf203-c038-4f47-b45b-e5b387faaff6 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:55.548899 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bf203-c038-4f47-b45b-e5b387faaff6 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:55.553997 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374139f8-3229-4e8c-ba1d-fafba3106c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:55.554654 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374139f8-3229-4e8c-ba1d-fafba3106c99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:55.554930 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374139f8-3229-4e8c-ba1d-fafba3106c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:55.555236 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374139f8-3229-4e8c-ba1d-fafba3106c99 admin admin] PATH_INFO: `/v3/projects/c643024799ab44eca5564ca869e69413/users/6e5ce001ce3b4580b49e44bdc0975e23/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:55.570063 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374139f8-3229-4e8c-ba1d-fafba3106c99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c643024799ab44eca5564ca869e69413, user_id=6e5ce001ce3b4580b49e44bdc0975e23, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:55.573112 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374139f8-3229-4e8c-ba1d-fafba3106c99 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:55.636845 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1302/2604] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:54:55 2022] PUT /identity/v3/projects/c643024799ab44eca5564ca869e69413/users/6e5ce001ce3b4580b49e44bdc0975e23/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:54:55.647639 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05861eb3-c8f9-47b6-b259-af8895710235 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:55.648029 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05861eb3-c8f9-47b6-b259-af8895710235 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:55.648312 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05861eb3-c8f9-47b6-b259-af8895710235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:55.676787 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-05861eb3-c8f9-47b6-b259-af8895710235 None None] MFA Rules not processed for user `6e5ce001ce3b4580b49e44bdc0975e23`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:54:55.678050 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-05861eb3-c8f9-47b6-b259-af8895710235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:55.743840 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1303/2605] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:54:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:54:55.749173 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374139f8-3229-4e8c-ba1d-fafba3106c99 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:55.818770 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374139f8-3229-4e8c-ba1d-fafba3106c99 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:55.823577 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20954f1d-de1c-48c2-b765-ee8bbffba3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:55.824206 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20954f1d-de1c-48c2-b765-ee8bbffba3a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:55.824488 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20954f1d-de1c-48c2-b765-ee8bbffba3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:55.824768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20954f1d-de1c-48c2-b765-ee8bbffba3a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:55.825437 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20954f1d-de1c-48c2-b765-ee8bbffba3a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:55.830259 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20954f1d-de1c-48c2-b765-ee8bbffba3a4 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:55.934624 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1303/2606] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:54:55 2022] POST /identity/v3/projects => generated 377 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:54:55.939468 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05861eb3-c8f9-47b6-b259-af8895710235 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:55.950427 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05861eb3-c8f9-47b6-b259-af8895710235 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:56.016339 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52167900-2ef8-44e9-958b-502feb517ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:56.016982 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52167900-2ef8-44e9-958b-502feb517ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:56.017267 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52167900-2ef8-44e9-958b-502feb517ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:56.017547 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52167900-2ef8-44e9-958b-502feb517ea4 admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:56.018228 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52167900-2ef8-44e9-958b-502feb517ea4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:56.020384 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52167900-2ef8-44e9-958b-502feb517ea4 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:56.101690 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1304/2607] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:54:55 2022] POST /identity/v3/users => generated 295 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:54:56.105984 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20954f1d-de1c-48c2-b765-ee8bbffba3a4 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:56.118862 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20954f1d-de1c-48c2-b765-ee8bbffba3a4 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:56.125100 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c24e2e-6140-48c8-8650-71f8013bfb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:56.126038 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c24e2e-6140-48c8-8650-71f8013bfb3b admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:56.126626 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c24e2e-6140-48c8-8650-71f8013bfb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:56.127253 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c24e2e-6140-48c8-8650-71f8013bfb3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:56.128186 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c24e2e-6140-48c8-8650-71f8013bfb3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:56.130090 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c24e2e-6140-48c8-8650-71f8013bfb3b admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:56.143514 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1304/2608] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:54:56.149805 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52167900-2ef8-44e9-958b-502feb517ea4 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:56.160559 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52167900-2ef8-44e9-958b-502feb517ea4 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:56.169868 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e71c9f-0624-44a7-8165-d931844e1e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:56.171602 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e71c9f-0624-44a7-8165-d931844e1e5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:56.172084 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e71c9f-0624-44a7-8165-d931844e1e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:56.172766 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e71c9f-0624-44a7-8165-d931844e1e5c admin admin] PATH_INFO: `/v3/projects/7c0bb76313e64725a62e1acd08fde0e2/users/4eb420cd476340d39dce7cd50f5344f6/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:56.176421 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:54:56.328279 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e71c9f-0624-44a7-8165-d931844e1e5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c0bb76313e64725a62e1acd08fde0e2, user_id=4eb420cd476340d39dce7cd50f5344f6, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:56.331151 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e71c9f-0624-44a7-8165-d931844e1e5c admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:56.397106 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1305/2609] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:54:56 2022] PUT /identity/v3/projects/7c0bb76313e64725a62e1acd08fde0e2/users/4eb420cd476340d39dce7cd50f5344f6/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:54:56.401186 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c24e2e-6140-48c8-8650-71f8013bfb3b admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:56.412104 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c24e2e-6140-48c8-8650-71f8013bfb3b admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:56.417359 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:54:56.468060 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2174606c-a7a8-435d-af02-102c9c52f473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:56.468717 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174606c-a7a8-435d-af02-102c9c52f473 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:56.468929 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174606c-a7a8-435d-af02-102c9c52f473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:56.469266 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174606c-a7a8-435d-af02-102c9c52f473 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:56.469952 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2174606c-a7a8-435d-af02-102c9c52f473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:56.471671 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2174606c-a7a8-435d-af02-102c9c52f473 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:56.481162 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1305/2610] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:54:56.486222 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e71c9f-0624-44a7-8165-d931844e1e5c admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:56.496512 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e71c9f-0624-44a7-8165-d931844e1e5c admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:56.501316 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e59fe-10d0-4132-9207-c1e649f97597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:56.501981 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e59fe-10d0-4132-9207-c1e649f97597 admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:56.502264 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e59fe-10d0-4132-9207-c1e649f97597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:56.502612 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e59fe-10d0-4132-9207-c1e649f97597 admin admin] PATH_INFO: `/v3/projects/7c0bb76313e64725a62e1acd08fde0e2/users/4eb420cd476340d39dce7cd50f5344f6/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:56.505007 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520e59fe-10d0-4132-9207-c1e649f97597 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c0bb76313e64725a62e1acd08fde0e2, user_id=4eb420cd476340d39dce7cd50f5344f6, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:56.507740 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520e59fe-10d0-4132-9207-c1e649f97597 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:56.519997 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1306/2611] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:54:56 2022] PUT /identity/v3/projects/7c0bb76313e64725a62e1acd08fde0e2/users/4eb420cd476340d39dce7cd50f5344f6/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:54:56.531634 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d090770-5896-4b71-8d87-09fc30ff2c1c None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:56.535095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d090770-5896-4b71-8d87-09fc30ff2c1c None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:56.535095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d090770-5896-4b71-8d87-09fc30ff2c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:56.567887 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-3d090770-5896-4b71-8d87-09fc30ff2c1c None None] MFA Rules not processed for user `4eb420cd476340d39dce7cd50f5344f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:54:56.571632 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-3d090770-5896-4b71-8d87-09fc30ff2c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:56.645778 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1306/2612] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:54:56 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:54:56.658363 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e59fe-10d0-4132-9207-c1e649f97597 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:56.660057 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-520e59fe-10d0-4132-9207-c1e649f97597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:56.743680 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e59fe-10d0-4132-9207-c1e649f97597 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:56.751732 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdfc32b-fb5f-45c1-bc65-52e41bc10a52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:56.752360 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfc32b-fb5f-45c1-bc65-52e41bc10a52 service cinder] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:56.752634 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfc32b-fb5f-45c1-bc65-52e41bc10a52 service cinder] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:56.752912 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfc32b-fb5f-45c1-bc65-52e41bc10a52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:56.769162 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdfc32b-fb5f-45c1-bc65-52e41bc10a52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:56.770868 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdfc32b-fb5f-45c1-bc65-52e41bc10a52 service cinder] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:56.782536 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1307/2613] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:54:56 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:54:56.903825 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d090770-5896-4b71-8d87-09fc30ff2c1c None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:56.905826 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-3d090770-5896-4b71-8d87-09fc30ff2c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:56.917537 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d090770-5896-4b71-8d87-09fc30ff2c1c None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:56.921260 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e04c04c-29d7-47b5-b736-3db7ca61a345 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:56.921865 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04c04c-29d7-47b5-b736-3db7ca61a345 service cinder] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:56.922142 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04c04c-29d7-47b5-b736-3db7ca61a345 service cinder] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:56.922414 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04c04c-29d7-47b5-b736-3db7ca61a345 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:56.979276 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e04c04c-29d7-47b5-b736-3db7ca61a345 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:56.980942 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e04c04c-29d7-47b5-b736-3db7ca61a345 service cinder] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:56.990693 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1307/2614] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:54:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:54:57.762393 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdfc32b-fb5f-45c1-bc65-52e41bc10a52 service cinder] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:57.764183 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-ccdfc32b-fb5f-45c1-bc65-52e41bc10a52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:57.880597 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdfc32b-fb5f-45c1-bc65-52e41bc10a52 service cinder] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:57.887075 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704ec2d2-9c2a-478b-b1e1-881c718e0a9b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647f2cb18a41d6a9e124e886faa994', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:57.888088 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ec2d2-9c2a-478b-b1e1-881c718e0a9b service placement] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:57.888795 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ec2d2-9c2a-478b-b1e1-881c718e0a9b service placement] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:57.889167 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ec2d2-9c2a-478b-b1e1-881c718e0a9b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:57.893245 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-704ec2d2-9c2a-478b-b1e1-881c718e0a9b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:57.907063 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e04c04c-29d7-47b5-b736-3db7ca61a345 service cinder] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:57.908633 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-4e04c04c-29d7-47b5-b736-3db7ca61a345 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:57.912032 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704ec2d2-9c2a-478b-b1e1-881c718e0a9b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:57.913698 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704ec2d2-9c2a-478b-b1e1-881c718e0a9b service placement] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:57.925084 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1308/2615] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:54:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:54:57.950368 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=100 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:54:57.985486 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e04c04c-29d7-47b5-b736-3db7ca61a345 service cinder] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:57.990060 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9b966-6546-49f4-9130-66bab58f2be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:57.990701 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9b966-6546-49f4-9130-66bab58f2be9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:57.991039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9b966-6546-49f4-9130-66bab58f2be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:57.991321 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9b966-6546-49f4-9130-66bab58f2be9 admin admin] PATH_INFO: `/v3/users/16970234a29e41cf8639b6ffc1aeadaf` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:57.992496 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca9b966-6546-49f4-9130-66bab58f2be9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16970234a29e41cf8639b6ffc1aeadaf)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:57.994473 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca9b966-6546-49f4-9130-66bab58f2be9 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:58.221709 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-dca9b966-6546-49f4-9130-66bab58f2be9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16970234a29e41cf8639b6ffc1aeadaf'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:58.293554 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-dca9b966-6546-49f4-9130-66bab58f2be9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16970234a29e41cf8639b6ffc1aeadaf'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:58.301124 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-dca9b966-6546-49f4-9130-66bab58f2be9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16970234a29e41cf8639b6ffc1aeadaf'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:58.312919 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-dca9b966-6546-49f4-9130-66bab58f2be9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16970234a29e41cf8639b6ffc1aeadaf'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:58.313551 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-dca9b966-6546-49f4-9130-66bab58f2be9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16970234a29e41cf8639b6ffc1aeadaf'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:58.319830 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1308/2616] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:54:57 2022] DELETE /identity/v3/users/16970234a29e41cf8639b6ffc1aeadaf => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:54:58.501798 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704ec2d2-9c2a-478b-b1e1-881c718e0a9b service placement] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:58.503231 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-704ec2d2-9c2a-478b-b1e1-881c718e0a9b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:58.516171 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704ec2d2-9c2a-478b-b1e1-881c718e0a9b service placement] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:58.570253 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9b966-6546-49f4-9130-66bab58f2be9 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:58.571745 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-dca9b966-6546-49f4-9130-66bab58f2be9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:58.572757 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8d6f0-9c16-4769-ad0b-cffeee7a5861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:58.573402 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8d6f0-9c16-4769-ad0b-cffeee7a5861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:58.573928 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8d6f0-9c16-4769-ad0b-cffeee7a5861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:58.574212 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8d6f0-9c16-4769-ad0b-cffeee7a5861 admin admin] PATH_INFO: `/v3/users/4c29ed76cff142eb9b277ea9635e65d3` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:58.575951 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba8d6f0-9c16-4769-ad0b-cffeee7a5861 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c29ed76cff142eb9b277ea9635e65d3)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:58.578269 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba8d6f0-9c16-4769-ad0b-cffeee7a5861 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:58.583727 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:54:58.590922 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9b966-6546-49f4-9130-66bab58f2be9 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:58.596122 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d04a2d-3a71-47fa-9307-a2074cee6590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:58.596782 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d04a2d-3a71-47fa-9307-a2074cee6590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:58.597179 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d04a2d-3a71-47fa-9307-a2074cee6590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:58.597356 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d04a2d-3a71-47fa-9307-a2074cee6590 admin admin] PATH_INFO: `/v3/projects/f2f7c0825ea64f44a5be7e3190b752b0` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:58.598727 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d04a2d-3a71-47fa-9307-a2074cee6590 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2f7c0825ea64f44a5be7e3190b752b0)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:58.600576 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d04a2d-3a71-47fa-9307-a2074cee6590 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:58.737681 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-d2d04a2d-3a71-47fa-9307-a2074cee6590 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2f7c0825ea64f44a5be7e3190b752b0', 'request_id': 'req-d2d04a2d-3a71-47fa-9307-a2074cee6590'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:58.737984 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-5ba8d6f0-9c16-4769-ad0b-cffeee7a5861 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c29ed76cff142eb9b277ea9635e65d3'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:58.826692 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-5ba8d6f0-9c16-4769-ad0b-cffeee7a5861 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c29ed76cff142eb9b277ea9635e65d3'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:58.835188 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-5ba8d6f0-9c16-4769-ad0b-cffeee7a5861 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c29ed76cff142eb9b277ea9635e65d3'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:58.841490 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-5ba8d6f0-9c16-4769-ad0b-cffeee7a5861 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c29ed76cff142eb9b277ea9635e65d3'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:58.854871 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-5ba8d6f0-9c16-4769-ad0b-cffeee7a5861 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c29ed76cff142eb9b277ea9635e65d3'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:58.861408 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1309/2617] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:54:58 2022] DELETE /identity/v3/users/4c29ed76cff142eb9b277ea9635e65d3 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:54:58.865932 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35887897-a48b-4ab7-99ba-0778471359a8 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:58.866280 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35887897-a48b-4ab7-99ba-0778471359a8 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:58.866558 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35887897-a48b-4ab7-99ba-0778471359a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:58.876624 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-d2d04a2d-3a71-47fa-9307-a2074cee6590 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2f7c0825ea64f44a5be7e3190b752b0', 'request_id': 'req-d2d04a2d-3a71-47fa-9307-a2074cee6590'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:58.883589 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-d2d04a2d-3a71-47fa-9307-a2074cee6590 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2f7c0825ea64f44a5be7e3190b752b0', 'request_id': 'req-d2d04a2d-3a71-47fa-9307-a2074cee6590'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:58.885780 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-35887897-a48b-4ab7-99ba-0778471359a8 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:54:58.887095 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-35887897-a48b-4ab7-99ba-0778471359a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:58.896263 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-d2d04a2d-3a71-47fa-9307-a2074cee6590 admin admin] The token cache is being invalidate because project f2f7c0825ea64f44a5be7e3190b752b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:54:58.896551 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-d2d04a2d-3a71-47fa-9307-a2074cee6590 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:58.897317 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-d2d04a2d-3a71-47fa-9307-a2074cee6590 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:58.898812 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1309/2618] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:54:58 2022] DELETE /identity/v3/projects/f2f7c0825ea64f44a5be7e3190b752b0 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:54:58.903484 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60650c-afd2-4950-9958-aa43117fafdd None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:58.903774 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60650c-afd2-4950-9958-aa43117fafdd None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:58.904165 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60650c-afd2-4950-9958-aa43117fafdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:58.923150 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-4a60650c-afd2-4950-9958-aa43117fafdd None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:54:58.924352 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-4a60650c-afd2-4950-9958-aa43117fafdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:58.957169 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1310/2619] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:54:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:54:58.957294 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:54:58.967700 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35887897-a48b-4ab7-99ba-0778471359a8 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:58.969665 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-35887897-a48b-4ab7-99ba-0778471359a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:58.991022 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1310/2620] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:54:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:54:59.000356 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c772ce-fa64-440d-bef7-302a686c1d36 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:59.000640 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c772ce-fa64-440d-bef7-302a686c1d36 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:59.000964 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c772ce-fa64-440d-bef7-302a686c1d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:59.020333 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-13c772ce-fa64-440d-bef7-302a686c1d36 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:54:59.021536 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-13c772ce-fa64-440d-bef7-302a686c1d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:59.033991 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1311/2621] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:54:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:54:59.035149 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c772ce-fa64-440d-bef7-302a686c1d36 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:59.035521 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35887897-a48b-4ab7-99ba-0778471359a8 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:59.040140 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f9877-a1ee-419e-9638-0d90e98817a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:59.044176 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f9877-a1ee-419e-9638-0d90e98817a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:59.044176 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f9877-a1ee-419e-9638-0d90e98817a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:59.044176 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f9877-a1ee-419e-9638-0d90e98817a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:59.044749 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c772ce-fa64-440d-bef7-302a686c1d36 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:59.050111 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5362a-2cfe-45e8-81a8-0dad04619490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:59.050720 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5362a-2cfe-45e8-81a8-0dad04619490 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:59.051049 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5362a-2cfe-45e8-81a8-0dad04619490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:59.051309 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5362a-2cfe-45e8-81a8-0dad04619490 admin admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:59.051828 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f9877-a1ee-419e-9638-0d90e98817a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:59.052215 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f5362a-2cfe-45e8-81a8-0dad04619490 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:54:59.052732 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f5362a-2cfe-45e8-81a8-0dad04619490 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:59.053308 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f9877-a1ee-419e-9638-0d90e98817a5 service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:59.054835 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f5362a-2cfe-45e8-81a8-0dad04619490 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:59.064153 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1311/2622] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:54:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:54:59.067146 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1312/2623] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:54:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:54:59.071441 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f9877-a1ee-419e-9638-0d90e98817a5 service neutron] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:59.080915 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f9877-a1ee-419e-9638-0d90e98817a5 service neutron] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:59.085649 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108237eb-e940-427e-a6a6-121aa9288ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:59.086273 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108237eb-e940-427e-a6a6-121aa9288ace admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:59.086556 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108237eb-e940-427e-a6a6-121aa9288ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:59.086830 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108237eb-e940-427e-a6a6-121aa9288ace admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:59.087530 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108237eb-e940-427e-a6a6-121aa9288ace admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:59.092412 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108237eb-e940-427e-a6a6-121aa9288ace admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:59.169681 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1312/2624] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:54:59 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:54:59.175211 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5362a-2cfe-45e8-81a8-0dad04619490 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:59.187005 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5362a-2cfe-45e8-81a8-0dad04619490 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:59.247053 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe095e7-9e5d-4e44-93aa-ccfa5d222d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:59.247677 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe095e7-9e5d-4e44-93aa-ccfa5d222d56 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:59.247956 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe095e7-9e5d-4e44-93aa-ccfa5d222d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:59.248228 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe095e7-9e5d-4e44-93aa-ccfa5d222d56 admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:59.249555 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe095e7-9e5d-4e44-93aa-ccfa5d222d56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:59.251465 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe095e7-9e5d-4e44-93aa-ccfa5d222d56 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:59.375797 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1313/2625] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:54:59 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:54:59.379586 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108237eb-e940-427e-a6a6-121aa9288ace admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:59.385155 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:54:59.390446 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108237eb-e940-427e-a6a6-121aa9288ace admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:59.395043 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f4e5f-2dbf-4ea8-b95f-98afdd85e15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:59.396035 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f4e5f-2dbf-4ea8-b95f-98afdd85e15a admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:59.403359 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f4e5f-2dbf-4ea8-b95f-98afdd85e15a admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:59.403359 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f4e5f-2dbf-4ea8-b95f-98afdd85e15a admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:59.403359 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f4e5f-2dbf-4ea8-b95f-98afdd85e15a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:59.403359 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f4e5f-2dbf-4ea8-b95f-98afdd85e15a admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:59.409775 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1313/2626] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:54:59.413722 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe095e7-9e5d-4e44-93aa-ccfa5d222d56 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:59.427455 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe095e7-9e5d-4e44-93aa-ccfa5d222d56 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:59.435176 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b35d95-01b9-4dd2-be28-00646f5320cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:59.435176 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b35d95-01b9-4dd2-be28-00646f5320cc admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:59.435176 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b35d95-01b9-4dd2-be28-00646f5320cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:59.435176 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b35d95-01b9-4dd2-be28-00646f5320cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:59.435674 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b35d95-01b9-4dd2-be28-00646f5320cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:59.436257 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b35d95-01b9-4dd2-be28-00646f5320cc admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:59.448005 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1314/2627] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:54:59.451986 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f4e5f-2dbf-4ea8-b95f-98afdd85e15a admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:59.464285 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f4e5f-2dbf-4ea8-b95f-98afdd85e15a admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:59.469440 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6212df29-7eaf-433a-9643-58bd1a3fe8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:59.470100 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212df29-7eaf-433a-9643-58bd1a3fe8d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:59.470380 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212df29-7eaf-433a-9643-58bd1a3fe8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:59.470654 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212df29-7eaf-433a-9643-58bd1a3fe8d5 admin admin] PATH_INFO: `/v3/projects/75590bf354b7488a94a7fdf337749dc5/users/000b1ad8cc0041b28f17fc753f590715/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:59.487612 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6212df29-7eaf-433a-9643-58bd1a3fe8d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75590bf354b7488a94a7fdf337749dc5, user_id=000b1ad8cc0041b28f17fc753f590715, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:59.490367 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6212df29-7eaf-433a-9643-58bd1a3fe8d5 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:59.539274 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b35d95-01b9-4dd2-be28-00646f5320cc admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:59.542761 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-29b35d95-01b9-4dd2-be28-00646f5320cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:59.558575 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b35d95-01b9-4dd2-be28-00646f5320cc admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:59.563564 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5438a86d-01df-4b31-9dc5-a9d4f4e6c474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:59.564159 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5438a86d-01df-4b31-9dc5-a9d4f4e6c474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:59.564439 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5438a86d-01df-4b31-9dc5-a9d4f4e6c474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:59.564796 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5438a86d-01df-4b31-9dc5-a9d4f4e6c474 admin admin] PATH_INFO: `/v3/projects/6622f49d72cf4c37bb978fcc6eaacb48` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:59.565889 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5438a86d-01df-4b31-9dc5-a9d4f4e6c474 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6622f49d72cf4c37bb978fcc6eaacb48)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:59.567840 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5438a86d-01df-4b31-9dc5-a9d4f4e6c474 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:59.581352 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1314/2628] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:54:59 2022] PUT /identity/v3/projects/75590bf354b7488a94a7fdf337749dc5/users/000b1ad8cc0041b28f17fc753f590715/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:54:59.591325 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20802e9-9488-4219-b5ae-71701df35e20 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:59.591616 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20802e9-9488-4219-b5ae-71701df35e20 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:59.591888 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20802e9-9488-4219-b5ae-71701df35e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:59.620275 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-f20802e9-9488-4219-b5ae-71701df35e20 None None] MFA Rules not processed for user `000b1ad8cc0041b28f17fc753f590715`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:54:59.621467 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-f20802e9-9488-4219-b5ae-71701df35e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:59.687401 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-5438a86d-01df-4b31-9dc5-a9d4f4e6c474 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6622f49d72cf4c37bb978fcc6eaacb48', 'request_id': 'req-5438a86d-01df-4b31-9dc5-a9d4f4e6c474'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:59.692782 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1315/2629] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:54:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:54:59.703988 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20802e9-9488-4219-b5ae-71701df35e20 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:59.705377 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-f20802e9-9488-4219-b5ae-71701df35e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:59.779441 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20802e9-9488-4219-b5ae-71701df35e20 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:59.779672 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-5438a86d-01df-4b31-9dc5-a9d4f4e6c474 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6622f49d72cf4c37bb978fcc6eaacb48', 'request_id': 'req-5438a86d-01df-4b31-9dc5-a9d4f4e6c474'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:59.786743 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-5438a86d-01df-4b31-9dc5-a9d4f4e6c474 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6622f49d72cf4c37bb978fcc6eaacb48', 'request_id': 'req-5438a86d-01df-4b31-9dc5-a9d4f4e6c474'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:59.798122 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-5438a86d-01df-4b31-9dc5-a9d4f4e6c474 admin admin] The token cache is being invalidate because project 6622f49d72cf4c37bb978fcc6eaacb48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:54:59.798466 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-5438a86d-01df-4b31-9dc5-a9d4f4e6c474 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:59.799291 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-5438a86d-01df-4b31-9dc5-a9d4f4e6c474 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:54:59.801074 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1315/2630] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:54:59 2022] DELETE /identity/v3/projects/6622f49d72cf4c37bb978fcc6eaacb48 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:54:59.805060 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5438a86d-01df-4b31-9dc5-a9d4f4e6c474 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:54:59.806390 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-5438a86d-01df-4b31-9dc5-a9d4f4e6c474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:59.819998 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:54:59.832212 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:54:59.852274 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcfe58e-ea80-4d4e-ac76-5b63a437edad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:59.852274 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcfe58e-ea80-4d4e-ac76-5b63a437edad service nova] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:59.852274 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcfe58e-ea80-4d4e-ac76-5b63a437edad service nova] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:59.852274 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcfe58e-ea80-4d4e-ac76-5b63a437edad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:59.853047 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-afcfe58e-ea80-4d4e-ac76-5b63a437edad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:54:59.893005 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5438a86d-01df-4b31-9dc5-a9d4f4e6c474 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:54:59.897746 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c7664-4b28-4fbe-aa13-863f084cb518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:54:59.898577 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c7664-4b28-4fbe-aa13-863f084cb518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:54:59.898714 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c7664-4b28-4fbe-aa13-863f084cb518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:54:59.898936 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c7664-4b28-4fbe-aa13-863f084cb518 admin admin] PATH_INFO: `/v3/users/2431e143c8cf4dae9d48784e26366380` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:54:59.900142 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c7664-4b28-4fbe-aa13-863f084cb518 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2431e143c8cf4dae9d48784e26366380)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:59.902053 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c7664-4b28-4fbe-aa13-863f084cb518 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:59.923545 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcfe58e-ea80-4d4e-ac76-5b63a437edad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:54:59.925135 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcfe58e-ea80-4d4e-ac76-5b63a437edad service nova] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:54:59.934178 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1316/2631] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:54:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:55:00.096606 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-6e1c7664-4b28-4fbe-aa13-863f084cb518 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2431e143c8cf4dae9d48784e26366380'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:00.173442 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-6e1c7664-4b28-4fbe-aa13-863f084cb518 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2431e143c8cf4dae9d48784e26366380'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:00.180497 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-6e1c7664-4b28-4fbe-aa13-863f084cb518 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2431e143c8cf4dae9d48784e26366380'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:00.192480 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-6e1c7664-4b28-4fbe-aa13-863f084cb518 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2431e143c8cf4dae9d48784e26366380'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:00.193138 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-6e1c7664-4b28-4fbe-aa13-863f084cb518 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2431e143c8cf4dae9d48784e26366380'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:00.199183 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1316/2632] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:54:59 2022] DELETE /identity/v3/users/2431e143c8cf4dae9d48784e26366380 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:55:00.619357 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcfe58e-ea80-4d4e-ac76-5b63a437edad service nova] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:00.632293 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcfe58e-ea80-4d4e-ac76-5b63a437edad service nova] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:00.689409 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f389da0-233f-4d9b-8ab5-b61e7ad11d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:00.690043 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f389da0-233f-4d9b-8ab5-b61e7ad11d13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:00.690319 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f389da0-233f-4d9b-8ab5-b61e7ad11d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:00.690619 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f389da0-233f-4d9b-8ab5-b61e7ad11d13 admin admin] PATH_INFO: `/v3/projects/f5dc678e1c3e4007ab8845b590045c3e` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:00.691901 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f389da0-233f-4d9b-8ab5-b61e7ad11d13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5dc678e1c3e4007ab8845b590045c3e)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:00.693794 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f389da0-233f-4d9b-8ab5-b61e7ad11d13 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:00.826679 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-6f389da0-233f-4d9b-8ab5-b61e7ad11d13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5dc678e1c3e4007ab8845b590045c3e', 'request_id': 'req-6f389da0-233f-4d9b-8ab5-b61e7ad11d13'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:00.940241 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-6f389da0-233f-4d9b-8ab5-b61e7ad11d13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5dc678e1c3e4007ab8845b590045c3e', 'request_id': 'req-6f389da0-233f-4d9b-8ab5-b61e7ad11d13'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:00.947311 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-6f389da0-233f-4d9b-8ab5-b61e7ad11d13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5dc678e1c3e4007ab8845b590045c3e', 'request_id': 'req-6f389da0-233f-4d9b-8ab5-b61e7ad11d13'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:00.958525 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-6f389da0-233f-4d9b-8ab5-b61e7ad11d13 admin admin] The token cache is being invalidate because project f5dc678e1c3e4007ab8845b590045c3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:55:00.958807 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-6f389da0-233f-4d9b-8ab5-b61e7ad11d13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:00.959464 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-6f389da0-233f-4d9b-8ab5-b61e7ad11d13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:00.960934 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1317/2633] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:55:00 2022] DELETE /identity/v3/projects/f5dc678e1c3e4007ab8845b590045c3e => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:55:00.966064 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f6973-81f0-4416-8392-f93a3e38c9ff None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:00.966362 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f6973-81f0-4416-8392-f93a3e38c9ff None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:00.966680 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f6973-81f0-4416-8392-f93a3e38c9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:00.987208 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-1c9f6973-81f0-4416-8392-f93a3e38c9ff None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:00.988607 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-1c9f6973-81f0-4416-8392-f93a3e38c9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:01.044607 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1317/2634] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:55:01.053043 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b1f30-2257-4f48-9a09-512939e273e4 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:01.053328 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b1f30-2257-4f48-9a09-512939e273e4 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:01.053602 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b1f30-2257-4f48-9a09-512939e273e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:01.073894 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-8f7b1f30-2257-4f48-9a09-512939e273e4 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:01.075058 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-8f7b1f30-2257-4f48-9a09-512939e273e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:01.083762 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1318/2635] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:55:01.086797 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f6973-81f0-4416-8392-f93a3e38c9ff None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:01.088106 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b1f30-2257-4f48-9a09-512939e273e4 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:01.088476 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-1c9f6973-81f0-4416-8392-f93a3e38c9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:01.097709 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b1f30-2257-4f48-9a09-512939e273e4 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:01.101722 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f6973-81f0-4416-8392-f93a3e38c9ff None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:01.104915 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2842b1-a5e7-412f-85e9-a1a48d88cc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:01.104915 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2842b1-a5e7-412f-85e9-a1a48d88cc2e admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:01.104915 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2842b1-a5e7-412f-85e9-a1a48d88cc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:01.104915 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2842b1-a5e7-412f-85e9-a1a48d88cc2e admin admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:01.105305 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2842b1-a5e7-412f-85e9-a1a48d88cc2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:55:01.105305 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2842b1-a5e7-412f-85e9-a1a48d88cc2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:01.106683 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f80f8-6b1a-46b0-acfb-3d222e90052f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:01.106836 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2842b1-a5e7-412f-85e9-a1a48d88cc2e admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:01.107550 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f80f8-6b1a-46b0-acfb-3d222e90052f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:01.107829 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f80f8-6b1a-46b0-acfb-3d222e90052f admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:01.108094 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f80f8-6b1a-46b0-acfb-3d222e90052f admin admin] PATH_INFO: `/v3/users/0ac4e1556298408c8f024fca923da13c` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:01.110130 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943f80f8-6b1a-46b0-acfb-3d222e90052f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ac4e1556298408c8f024fca923da13c)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:01.112471 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943f80f8-6b1a-46b0-acfb-3d222e90052f admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:01.120537 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1319/2636] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:55:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:55:01.125240 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2842b1-a5e7-412f-85e9-a1a48d88cc2e admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:01.130235 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:01.135488 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2842b1-a5e7-412f-85e9-a1a48d88cc2e admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:01.140655 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd9c3e-cc54-448c-bbad-402225199cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:01.145190 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd9c3e-cc54-448c-bbad-402225199cfe admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:01.145190 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd9c3e-cc54-448c-bbad-402225199cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:01.145190 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd9c3e-cc54-448c-bbad-402225199cfe admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:01.145190 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd9c3e-cc54-448c-bbad-402225199cfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:01.145190 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd9c3e-cc54-448c-bbad-402225199cfe admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:01.198218 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:01.231746 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1320/2637] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:55:01 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:55:01.236726 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd9c3e-cc54-448c-bbad-402225199cfe admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:01.255753 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-943f80f8-6b1a-46b0-acfb-3d222e90052f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ac4e1556298408c8f024fca923da13c'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:01.297501 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd9c3e-cc54-448c-bbad-402225199cfe admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:01.302077 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a006b9-9d96-4420-83e7-79383960d165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:01.302686 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a006b9-9d96-4420-83e7-79383960d165 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:01.302998 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a006b9-9d96-4420-83e7-79383960d165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:01.303295 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a006b9-9d96-4420-83e7-79383960d165 admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:01.306308 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a006b9-9d96-4420-83e7-79383960d165 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:01.306308 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a006b9-9d96-4420-83e7-79383960d165 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:01.316802 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-943f80f8-6b1a-46b0-acfb-3d222e90052f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ac4e1556298408c8f024fca923da13c'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:01.324195 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-943f80f8-6b1a-46b0-acfb-3d222e90052f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ac4e1556298408c8f024fca923da13c'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:01.336049 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-943f80f8-6b1a-46b0-acfb-3d222e90052f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ac4e1556298408c8f024fca923da13c'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:01.336644 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-943f80f8-6b1a-46b0-acfb-3d222e90052f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ac4e1556298408c8f024fca923da13c'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:01.342589 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1318/2638] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:55:01 2022] DELETE /identity/v3/users/0ac4e1556298408c8f024fca923da13c => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:55:01.346811 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc04c9-694b-4196-83a9-2a58370452ae None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:01.347126 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc04c9-694b-4196-83a9-2a58370452ae None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:01.347405 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc04c9-694b-4196-83a9-2a58370452ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:01.366982 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-b9dc04c9-694b-4196-83a9-2a58370452ae None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:01.368176 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-b9dc04c9-694b-4196-83a9-2a58370452ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:01.368494 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1321/2639] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:55:01 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:55:01.372700 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a006b9-9d96-4420-83e7-79383960d165 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:01.375095 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-d2a006b9-9d96-4420-83e7-79383960d165 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:01.387146 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a006b9-9d96-4420-83e7-79383960d165 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:01.427351 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1319/2640] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:55:01.437511 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc04c9-694b-4196-83a9-2a58370452ae None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:01.438877 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-b9dc04c9-694b-4196-83a9-2a58370452ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:01.448887 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d404f-4ec6-4219-b37c-03050fe56b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:01.449502 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d404f-4ec6-4219-b37c-03050fe56b6e admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:01.449779 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d404f-4ec6-4219-b37c-03050fe56b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:01.450050 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d404f-4ec6-4219-b37c-03050fe56b6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:01.450735 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d404f-4ec6-4219-b37c-03050fe56b6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:01.452429 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d404f-4ec6-4219-b37c-03050fe56b6e admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:01.462192 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1322/2641] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:55:01.466047 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d404f-4ec6-4219-b37c-03050fe56b6e admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:01.475515 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d404f-4ec6-4219-b37c-03050fe56b6e admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:01.480085 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8be114c-d55d-47aa-b1c6-bff55d3715e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:01.480653 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be114c-d55d-47aa-b1c6-bff55d3715e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:01.480934 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be114c-d55d-47aa-b1c6-bff55d3715e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:01.481205 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be114c-d55d-47aa-b1c6-bff55d3715e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:01.481863 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8be114c-d55d-47aa-b1c6-bff55d3715e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:01.483995 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8be114c-d55d-47aa-b1c6-bff55d3715e6 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:01.494210 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1323/2642] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:55:01.495799 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc04c9-694b-4196-83a9-2a58370452ae None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:01.498130 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8be114c-d55d-47aa-b1c6-bff55d3715e6 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:01.500053 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152b60b-1d05-4b22-8a0e-12ef2cc724cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:01.500664 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152b60b-1d05-4b22-8a0e-12ef2cc724cc service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:01.500942 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152b60b-1d05-4b22-8a0e-12ef2cc724cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:01.501211 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152b60b-1d05-4b22-8a0e-12ef2cc724cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:01.507883 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8be114c-d55d-47aa-b1c6-bff55d3715e6 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:01.510324 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152b60b-1d05-4b22-8a0e-12ef2cc724cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:01.511774 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152b60b-1d05-4b22-8a0e-12ef2cc724cc service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:01.512478 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d544d-d079-474a-824b-7ed523f6ee21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:01.513096 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d544d-d079-474a-824b-7ed523f6ee21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:01.513381 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d544d-d079-474a-824b-7ed523f6ee21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:01.513654 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d544d-d079-474a-824b-7ed523f6ee21 admin admin] PATH_INFO: `/v3/projects/2cb51b61a23747b58ea07800c1daba98/users/7aab838d8fc841a5ab4ad92ad9bffb8f/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:01.522052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1320/2643] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:55:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:55:01.527967 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d544d-d079-474a-824b-7ed523f6ee21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cb51b61a23747b58ea07800c1daba98, user_id=7aab838d8fc841a5ab4ad92ad9bffb8f, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:01.530698 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d544d-d079-474a-824b-7ed523f6ee21 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:01.625591 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1324/2644] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:55:01 2022] PUT /identity/v3/projects/2cb51b61a23747b58ea07800c1daba98/users/7aab838d8fc841a5ab4ad92ad9bffb8f/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:55:01.635582 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257752b7-ecbb-4ed3-a8ec-aac2806e575a None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:01.635830 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257752b7-ecbb-4ed3-a8ec-aac2806e575a None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:01.636104 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257752b7-ecbb-4ed3-a8ec-aac2806e575a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:01.670817 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-257752b7-ecbb-4ed3-a8ec-aac2806e575a None None] MFA Rules not processed for user `7aab838d8fc841a5ab4ad92ad9bffb8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:01.672593 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-257752b7-ecbb-4ed3-a8ec-aac2806e575a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:01.719957 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:01.748006 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1321/2645] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:55:01.752468 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d544d-d079-474a-824b-7ed523f6ee21 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:01.789287 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:01.818550 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d544d-d079-474a-824b-7ed523f6ee21 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:01.823633 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee3cc3-aa88-4c65-9926-9398c1eb8335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:01.824125 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee3cc3-aa88-4c65-9926-9398c1eb8335 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:01.824403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee3cc3-aa88-4c65-9926-9398c1eb8335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:01.824676 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee3cc3-aa88-4c65-9926-9398c1eb8335 admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:01.825489 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee3cc3-aa88-4c65-9926-9398c1eb8335 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:01.827525 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee3cc3-aa88-4c65-9926-9398c1eb8335 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:01.930179 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257752b7-ecbb-4ed3-a8ec-aac2806e575a None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:01.930917 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1325/2646] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:55:01 2022] POST /identity/v3/projects => generated 387 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:55:01.932264 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-257752b7-ecbb-4ed3-a8ec-aac2806e575a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:01.934599 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee3cc3-aa88-4c65-9926-9398c1eb8335 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:01.946562 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257752b7-ecbb-4ed3-a8ec-aac2806e575a None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:02.004886 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee3cc3-aa88-4c65-9926-9398c1eb8335 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:02.009747 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae71c7-bfaf-4880-ae0e-3723de82d9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:02.010266 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15e132-14be-488c-9c96-dccb46988270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:02.010487 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae71c7-bfaf-4880-ae0e-3723de82d9af admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:02.010902 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae71c7-bfaf-4880-ae0e-3723de82d9af admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:02.011044 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15e132-14be-488c-9c96-dccb46988270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:02.011236 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae71c7-bfaf-4880-ae0e-3723de82d9af admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:02.011442 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15e132-14be-488c-9c96-dccb46988270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:02.011608 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15e132-14be-488c-9c96-dccb46988270 admin admin] PATH_INFO: `/v3/projects/8ae967175cb0469b89bef23a39caf2aa` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:02.012033 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae71c7-bfaf-4880-ae0e-3723de82d9af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:02.012654 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce15e132-14be-488c-9c96-dccb46988270 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ae967175cb0469b89bef23a39caf2aa)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:02.014072 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae71c7-bfaf-4880-ae0e-3723de82d9af admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:02.015087 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce15e132-14be-488c-9c96-dccb46988270 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:02.111542 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1326/2647] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:55:01 2022] POST /identity/v3/users => generated 300 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:55:02.115618 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae71c7-bfaf-4880-ae0e-3723de82d9af admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:02.123167 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-ce15e132-14be-488c-9c96-dccb46988270 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ae967175cb0469b89bef23a39caf2aa', 'request_id': 'req-ce15e132-14be-488c-9c96-dccb46988270'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:02.127419 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae71c7-bfaf-4880-ae0e-3723de82d9af admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:02.184576 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a28e61f-1b31-4258-8488-297726260942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:02.185111 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28e61f-1b31-4258-8488-297726260942 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:02.185392 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28e61f-1b31-4258-8488-297726260942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:02.185671 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28e61f-1b31-4258-8488-297726260942 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:02.186377 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a28e61f-1b31-4258-8488-297726260942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:02.188016 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a28e61f-1b31-4258-8488-297726260942 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:02.197697 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1327/2648] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:55:02.201819 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a28e61f-1b31-4258-8488-297726260942 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:02.207829 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-ce15e132-14be-488c-9c96-dccb46988270 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ae967175cb0469b89bef23a39caf2aa', 'request_id': 'req-ce15e132-14be-488c-9c96-dccb46988270'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:02.212113 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a28e61f-1b31-4258-8488-297726260942 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:02.214477 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-ce15e132-14be-488c-9c96-dccb46988270 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ae967175cb0469b89bef23a39caf2aa', 'request_id': 'req-ce15e132-14be-488c-9c96-dccb46988270'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:02.216973 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0a99e-e1bd-43aa-ba7a-7c138521c7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:02.217616 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0a99e-e1bd-43aa-ba7a-7c138521c7bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:02.218518 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0a99e-e1bd-43aa-ba7a-7c138521c7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:02.218826 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0a99e-e1bd-43aa-ba7a-7c138521c7bd admin admin] PATH_INFO: `/v3/projects/89e3487f164e4b6381407119830193f4/users/04c030c933cb40e7abcf8af6ae0344a1/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:02.226921 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-ce15e132-14be-488c-9c96-dccb46988270 admin admin] The token cache is being invalidate because project 8ae967175cb0469b89bef23a39caf2aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:55:02.227332 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-ce15e132-14be-488c-9c96-dccb46988270 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:02.228034 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-ce15e132-14be-488c-9c96-dccb46988270 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:02.229759 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1322/2649] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:55:01 2022] DELETE /identity/v3/projects/8ae967175cb0469b89bef23a39caf2aa => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:55:02.233522 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15e132-14be-488c-9c96-dccb46988270 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:02.233930 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d0a99e-e1bd-43aa-ba7a-7c138521c7bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=89e3487f164e4b6381407119830193f4, user_id=04c030c933cb40e7abcf8af6ae0344a1, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:02.234845 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-ce15e132-14be-488c-9c96-dccb46988270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:02.236979 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d0a99e-e1bd-43aa-ba7a-7c138521c7bd admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:02.250112 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15e132-14be-488c-9c96-dccb46988270 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:02.255421 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c03e20-7a88-4498-9671-cc1e6d9d344b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:02.255970 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c03e20-7a88-4498-9671-cc1e6d9d344b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:02.256392 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c03e20-7a88-4498-9671-cc1e6d9d344b admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:02.256777 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c03e20-7a88-4498-9671-cc1e6d9d344b admin admin] PATH_INFO: `/v3/users/6e5ce001ce3b4580b49e44bdc0975e23` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:02.258256 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c03e20-7a88-4498-9671-cc1e6d9d344b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e5ce001ce3b4580b49e44bdc0975e23)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:02.260808 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c03e20-7a88-4498-9671-cc1e6d9d344b admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:02.323585 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1328/2650] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:55:02 2022] PUT /identity/v3/projects/89e3487f164e4b6381407119830193f4/users/04c030c933cb40e7abcf8af6ae0344a1/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:55:02.328950 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0a99e-e1bd-43aa-ba7a-7c138521c7bd admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:02.331540 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-40d0a99e-e1bd-43aa-ba7a-7c138521c7bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:02.357392 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:02.402307 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0a99e-e1bd-43aa-ba7a-7c138521c7bd admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:02.407111 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99d31b-b2c7-4ea6-9e0e-46606640e8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:02.410211 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99d31b-b2c7-4ea6-9e0e-46606640e8b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:02.410211 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99d31b-b2c7-4ea6-9e0e-46606640e8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:02.410211 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99d31b-b2c7-4ea6-9e0e-46606640e8b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:02.410211 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b99d31b-b2c7-4ea6-9e0e-46606640e8b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:02.410556 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b99d31b-b2c7-4ea6-9e0e-46606640e8b4 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:02.420420 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1329/2651] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:55:02.430025 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99d31b-b2c7-4ea6-9e0e-46606640e8b4 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:02.440374 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99d31b-b2c7-4ea6-9e0e-46606640e8b4 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:02.444889 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ea0e2-0bd0-4fe1-bb46-b95708f31ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:02.445547 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ea0e2-0bd0-4fe1-bb46-b95708f31ca2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:02.445824 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ea0e2-0bd0-4fe1-bb46-b95708f31ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:02.446098 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ea0e2-0bd0-4fe1-bb46-b95708f31ca2 admin admin] PATH_INFO: `/v3/projects/89e3487f164e4b6381407119830193f4/users/04c030c933cb40e7abcf8af6ae0344a1/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:02.448077 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ea0e2-0bd0-4fe1-bb46-b95708f31ca2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89e3487f164e4b6381407119830193f4, user_id=04c030c933cb40e7abcf8af6ae0344a1, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:02.450709 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ea0e2-0bd0-4fe1-bb46-b95708f31ca2 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:02.461266 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1330/2652] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:55:02 2022] PUT /identity/v3/projects/89e3487f164e4b6381407119830193f4/users/04c030c933cb40e7abcf8af6ae0344a1/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:55:02.470644 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-c4c03e20-7a88-4498-9671-cc1e6d9d344b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e5ce001ce3b4580b49e44bdc0975e23'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:02.473043 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110073c-fa8a-4f98-896e-37f59a97beff None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:02.473343 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110073c-fa8a-4f98-896e-37f59a97beff None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:02.473613 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110073c-fa8a-4f98-896e-37f59a97beff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:02.501785 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-2110073c-fa8a-4f98-896e-37f59a97beff None None] MFA Rules not processed for user `04c030c933cb40e7abcf8af6ae0344a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:02.503263 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-2110073c-fa8a-4f98-896e-37f59a97beff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:02.517018 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-c4c03e20-7a88-4498-9671-cc1e6d9d344b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e5ce001ce3b4580b49e44bdc0975e23'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:02.524425 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-c4c03e20-7a88-4498-9671-cc1e6d9d344b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e5ce001ce3b4580b49e44bdc0975e23'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:02.525580 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:02.536766 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-c4c03e20-7a88-4498-9671-cc1e6d9d344b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e5ce001ce3b4580b49e44bdc0975e23'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:02.537431 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-c4c03e20-7a88-4498-9671-cc1e6d9d344b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e5ce001ce3b4580b49e44bdc0975e23'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:02.543402 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1323/2653] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:55:02 2022] DELETE /identity/v3/users/6e5ce001ce3b4580b49e44bdc0975e23 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:55:02.575194 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1331/2654] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:02 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:55:02.587019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c03e20-7a88-4498-9671-cc1e6d9d344b admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:02.588525 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-c4c03e20-7a88-4498-9671-cc1e6d9d344b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:02.648089 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c03e20-7a88-4498-9671-cc1e6d9d344b admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:02.651732 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b608d024-9319-456a-b543-2b3bedb3edaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:02.652388 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608d024-9319-456a-b543-2b3bedb3edaa service cinder] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:02.652673 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608d024-9319-456a-b543-2b3bedb3edaa service cinder] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:02.652946 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608d024-9319-456a-b543-2b3bedb3edaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:02.715785 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b608d024-9319-456a-b543-2b3bedb3edaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:02.717167 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b608d024-9319-456a-b543-2b3bedb3edaa service cinder] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:02.730338 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1324/2655] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:55:02 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:55:02.920306 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110073c-fa8a-4f98-896e-37f59a97beff None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:02.922297 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-2110073c-fa8a-4f98-896e-37f59a97beff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:03.003112 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110073c-fa8a-4f98-896e-37f59a97beff None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:03.033898 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:03.060965 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa5551-3112-45a8-a19e-e65272ee181d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:03.062261 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa5551-3112-45a8-a19e-e65272ee181d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:03.062537 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa5551-3112-45a8-a19e-e65272ee181d admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:03.062809 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa5551-3112-45a8-a19e-e65272ee181d admin admin] PATH_INFO: `/v3/projects/c643024799ab44eca5564ca869e69413` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:03.063995 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa5551-3112-45a8-a19e-e65272ee181d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c643024799ab44eca5564ca869e69413)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:03.065964 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa5551-3112-45a8-a19e-e65272ee181d admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:03.201559 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-e0fa5551-3112-45a8-a19e-e65272ee181d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c643024799ab44eca5564ca869e69413', 'request_id': 'req-e0fa5551-3112-45a8-a19e-e65272ee181d'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:03.277376 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-e0fa5551-3112-45a8-a19e-e65272ee181d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c643024799ab44eca5564ca869e69413', 'request_id': 'req-e0fa5551-3112-45a8-a19e-e65272ee181d'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:03.284372 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-e0fa5551-3112-45a8-a19e-e65272ee181d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c643024799ab44eca5564ca869e69413', 'request_id': 'req-e0fa5551-3112-45a8-a19e-e65272ee181d'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:03.295800 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-e0fa5551-3112-45a8-a19e-e65272ee181d admin admin] The token cache is being invalidate because project c643024799ab44eca5564ca869e69413 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:55:03.296766 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-e0fa5551-3112-45a8-a19e-e65272ee181d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:03.297418 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-e0fa5551-3112-45a8-a19e-e65272ee181d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:03.298912 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1332/2656] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:55:02 2022] DELETE /identity/v3/projects/c643024799ab44eca5564ca869e69413 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:55:03.303068 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b608d024-9319-456a-b543-2b3bedb3edaa service cinder] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:03.313768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b608d024-9319-456a-b543-2b3bedb3edaa service cinder] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:03.386269 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e412b-54fc-425a-8394-ec69ac14e525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:03.386920 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e412b-54fc-425a-8394-ec69ac14e525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:03.387267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e412b-54fc-425a-8394-ec69ac14e525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:03.390407 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e412b-54fc-425a-8394-ec69ac14e525 admin admin] PATH_INFO: `/v3/users/4eb420cd476340d39dce7cd50f5344f6` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:03.390407 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e412b-54fc-425a-8394-ec69ac14e525 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eb420cd476340d39dce7cd50f5344f6)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:03.390702 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e412b-54fc-425a-8394-ec69ac14e525 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:03.570569 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:03.594307 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-f22e412b-54fc-425a-8394-ec69ac14e525 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eb420cd476340d39dce7cd50f5344f6'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:03.665574 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-f22e412b-54fc-425a-8394-ec69ac14e525 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eb420cd476340d39dce7cd50f5344f6'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:03.675701 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-f22e412b-54fc-425a-8394-ec69ac14e525 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eb420cd476340d39dce7cd50f5344f6'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:03.689499 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-f22e412b-54fc-425a-8394-ec69ac14e525 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eb420cd476340d39dce7cd50f5344f6'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:03.690816 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-f22e412b-54fc-425a-8394-ec69ac14e525 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eb420cd476340d39dce7cd50f5344f6'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:03.697223 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1325/2657] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:55:03 2022] DELETE /identity/v3/users/4eb420cd476340d39dce7cd50f5344f6 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:55:03.851868 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa5551-3112-45a8-a19e-e65272ee181d admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:03.855853 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-e0fa5551-3112-45a8-a19e-e65272ee181d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:03.866575 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa5551-3112-45a8-a19e-e65272ee181d admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:03.950181 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82abfbda-a7e3-4185-a7c3-0df94ccb96a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:03.950971 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abfbda-a7e3-4185-a7c3-0df94ccb96a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:03.951270 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abfbda-a7e3-4185-a7c3-0df94ccb96a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:03.951547 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abfbda-a7e3-4185-a7c3-0df94ccb96a5 admin admin] PATH_INFO: `/v3/users/7aab838d8fc841a5ab4ad92ad9bffb8f` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:03.952959 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82abfbda-a7e3-4185-a7c3-0df94ccb96a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7aab838d8fc841a5ab4ad92ad9bffb8f)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:03.955078 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82abfbda-a7e3-4185-a7c3-0df94ccb96a5 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:04.113821 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e412b-54fc-425a-8394-ec69ac14e525 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:04.115823 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-f22e412b-54fc-425a-8394-ec69ac14e525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:04.122337 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-82abfbda-a7e3-4185-a7c3-0df94ccb96a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7aab838d8fc841a5ab4ad92ad9bffb8f'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:04.129809 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e412b-54fc-425a-8394-ec69ac14e525 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:04.134930 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b604929-7b41-41c5-83e3-d4bc66841b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:04.135663 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b604929-7b41-41c5-83e3-d4bc66841b0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:04.135942 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b604929-7b41-41c5-83e3-d4bc66841b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:04.136215 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b604929-7b41-41c5-83e3-d4bc66841b0e admin admin] PATH_INFO: `/v3/projects/7c0bb76313e64725a62e1acd08fde0e2` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:04.137376 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b604929-7b41-41c5-83e3-d4bc66841b0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c0bb76313e64725a62e1acd08fde0e2)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:04.139315 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b604929-7b41-41c5-83e3-d4bc66841b0e admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:04.185690 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-82abfbda-a7e3-4185-a7c3-0df94ccb96a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7aab838d8fc841a5ab4ad92ad9bffb8f'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:04.194651 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-82abfbda-a7e3-4185-a7c3-0df94ccb96a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7aab838d8fc841a5ab4ad92ad9bffb8f'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:04.196013 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-82abfbda-a7e3-4185-a7c3-0df94ccb96a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7aab838d8fc841a5ab4ad92ad9bffb8f'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:04.198787 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:04.212051 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-82abfbda-a7e3-4185-a7c3-0df94ccb96a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7aab838d8fc841a5ab4ad92ad9bffb8f'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:04.219569 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1333/2658] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:55:03 2022] DELETE /identity/v3/users/7aab838d8fc841a5ab4ad92ad9bffb8f => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:55:04.224027 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9199c1b-6d8f-4ec5-af98-775942f24cec None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:04.224343 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9199c1b-6d8f-4ec5-af98-775942f24cec None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:04.224617 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9199c1b-6d8f-4ec5-af98-775942f24cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:04.248203 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-0b604929-7b41-41c5-83e3-d4bc66841b0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c0bb76313e64725a62e1acd08fde0e2', 'request_id': 'req-0b604929-7b41-41c5-83e3-d4bc66841b0e'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:04.248663 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-b9199c1b-6d8f-4ec5-af98-775942f24cec None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:04.250573 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-b9199c1b-6d8f-4ec5-af98-775942f24cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:04.312035 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1334/2659] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:55:04.316918 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-0b604929-7b41-41c5-83e3-d4bc66841b0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c0bb76313e64725a62e1acd08fde0e2', 'request_id': 'req-0b604929-7b41-41c5-83e3-d4bc66841b0e'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:04.321822 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9199c1b-6d8f-4ec5-af98-775942f24cec None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:04.323213 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-b9199c1b-6d8f-4ec5-af98-775942f24cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:04.323552 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-0b604929-7b41-41c5-83e3-d4bc66841b0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c0bb76313e64725a62e1acd08fde0e2', 'request_id': 'req-0b604929-7b41-41c5-83e3-d4bc66841b0e'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:04.335323 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-0b604929-7b41-41c5-83e3-d4bc66841b0e admin admin] The token cache is being invalidate because project 7c0bb76313e64725a62e1acd08fde0e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:55:04.335610 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-0b604929-7b41-41c5-83e3-d4bc66841b0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:04.336248 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-0b604929-7b41-41c5-83e3-d4bc66841b0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:04.337949 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1326/2660] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:55:04 2022] DELETE /identity/v3/projects/7c0bb76313e64725a62e1acd08fde0e2 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:55:04.343886 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7cdda-04c7-453a-9b4b-bf768fe63c22 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:04.344169 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7cdda-04c7-453a-9b4b-bf768fe63c22 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:04.344441 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7cdda-04c7-453a-9b4b-bf768fe63c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:04.363849 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-37f7cdda-04c7-453a-9b4b-bf768fe63c22 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:04.364975 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-37f7cdda-04c7-453a-9b4b-bf768fe63c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:04.373145 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1327/2661] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:55:04.381236 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f0a60-4648-4e33-bd62-cc0d49d90101 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:04.383177 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f0a60-4648-4e33-bd62-cc0d49d90101 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:04.383177 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f0a60-4648-4e33-bd62-cc0d49d90101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:04.383402 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9199c1b-6d8f-4ec5-af98-775942f24cec None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:04.385945 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0639e-5beb-4333-b4cf-142489970cd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:04.386556 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0639e-5beb-4333-b4cf-142489970cd1 service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:04.386833 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0639e-5beb-4333-b4cf-142489970cd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:04.387146 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0639e-5beb-4333-b4cf-142489970cd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:04.389197 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-8ce0639e-5beb-4333-b4cf-142489970cd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:04.401382 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-586f0a60-4648-4e33-bd62-cc0d49d90101 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:04.402449 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce0639e-5beb-4333-b4cf-142489970cd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:04.402962 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-586f0a60-4648-4e33-bd62-cc0d49d90101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:04.404252 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce0639e-5beb-4333-b4cf-142489970cd1 service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:04.411780 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1328/2662] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:55:04.415847 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f0a60-4648-4e33-bd62-cc0d49d90101 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:04.418481 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1335/2663] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:55:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:55:04.424890 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f0a60-4648-4e33-bd62-cc0d49d90101 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:04.429674 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8b6bb-8136-4416-9920-b12a4f9cd439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:04.430320 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8b6bb-8136-4416-9920-b12a4f9cd439 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:04.430656 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8b6bb-8136-4416-9920-b12a4f9cd439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:04.430940 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8b6bb-8136-4416-9920-b12a4f9cd439 admin admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:04.431659 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a8b6bb-8136-4416-9920-b12a4f9cd439 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:55:04.431959 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a8b6bb-8136-4416-9920-b12a4f9cd439 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:04.433716 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a8b6bb-8136-4416-9920-b12a4f9cd439 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:04.445734 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1329/2664] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:55:04.450101 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0639e-5beb-4333-b4cf-142489970cd1 service neutron] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:04.460179 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0639e-5beb-4333-b4cf-142489970cd1 service neutron] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:04.470580 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a041d-465e-41a3-9542-0daa17fd6230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:04.470580 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a041d-465e-41a3-9542-0daa17fd6230 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:04.470580 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a041d-465e-41a3-9542-0daa17fd6230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:04.470580 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a041d-465e-41a3-9542-0daa17fd6230 admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:04.471250 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a041d-465e-41a3-9542-0daa17fd6230 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:04.471250 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a041d-465e-41a3-9542-0daa17fd6230 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:04.541858 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1336/2665] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:55:04 2022] POST /identity/v3/projects => generated 371 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:55:04.546184 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8b6bb-8136-4416-9920-b12a4f9cd439 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:04.556536 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8b6bb-8136-4416-9920-b12a4f9cd439 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:04.622403 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aeea12-dd0e-4dc1-9191-7823a1039f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:04.622982 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aeea12-dd0e-4dc1-9191-7823a1039f00 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:04.623277 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aeea12-dd0e-4dc1-9191-7823a1039f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:04.623559 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aeea12-dd0e-4dc1-9191-7823a1039f00 admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:04.624761 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aeea12-dd0e-4dc1-9191-7823a1039f00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:04.626666 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aeea12-dd0e-4dc1-9191-7823a1039f00 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:04.638672 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=83,keystone:DELETE=12,keystone:INSERT=5 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:04.713207 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1330/2666] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:55:04 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:55:04.718316 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a041d-465e-41a3-9542-0daa17fd6230 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:04.728945 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a041d-465e-41a3-9542-0daa17fd6230 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:04.733768 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd724163-d3db-4792-930e-11218dbb7ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:04.734377 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd724163-d3db-4792-930e-11218dbb7ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:04.735060 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd724163-d3db-4792-930e-11218dbb7ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:04.735328 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd724163-d3db-4792-930e-11218dbb7ee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:04.736290 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd724163-d3db-4792-930e-11218dbb7ee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:04.737955 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd724163-d3db-4792-930e-11218dbb7ee2 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:04.748595 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1337/2667] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:55:04.753223 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aeea12-dd0e-4dc1-9191-7823a1039f00 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:04.763213 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aeea12-dd0e-4dc1-9191-7823a1039f00 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:04.768365 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77293ce5-6ac2-47a8-a7f0-917b7bb5efe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:04.768975 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77293ce5-6ac2-47a8-a7f0-917b7bb5efe4 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:04.769252 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77293ce5-6ac2-47a8-a7f0-917b7bb5efe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:04.769525 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77293ce5-6ac2-47a8-a7f0-917b7bb5efe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:04.770218 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77293ce5-6ac2-47a8-a7f0-917b7bb5efe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:04.771834 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77293ce5-6ac2-47a8-a7f0-917b7bb5efe4 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:04.782271 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1331/2668] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:55:04.786324 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd724163-d3db-4792-930e-11218dbb7ee2 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:04.794434 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77293ce5-6ac2-47a8-a7f0-917b7bb5efe4 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:04.796963 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-77293ce5-6ac2-47a8-a7f0-917b7bb5efe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:04.797373 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd724163-d3db-4792-930e-11218dbb7ee2 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:04.802022 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30268a-f991-4b6e-a2e5-4e1e130b7372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:04.802687 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30268a-f991-4b6e-a2e5-4e1e130b7372 admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:04.802986 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30268a-f991-4b6e-a2e5-4e1e130b7372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:04.803272 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30268a-f991-4b6e-a2e5-4e1e130b7372 admin admin] PATH_INFO: `/v3/projects/30cc93e37941443eb697a86b2db1a896/users/b0093482dfd9456ca0597972ffabe8f9/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:04.811382 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77293ce5-6ac2-47a8-a7f0-917b7bb5efe4 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:04.816850 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52475cbf-1656-49f9-9e90-a192a0a81357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:04.817497 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52475cbf-1656-49f9-9e90-a192a0a81357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:04.818237 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52475cbf-1656-49f9-9e90-a192a0a81357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:04.818528 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52475cbf-1656-49f9-9e90-a192a0a81357 admin admin] PATH_INFO: `/v3/projects/2cb51b61a23747b58ea07800c1daba98` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:04.819765 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52475cbf-1656-49f9-9e90-a192a0a81357 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cb51b61a23747b58ea07800c1daba98)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:04.821736 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52475cbf-1656-49f9-9e90-a192a0a81357 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:04.833033 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef30268a-f991-4b6e-a2e5-4e1e130b7372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30cc93e37941443eb697a86b2db1a896, user_id=b0093482dfd9456ca0597972ffabe8f9, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:04.835742 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef30268a-f991-4b6e-a2e5-4e1e130b7372 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:04.963566 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1338/2669] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:55:04 2022] PUT /identity/v3/projects/30cc93e37941443eb697a86b2db1a896/users/b0093482dfd9456ca0597972ffabe8f9/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:55:04.975102 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-52475cbf-1656-49f9-9e90-a192a0a81357 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cb51b61a23747b58ea07800c1daba98', 'request_id': 'req-52475cbf-1656-49f9-9e90-a192a0a81357'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:04.980443 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67cb7f-3b20-473c-ad84-5cf60babb499 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:04.980732 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67cb7f-3b20-473c-ad84-5cf60babb499 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:04.981013 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67cb7f-3b20-473c-ad84-5cf60babb499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:05.010091 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-ea67cb7f-3b20-473c-ad84-5cf60babb499 None None] MFA Rules not processed for user `b0093482dfd9456ca0597972ffabe8f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:05.011330 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-ea67cb7f-3b20-473c-ad84-5cf60babb499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:05.028604 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:05.065217 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-52475cbf-1656-49f9-9e90-a192a0a81357 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cb51b61a23747b58ea07800c1daba98', 'request_id': 'req-52475cbf-1656-49f9-9e90-a192a0a81357'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:05.071304 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-52475cbf-1656-49f9-9e90-a192a0a81357 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cb51b61a23747b58ea07800c1daba98', 'request_id': 'req-52475cbf-1656-49f9-9e90-a192a0a81357'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:05.077483 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1339/2670] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:55:05.087038 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-52475cbf-1656-49f9-9e90-a192a0a81357 admin admin] The token cache is being invalidate because project 2cb51b61a23747b58ea07800c1daba98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:55:05.087460 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-52475cbf-1656-49f9-9e90-a192a0a81357 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:05.088153 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-52475cbf-1656-49f9-9e90-a192a0a81357 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:05.088664 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67cb7f-3b20-473c-ad84-5cf60babb499 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:05.089763 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1332/2671] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:55:04 2022] DELETE /identity/v3/projects/2cb51b61a23747b58ea07800c1daba98 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:55:05.090053 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-ea67cb7f-3b20-473c-ad84-5cf60babb499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:05.096936 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52475cbf-1656-49f9-9e90-a192a0a81357 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:05.098236 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-52475cbf-1656-49f9-9e90-a192a0a81357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:05.145936 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67cb7f-3b20-473c-ad84-5cf60babb499 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:05.149386 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d006408-daf8-4a59-b482-121639f84a03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:05.150027 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d006408-daf8-4a59-b482-121639f84a03 service cinder] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:05.150322 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d006408-daf8-4a59-b482-121639f84a03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:05.150810 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d006408-daf8-4a59-b482-121639f84a03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:05.152515 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-5d006408-daf8-4a59-b482-121639f84a03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:05.163275 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52475cbf-1656-49f9-9e90-a192a0a81357 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:05.164071 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d006408-daf8-4a59-b482-121639f84a03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:05.165618 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d006408-daf8-4a59-b482-121639f84a03 service cinder] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:05.168115 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a28fcc-746e-4ae5-88c0-717ab9e59360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:05.168802 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a28fcc-746e-4ae5-88c0-717ab9e59360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:05.169120 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a28fcc-746e-4ae5-88c0-717ab9e59360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:05.169394 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a28fcc-746e-4ae5-88c0-717ab9e59360 admin admin] PATH_INFO: `/v3/users/04c030c933cb40e7abcf8af6ae0344a1` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:05.170623 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a28fcc-746e-4ae5-88c0-717ab9e59360 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04c030c933cb40e7abcf8af6ae0344a1)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:05.173300 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a28fcc-746e-4ae5-88c0-717ab9e59360 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:05.175076 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1340/2672] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:55:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:55:05.197287 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d006408-daf8-4a59-b482-121639f84a03 service cinder] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:05.198691 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-5d006408-daf8-4a59-b482-121639f84a03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:05.211832 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d006408-daf8-4a59-b482-121639f84a03 service cinder] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:05.217265 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f6b27-b9a9-4fec-b34d-a81bf17952ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:05.217963 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f6b27-b9a9-4fec-b34d-a81bf17952ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:05.218285 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f6b27-b9a9-4fec-b34d-a81bf17952ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:05.218562 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f6b27-b9a9-4fec-b34d-a81bf17952ff admin admin] PATH_INFO: `/v3/users/b0093482dfd9456ca0597972ffabe8f9` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:05.219773 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f6b27-b9a9-4fec-b34d-a81bf17952ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0093482dfd9456ca0597972ffabe8f9)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:05.221684 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f6b27-b9a9-4fec-b34d-a81bf17952ff admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:05.387546 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-31a28fcc-746e-4ae5-88c0-717ab9e59360 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04c030c933cb40e7abcf8af6ae0344a1'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:05.461872 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-907f6b27-b9a9-4fec-b34d-a81bf17952ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0093482dfd9456ca0597972ffabe8f9'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:05.476923 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-31a28fcc-746e-4ae5-88c0-717ab9e59360 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04c030c933cb40e7abcf8af6ae0344a1'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:05.485080 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-31a28fcc-746e-4ae5-88c0-717ab9e59360 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04c030c933cb40e7abcf8af6ae0344a1'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:05.490448 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:05.496976 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-31a28fcc-746e-4ae5-88c0-717ab9e59360 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04c030c933cb40e7abcf8af6ae0344a1'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:05.497603 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-31a28fcc-746e-4ae5-88c0-717ab9e59360 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04c030c933cb40e7abcf8af6ae0344a1'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:05.503300 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1333/2673] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:55:05 2022] DELETE /identity/v3/users/04c030c933cb40e7abcf8af6ae0344a1 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:55:05.528665 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-907f6b27-b9a9-4fec-b34d-a81bf17952ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0093482dfd9456ca0597972ffabe8f9'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:05.537191 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-907f6b27-b9a9-4fec-b34d-a81bf17952ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0093482dfd9456ca0597972ffabe8f9'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:05.537871 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-907f6b27-b9a9-4fec-b34d-a81bf17952ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0093482dfd9456ca0597972ffabe8f9'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:05.550673 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-907f6b27-b9a9-4fec-b34d-a81bf17952ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0093482dfd9456ca0597972ffabe8f9'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:05.557544 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1341/2674] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:55:05 2022] DELETE /identity/v3/users/b0093482dfd9456ca0597972ffabe8f9 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:55:05.562238 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bbee6-6437-4608-9ef4-5a0a447c2f4d None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:05.562538 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bbee6-6437-4608-9ef4-5a0a447c2f4d None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:05.562826 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bbee6-6437-4608-9ef4-5a0a447c2f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:05.581918 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-fb5bbee6-6437-4608-9ef4-5a0a447c2f4d None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:05.583191 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-fb5bbee6-6437-4608-9ef4-5a0a447c2f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:05.641938 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1334/2675] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:55:05.651534 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f6b27-b9a9-4fec-b34d-a81bf17952ff admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:05.653214 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-907f6b27-b9a9-4fec-b34d-a81bf17952ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:05.688720 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:05.710461 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f6b27-b9a9-4fec-b34d-a81bf17952ff admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:05.713907 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c645ecb-dfa1-4e91-9032-51ff7d827167 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:05.714517 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c645ecb-dfa1-4e91-9032-51ff7d827167 service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:05.714793 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c645ecb-dfa1-4e91-9032-51ff7d827167 service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:05.715114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c645ecb-dfa1-4e91-9032-51ff7d827167 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:05.725777 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c645ecb-dfa1-4e91-9032-51ff7d827167 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:05.729300 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c645ecb-dfa1-4e91-9032-51ff7d827167 service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:05.741483 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1342/2676] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:55:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:55:05.972233 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5bbee6-6437-4608-9ef4-5a0a447c2f4d None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:05.974100 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-fb5bbee6-6437-4608-9ef4-5a0a447c2f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:05.996655 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5bbee6-6437-4608-9ef4-5a0a447c2f4d None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:06.003303 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f36137-0c7d-4a61-82ca-f15821ac4f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:06.004931 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f36137-0c7d-4a61-82ca-f15821ac4f8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:06.005644 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f36137-0c7d-4a61-82ca-f15821ac4f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:06.006224 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f36137-0c7d-4a61-82ca-f15821ac4f8d admin admin] PATH_INFO: `/v3/projects/89e3487f164e4b6381407119830193f4` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:06.008913 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f36137-0c7d-4a61-82ca-f15821ac4f8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=89e3487f164e4b6381407119830193f4)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:06.012061 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f36137-0c7d-4a61-82ca-f15821ac4f8d admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:06.133175 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c645ecb-dfa1-4e91-9032-51ff7d827167 service neutron] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:06.133175 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-8c645ecb-dfa1-4e91-9032-51ff7d827167 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:06.133175 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c645ecb-dfa1-4e91-9032-51ff7d827167 service neutron] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:06.135196 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227e779-dcb2-4022-b26e-047588fb0b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:06.135196 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227e779-dcb2-4022-b26e-047588fb0b49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:06.135196 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227e779-dcb2-4022-b26e-047588fb0b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:06.135196 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227e779-dcb2-4022-b26e-047588fb0b49 admin admin] PATH_INFO: `/v3/users/000b1ad8cc0041b28f17fc753f590715` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:06.136846 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e227e779-dcb2-4022-b26e-047588fb0b49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=000b1ad8cc0041b28f17fc753f590715)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:06.136846 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e227e779-dcb2-4022-b26e-047588fb0b49 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:06.233225 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-a2f36137-0c7d-4a61-82ca-f15821ac4f8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89e3487f164e4b6381407119830193f4', 'request_id': 'req-a2f36137-0c7d-4a61-82ca-f15821ac4f8d'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:06.454869 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-a2f36137-0c7d-4a61-82ca-f15821ac4f8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89e3487f164e4b6381407119830193f4', 'request_id': 'req-a2f36137-0c7d-4a61-82ca-f15821ac4f8d'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:06.462004 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-a2f36137-0c7d-4a61-82ca-f15821ac4f8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89e3487f164e4b6381407119830193f4', 'request_id': 'req-a2f36137-0c7d-4a61-82ca-f15821ac4f8d'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:06.473779 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-a2f36137-0c7d-4a61-82ca-f15821ac4f8d admin admin] The token cache is being invalidate because project 89e3487f164e4b6381407119830193f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:55:06.474071 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-a2f36137-0c7d-4a61-82ca-f15821ac4f8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:06.474749 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-a2f36137-0c7d-4a61-82ca-f15821ac4f8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:06.476327 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1335/2677] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:55:05 2022] DELETE /identity/v3/projects/89e3487f164e4b6381407119830193f4 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:55:06.479768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f36137-0c7d-4a61-82ca-f15821ac4f8d admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:06.479768 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-a2f36137-0c7d-4a61-82ca-f15821ac4f8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:06.529570 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-e227e779-dcb2-4022-b26e-047588fb0b49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '000b1ad8cc0041b28f17fc753f590715'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:06.548544 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f36137-0c7d-4a61-82ca-f15821ac4f8d admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:06.553199 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bdf731-d8a6-4ac5-bdc1-2f347ef2a638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:06.553832 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bdf731-d8a6-4ac5-bdc1-2f347ef2a638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:06.554128 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bdf731-d8a6-4ac5-bdc1-2f347ef2a638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:06.554401 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bdf731-d8a6-4ac5-bdc1-2f347ef2a638 admin admin] PATH_INFO: `/v3/projects/30cc93e37941443eb697a86b2db1a896` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:06.555563 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bdf731-d8a6-4ac5-bdc1-2f347ef2a638 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30cc93e37941443eb697a86b2db1a896)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:06.557550 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bdf731-d8a6-4ac5-bdc1-2f347ef2a638 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:06.569174 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:06.631221 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-e227e779-dcb2-4022-b26e-047588fb0b49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '000b1ad8cc0041b28f17fc753f590715'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:06.638682 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-e227e779-dcb2-4022-b26e-047588fb0b49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '000b1ad8cc0041b28f17fc753f590715'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:06.640114 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-e227e779-dcb2-4022-b26e-047588fb0b49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '000b1ad8cc0041b28f17fc753f590715'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:06.652004 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-e227e779-dcb2-4022-b26e-047588fb0b49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '000b1ad8cc0041b28f17fc753f590715'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:06.658104 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1343/2678] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:55:06 2022] DELETE /identity/v3/users/000b1ad8cc0041b28f17fc753f590715 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:55:06.659354 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72100f8-aaeb-4702-a4df-9ac04f74edc9 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:06.659645 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72100f8-aaeb-4702-a4df-9ac04f74edc9 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:06.659940 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72100f8-aaeb-4702-a4df-9ac04f74edc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:06.662397 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-53bdf731-d8a6-4ac5-bdc1-2f347ef2a638 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30cc93e37941443eb697a86b2db1a896', 'request_id': 'req-53bdf731-d8a6-4ac5-bdc1-2f347ef2a638'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:06.679492 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-d72100f8-aaeb-4702-a4df-9ac04f74edc9 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:06.680692 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-d72100f8-aaeb-4702-a4df-9ac04f74edc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:06.734567 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-53bdf731-d8a6-4ac5-bdc1-2f347ef2a638 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30cc93e37941443eb697a86b2db1a896', 'request_id': 'req-53bdf731-d8a6-4ac5-bdc1-2f347ef2a638'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:06.740286 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1344/2679] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:55:06.741457 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083207a3-712a-4e03-8711-9e4f5a9d2e01 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:06.741740 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083207a3-712a-4e03-8711-9e4f5a9d2e01 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:06.742013 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083207a3-712a-4e03-8711-9e4f5a9d2e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:06.749230 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-53bdf731-d8a6-4ac5-bdc1-2f347ef2a638 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30cc93e37941443eb697a86b2db1a896', 'request_id': 'req-53bdf731-d8a6-4ac5-bdc1-2f347ef2a638'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:06.761461 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-53bdf731-d8a6-4ac5-bdc1-2f347ef2a638 admin admin] The token cache is being invalidate because project 30cc93e37941443eb697a86b2db1a896 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:55:06.761679 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-083207a3-712a-4e03-8711-9e4f5a9d2e01 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:06.761792 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-53bdf731-d8a6-4ac5-bdc1-2f347ef2a638 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:06.762410 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-53bdf731-d8a6-4ac5-bdc1-2f347ef2a638 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:06.762844 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-083207a3-712a-4e03-8711-9e4f5a9d2e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:06.767464 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1336/2680] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:55:06 2022] DELETE /identity/v3/projects/30cc93e37941443eb697a86b2db1a896 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:55:06.767464 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a34ad-0c17-40a0-92b3-08927f14aebe None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:06.767464 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a34ad-0c17-40a0-92b3-08927f14aebe None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:06.767464 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a34ad-0c17-40a0-92b3-08927f14aebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:06.773385 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1345/2681] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:55:06.774597 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c65f00-321e-407a-b12e-8022439988b6 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:06.774875 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c65f00-321e-407a-b12e-8022439988b6 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:06.775191 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c65f00-321e-407a-b12e-8022439988b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:06.786333 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-ed5a34ad-0c17-40a0-92b3-08927f14aebe None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:06.789529 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-ed5a34ad-0c17-40a0-92b3-08927f14aebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:06.794291 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-f2c65f00-321e-407a-b12e-8022439988b6 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:06.795478 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-f2c65f00-321e-407a-b12e-8022439988b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:06.795870 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1337/2682] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:55:06.800352 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a34ad-0c17-40a0-92b3-08927f14aebe None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:06.801646 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-ed5a34ad-0c17-40a0-92b3-08927f14aebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:06.803807 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1346/2683] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:55:06.804554 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c65f00-321e-407a-b12e-8022439988b6 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:06.815234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c65f00-321e-407a-b12e-8022439988b6 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:06.820389 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194b78e7-7d46-40c9-b8ec-f4a737645200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:06.820987 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b78e7-7d46-40c9-b8ec-f4a737645200 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:06.821401 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b78e7-7d46-40c9-b8ec-f4a737645200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:06.821677 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b78e7-7d46-40c9-b8ec-f4a737645200 admin admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:06.822363 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194b78e7-7d46-40c9-b8ec-f4a737645200 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:55:06.822659 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194b78e7-7d46-40c9-b8ec-f4a737645200 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:06.824292 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194b78e7-7d46-40c9-b8ec-f4a737645200 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:06.835626 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1347/2684] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:55:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:55:06.843846 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cfd31-299c-435a-b12b-493c74f5123e None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:06.843846 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cfd31-299c-435a-b12b-493c74f5123e None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:06.843846 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cfd31-299c-435a-b12b-493c74f5123e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:06.856601 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-3b8cfd31-299c-435a-b12b-493c74f5123e None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:06.857832 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-3b8cfd31-299c-435a-b12b-493c74f5123e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:06.862134 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a34ad-0c17-40a0-92b3-08927f14aebe None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:06.866070 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26686bd1-43f6-4f16-97cd-d48e1bf25c4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:06.866690 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26686bd1-43f6-4f16-97cd-d48e1bf25c4c service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:06.866998 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26686bd1-43f6-4f16-97cd-d48e1bf25c4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:06.867193 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1348/2685] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:55:06.867376 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26686bd1-43f6-4f16-97cd-d48e1bf25c4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:06.867981 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8cfd31-299c-435a-b12b-493c74f5123e None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:06.877236 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26686bd1-43f6-4f16-97cd-d48e1bf25c4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:06.880095 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8cfd31-299c-435a-b12b-493c74f5123e None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:06.880213 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26686bd1-43f6-4f16-97cd-d48e1bf25c4c service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:06.881978 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb9c9a5-0072-419b-885b-98dfb1266fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:06.882629 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9c9a5-0072-419b-885b-98dfb1266fc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:06.882910 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9c9a5-0072-419b-885b-98dfb1266fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:06.883222 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9c9a5-0072-419b-885b-98dfb1266fc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:06.883873 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb9c9a5-0072-419b-885b-98dfb1266fc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:06.885762 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb9c9a5-0072-419b-885b-98dfb1266fc0 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:06.888377 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1338/2686] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:55:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:55:06.895534 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26686bd1-43f6-4f16-97cd-d48e1bf25c4c service neutron] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:06.902154 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:06.904918 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26686bd1-43f6-4f16-97cd-d48e1bf25c4c service neutron] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:06.910114 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65822e6-6fae-45c8-9e2e-84eede36a454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:06.910733 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65822e6-6fae-45c8-9e2e-84eede36a454 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:06.911049 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65822e6-6fae-45c8-9e2e-84eede36a454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:06.911355 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65822e6-6fae-45c8-9e2e-84eede36a454 admin admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:06.912084 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65822e6-6fae-45c8-9e2e-84eede36a454 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:55:06.912422 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65822e6-6fae-45c8-9e2e-84eede36a454 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:06.914018 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65822e6-6fae-45c8-9e2e-84eede36a454 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:06.926459 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1339/2687] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:55:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:55:06.930667 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65822e6-6fae-45c8-9e2e-84eede36a454 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:06.940366 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65822e6-6fae-45c8-9e2e-84eede36a454 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:06.945876 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e85a74-48f1-4285-a065-d907f7692a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:06.949186 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e85a74-48f1-4285-a065-d907f7692a35 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:06.949186 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e85a74-48f1-4285-a065-d907f7692a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:06.949186 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e85a74-48f1-4285-a065-d907f7692a35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:06.949186 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e85a74-48f1-4285-a065-d907f7692a35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:06.949737 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e85a74-48f1-4285-a065-d907f7692a35 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:06.998501 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1349/2688] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:55:06 2022] POST /identity/v3/projects => generated 371 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:55:07.002880 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb9c9a5-0072-419b-885b-98dfb1266fc0 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:07.062310 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb9c9a5-0072-419b-885b-98dfb1266fc0 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:07.066897 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f6114-2a8f-4f06-b6be-e654aa5d359f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:07.067522 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f6114-2a8f-4f06-b6be-e654aa5d359f admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:07.067800 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f6114-2a8f-4f06-b6be-e654aa5d359f admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:07.068072 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f6114-2a8f-4f06-b6be-e654aa5d359f admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:07.068711 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f6114-2a8f-4f06-b6be-e654aa5d359f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:07.070605 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f6114-2a8f-4f06-b6be-e654aa5d359f admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:07.084719 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1340/2689] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:55:06 2022] POST /identity/v3/projects => generated 371 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:55:07.089472 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e85a74-48f1-4285-a065-d907f7692a35 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:07.156881 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e85a74-48f1-4285-a065-d907f7692a35 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:07.161952 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb37354-5491-4200-a5cd-9eb444417914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:07.162799 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb37354-5491-4200-a5cd-9eb444417914 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:07.163279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb37354-5491-4200-a5cd-9eb444417914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:07.163712 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb37354-5491-4200-a5cd-9eb444417914 admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:07.164618 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb37354-5491-4200-a5cd-9eb444417914 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:07.166705 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb37354-5491-4200-a5cd-9eb444417914 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:07.170272 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1350/2690] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:55:07 2022] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:55:07.174975 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f6114-2a8f-4f06-b6be-e654aa5d359f admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:07.185778 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f6114-2a8f-4f06-b6be-e654aa5d359f admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:07.190528 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbac5ac-660f-4888-8dca-3812e1de9b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:07.191300 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbac5ac-660f-4888-8dca-3812e1de9b3d admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:07.191647 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbac5ac-660f-4888-8dca-3812e1de9b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:07.191980 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbac5ac-660f-4888-8dca-3812e1de9b3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:07.192672 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbac5ac-660f-4888-8dca-3812e1de9b3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:07.194260 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbac5ac-660f-4888-8dca-3812e1de9b3d admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:07.204595 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1351/2691] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:55:07.208145 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbac5ac-660f-4888-8dca-3812e1de9b3d admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:07.214892 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:07.219626 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbac5ac-660f-4888-8dca-3812e1de9b3d admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:07.225045 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259e91d-3189-40ec-8679-eadf1f447915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:07.225643 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259e91d-3189-40ec-8679-eadf1f447915 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:07.225928 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259e91d-3189-40ec-8679-eadf1f447915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:07.226201 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259e91d-3189-40ec-8679-eadf1f447915 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:07.226881 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1259e91d-3189-40ec-8679-eadf1f447915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:07.228507 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1259e91d-3189-40ec-8679-eadf1f447915 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:07.240010 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1352/2692] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:55:07.244499 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259e91d-3189-40ec-8679-eadf1f447915 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:07.252490 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1341/2693] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:55:07 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:55:07.253434 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb37354-5491-4200-a5cd-9eb444417914 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:07.254871 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259e91d-3189-40ec-8679-eadf1f447915 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:07.259631 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555ba4f-06f7-45b4-a336-29aa321fc1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:07.260364 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555ba4f-06f7-45b4-a336-29aa321fc1c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:07.260648 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555ba4f-06f7-45b4-a336-29aa321fc1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:07.260923 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555ba4f-06f7-45b4-a336-29aa321fc1c6 admin admin] PATH_INFO: `/v3/projects/fe473ec54cca4e6eb55cf4acbd200acb/users/37eb7963e70c4335aeaa77060d2dee64/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:07.263147 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb37354-5491-4200-a5cd-9eb444417914 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:07.272428 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae61dba-b1ae-4641-86e7-7aeb58bdc8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:07.272428 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae61dba-b1ae-4641-86e7-7aeb58bdc8b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:07.272428 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae61dba-b1ae-4641-86e7-7aeb58bdc8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:07.272428 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae61dba-b1ae-4641-86e7-7aeb58bdc8b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:07.273315 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae61dba-b1ae-4641-86e7-7aeb58bdc8b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:07.273315 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae61dba-b1ae-4641-86e7-7aeb58bdc8b8 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:07.277098 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4555ba4f-06f7-45b4-a336-29aa321fc1c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe473ec54cca4e6eb55cf4acbd200acb, user_id=37eb7963e70c4335aeaa77060d2dee64, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:07.279838 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4555ba4f-06f7-45b4-a336-29aa321fc1c6 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:07.285456 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1342/2694] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:55:07.292493 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae61dba-b1ae-4641-86e7-7aeb58bdc8b8 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:07.302563 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae61dba-b1ae-4641-86e7-7aeb58bdc8b8 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:07.307684 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347d416-0b4f-40ec-8e38-9865b0fbda46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:07.308296 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347d416-0b4f-40ec-8e38-9865b0fbda46 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:07.308578 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347d416-0b4f-40ec-8e38-9865b0fbda46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:07.309193 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347d416-0b4f-40ec-8e38-9865b0fbda46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:07.309635 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a347d416-0b4f-40ec-8e38-9865b0fbda46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:07.311366 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a347d416-0b4f-40ec-8e38-9865b0fbda46 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:07.324017 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1343/2695] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:55:07.325117 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347d416-0b4f-40ec-8e38-9865b0fbda46 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:07.327003 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-a347d416-0b4f-40ec-8e38-9865b0fbda46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:07.341054 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1353/2696] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:55:07 2022] PUT /identity/v3/projects/fe473ec54cca4e6eb55cf4acbd200acb/users/37eb7963e70c4335aeaa77060d2dee64/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:55:07.341054 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555ba4f-06f7-45b4-a336-29aa321fc1c6 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:07.347275 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347d416-0b4f-40ec-8e38-9865b0fbda46 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:07.400108 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec9e8c-ad91-4eea-976f-8d6799e74e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:07.400761 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec9e8c-ad91-4eea-976f-8d6799e74e13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:07.401046 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec9e8c-ad91-4eea-976f-8d6799e74e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:07.401358 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec9e8c-ad91-4eea-976f-8d6799e74e13 admin admin] PATH_INFO: `/v3/projects/75590bf354b7488a94a7fdf337749dc5` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:07.401475 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555ba4f-06f7-45b4-a336-29aa321fc1c6 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:07.402515 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec9e8c-ad91-4eea-976f-8d6799e74e13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75590bf354b7488a94a7fdf337749dc5)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:07.404480 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec9e8c-ad91-4eea-976f-8d6799e74e13 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:07.406832 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b62c58-b237-4e40-b3a0-7b72ea3b3aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:07.407539 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b62c58-b237-4e40-b3a0-7b72ea3b3aed admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:07.407820 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b62c58-b237-4e40-b3a0-7b72ea3b3aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:07.408100 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b62c58-b237-4e40-b3a0-7b72ea3b3aed admin admin] PATH_INFO: `/v3/projects/cbded8c76d3a46f89e1ef7e4d3109a9a/users/1b9409ba7be54808812a6b90976406d7/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:07.422650 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b62c58-b237-4e40-b3a0-7b72ea3b3aed admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbded8c76d3a46f89e1ef7e4d3109a9a, user_id=1b9409ba7be54808812a6b90976406d7, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:07.425370 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b62c58-b237-4e40-b3a0-7b72ea3b3aed admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:07.522764 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1354/2697] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:55:07 2022] PUT /identity/v3/projects/cbded8c76d3a46f89e1ef7e4d3109a9a/users/1b9409ba7be54808812a6b90976406d7/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:55:07.523989 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740f6bf-d9a2-46e8-8ee4-9d580199312a None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:07.524279 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740f6bf-d9a2-46e8-8ee4-9d580199312a None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:07.524575 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740f6bf-d9a2-46e8-8ee4-9d580199312a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:07.544587 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-a740f6bf-d9a2-46e8-8ee4-9d580199312a None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:07.545823 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-a740f6bf-d9a2-46e8-8ee4-9d580199312a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:07.551306 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-0dec9e8c-ad91-4eea-976f-8d6799e74e13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75590bf354b7488a94a7fdf337749dc5', 'request_id': 'req-0dec9e8c-ad91-4eea-976f-8d6799e74e13'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:07.558167 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:07.603261 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1355/2698] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:55:07.604625 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247f567-b4ae-45ee-b903-acdf14670808 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:07.604915 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247f567-b4ae-45ee-b903-acdf14670808 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:07.605191 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247f567-b4ae-45ee-b903-acdf14670808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:07.632570 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-6247f567-b4ae-45ee-b903-acdf14670808 None None] MFA Rules not processed for user `1b9409ba7be54808812a6b90976406d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:07.633773 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-6247f567-b4ae-45ee-b903-acdf14670808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:07.636660 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-0dec9e8c-ad91-4eea-976f-8d6799e74e13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75590bf354b7488a94a7fdf337749dc5', 'request_id': 'req-0dec9e8c-ad91-4eea-976f-8d6799e74e13'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:07.643292 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-0dec9e8c-ad91-4eea-976f-8d6799e74e13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75590bf354b7488a94a7fdf337749dc5', 'request_id': 'req-0dec9e8c-ad91-4eea-976f-8d6799e74e13'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:07.655095 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-0dec9e8c-ad91-4eea-976f-8d6799e74e13 admin admin] The token cache is being invalidate because project 75590bf354b7488a94a7fdf337749dc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:55:07.660912 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-0dec9e8c-ad91-4eea-976f-8d6799e74e13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:07.660912 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-0dec9e8c-ad91-4eea-976f-8d6799e74e13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:07.660912 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1344/2699] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:55:07 2022] DELETE /identity/v3/projects/75590bf354b7488a94a7fdf337749dc5 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:55:07.660912 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec9e8c-ad91-4eea-976f-8d6799e74e13 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:07.660912 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-0dec9e8c-ad91-4eea-976f-8d6799e74e13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:07.701196 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1356/2700] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:55:07.702275 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aadbac-1369-4c71-a83a-15c6a32e65e6 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:07.703194 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aadbac-1369-4c71-a83a-15c6a32e65e6 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:07.703475 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aadbac-1369-4c71-a83a-15c6a32e65e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:07.723254 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec9e8c-ad91-4eea-976f-8d6799e74e13 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:07.724394 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-67aadbac-1369-4c71-a83a-15c6a32e65e6 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:07.725574 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-67aadbac-1369-4c71-a83a-15c6a32e65e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:07.727039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7736b8b-fff0-424e-bb85-cab628fa5b4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:07.727664 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7736b8b-fff0-424e-bb85-cab628fa5b4e service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:07.727985 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7736b8b-fff0-424e-bb85-cab628fa5b4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:07.728261 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7736b8b-fff0-424e-bb85-cab628fa5b4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:07.729995 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-e7736b8b-fff0-424e-bb85-cab628fa5b4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:07.733611 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1357/2701] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:55:07.739711 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aadbac-1369-4c71-a83a-15c6a32e65e6 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:07.739711 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-67aadbac-1369-4c71-a83a-15c6a32e65e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:07.749197 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7736b8b-fff0-424e-bb85-cab628fa5b4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:07.751313 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7736b8b-fff0-424e-bb85-cab628fa5b4e service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:07.761415 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1345/2702] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:55:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:55:07.762778 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c164c77-c286-4e26-bb6c-7862898484d3 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:07.763099 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c164c77-c286-4e26-bb6c-7862898484d3 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:07.763382 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c164c77-c286-4e26-bb6c-7862898484d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:07.773211 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:07.786223 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-4c164c77-c286-4e26-bb6c-7862898484d3 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:07.787454 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-4c164c77-c286-4e26-bb6c-7862898484d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:07.792054 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aadbac-1369-4c71-a83a-15c6a32e65e6 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:07.795684 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1346/2703] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:55:07.799123 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eff642-aa62-4298-b7d0-b4918c1f8869 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '116f66d7dd7b42878f71bd29dc55729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:07.799123 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eff642-aa62-4298-b7d0-b4918c1f8869 service glance] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:07.799123 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eff642-aa62-4298-b7d0-b4918c1f8869 service glance] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:07.799123 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eff642-aa62-4298-b7d0-b4918c1f8869 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:07.801744 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c164c77-c286-4e26-bb6c-7862898484d3 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:07.805611 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eff642-aa62-4298-b7d0-b4918c1f8869 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:07.807061 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eff642-aa62-4298-b7d0-b4918c1f8869 service glance] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:07.808700 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c164c77-c286-4e26-bb6c-7862898484d3 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:07.814001 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835591cd-a9cc-4a89-ab4c-5ad8c3aa02ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:07.814621 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835591cd-a9cc-4a89-ab4c-5ad8c3aa02ab admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:07.814898 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835591cd-a9cc-4a89-ab4c-5ad8c3aa02ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:07.815196 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835591cd-a9cc-4a89-ab4c-5ad8c3aa02ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:07.815887 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835591cd-a9cc-4a89-ab4c-5ad8c3aa02ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:55:07.816186 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835591cd-a9cc-4a89-ab4c-5ad8c3aa02ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:07.816448 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1358/2704] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:55:07 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:55:07.821624 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835591cd-a9cc-4a89-ab4c-5ad8c3aa02ab admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:07.838066 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1347/2705] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:55:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:55:07.839057 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eff642-aa62-4298-b7d0-b4918c1f8869 service glance] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:07.850164 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eff642-aa62-4298-b7d0-b4918c1f8869 service glance] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:07.854827 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018c034-39f2-429b-b528-d3161f0b4e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:07.855466 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018c034-39f2-429b-b528-d3161f0b4e55 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:07.855744 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018c034-39f2-429b-b528-d3161f0b4e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:07.856012 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018c034-39f2-429b-b528-d3161f0b4e55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:07.856659 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1018c034-39f2-429b-b528-d3161f0b4e55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:07.858542 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1018c034-39f2-429b-b528-d3161f0b4e55 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:07.949673 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1359/2706] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:55:07 2022] POST /identity/v3/projects => generated 403 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:55:07.954695 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835591cd-a9cc-4a89-ab4c-5ad8c3aa02ab admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:07.967960 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835591cd-a9cc-4a89-ab4c-5ad8c3aa02ab admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:08.029814 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4f0ff-ebc1-4710-a70b-45c0800e5682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:08.030375 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4f0ff-ebc1-4710-a70b-45c0800e5682 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:08.030662 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4f0ff-ebc1-4710-a70b-45c0800e5682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:08.030935 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4f0ff-ebc1-4710-a70b-45c0800e5682 admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:08.031622 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf4f0ff-ebc1-4710-a70b-45c0800e5682 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:08.033846 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf4f0ff-ebc1-4710-a70b-45c0800e5682 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:08.118022 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1348/2707] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:55:07 2022] POST /identity/v3/users => generated 302 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:55:08.122233 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018c034-39f2-429b-b528-d3161f0b4e55 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:08.133599 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018c034-39f2-429b-b528-d3161f0b4e55 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:08.138340 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd5d17-ee25-4046-a016-bd27afeb66a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:08.139037 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd5d17-ee25-4046-a016-bd27afeb66a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:08.139321 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd5d17-ee25-4046-a016-bd27afeb66a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:08.139642 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd5d17-ee25-4046-a016-bd27afeb66a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:08.140370 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd5d17-ee25-4046-a016-bd27afeb66a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:08.141975 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd5d17-ee25-4046-a016-bd27afeb66a5 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:08.152552 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1360/2708] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:55:08.156754 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4f0ff-ebc1-4710-a70b-45c0800e5682 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:08.166996 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4f0ff-ebc1-4710-a70b-45c0800e5682 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:08.172179 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f7acf-0578-4397-b271-d8f134359449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:08.172791 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f7acf-0578-4397-b271-d8f134359449 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:08.180508 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f7acf-0578-4397-b271-d8f134359449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:08.180508 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f7acf-0578-4397-b271-d8f134359449 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:08.180508 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f7acf-0578-4397-b271-d8f134359449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:08.180508 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f7acf-0578-4397-b271-d8f134359449 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:08.185987 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1349/2709] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:55:08.191078 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd5d17-ee25-4046-a016-bd27afeb66a5 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:08.200837 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd5d17-ee25-4046-a016-bd27afeb66a5 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:08.207165 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097945b-bf57-46d6-828e-e5c0d1cc7ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:08.207805 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097945b-bf57-46d6-828e-e5c0d1cc7ec5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:08.208085 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097945b-bf57-46d6-828e-e5c0d1cc7ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:08.208379 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097945b-bf57-46d6-828e-e5c0d1cc7ec5 admin admin] PATH_INFO: `/v3/projects/279f0cc616e54e8ea128a25d0ddad6b7/users/dc03490050524ab7b11fce5231051e7b/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:08.219938 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:08.223959 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f097945b-bf57-46d6-828e-e5c0d1cc7ec5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=279f0cc616e54e8ea128a25d0ddad6b7, user_id=dc03490050524ab7b11fce5231051e7b, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:08.226782 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f097945b-bf57-46d6-828e-e5c0d1cc7ec5 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:08.295287 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1361/2710] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:55:08 2022] PUT /identity/v3/projects/279f0cc616e54e8ea128a25d0ddad6b7/users/dc03490050524ab7b11fce5231051e7b/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:55:08.311740 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd2509-6b59-4bbe-b930-4fa7691e39ba None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:08.312870 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd2509-6b59-4bbe-b930-4fa7691e39ba None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:08.313148 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd2509-6b59-4bbe-b930-4fa7691e39ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:08.344552 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-e2fd2509-6b59-4bbe-b930-4fa7691e39ba None None] MFA Rules not processed for user `dc03490050524ab7b11fce5231051e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:08.346171 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-e2fd2509-6b59-4bbe-b930-4fa7691e39ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:08.416553 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1350/2711] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:08 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:55:08.421835 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097945b-bf57-46d6-828e-e5c0d1cc7ec5 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:08.480088 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097945b-bf57-46d6-828e-e5c0d1cc7ec5 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:08.485346 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700f8eb-a26d-41cb-a7ae-61a4e88bfcce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:08.486206 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700f8eb-a26d-41cb-a7ae-61a4e88bfcce admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:08.486492 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700f8eb-a26d-41cb-a7ae-61a4e88bfcce admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:08.486762 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700f8eb-a26d-41cb-a7ae-61a4e88bfcce admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:08.487482 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1700f8eb-a26d-41cb-a7ae-61a4e88bfcce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:08.489864 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1700f8eb-a26d-41cb-a7ae-61a4e88bfcce admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:08.565804 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1362/2712] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:55:08 2022] POST /identity/v3/projects => generated 405 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:55:08.570076 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd2509-6b59-4bbe-b930-4fa7691e39ba None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:08.592030 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd2509-6b59-4bbe-b930-4fa7691e39ba None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:08.646074 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:08.656873 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb55e56-09ff-4618-bea9-92a21ad07e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:08.657500 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb55e56-09ff-4618-bea9-92a21ad07e01 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:08.657779 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb55e56-09ff-4618-bea9-92a21ad07e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:08.658048 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb55e56-09ff-4618-bea9-92a21ad07e01 admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:08.658716 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb55e56-09ff-4618-bea9-92a21ad07e01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:08.660671 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb55e56-09ff-4618-bea9-92a21ad07e01 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:08.741114 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1351/2713] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:55:08 2022] POST /identity/v3/users => generated 309 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:55:08.745296 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700f8eb-a26d-41cb-a7ae-61a4e88bfcce admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:08.755629 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700f8eb-a26d-41cb-a7ae-61a4e88bfcce admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:08.760311 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e02e61f-43c5-4d76-abe9-e35b1ba37c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:08.760922 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02e61f-43c5-4d76-abe9-e35b1ba37c8a admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:08.761190 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02e61f-43c5-4d76-abe9-e35b1ba37c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:08.761471 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02e61f-43c5-4d76-abe9-e35b1ba37c8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:08.762150 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e02e61f-43c5-4d76-abe9-e35b1ba37c8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:08.763798 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e02e61f-43c5-4d76-abe9-e35b1ba37c8a admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:08.774761 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1363/2714] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:55:08.779131 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb55e56-09ff-4618-bea9-92a21ad07e01 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:08.790763 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb55e56-09ff-4618-bea9-92a21ad07e01 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:08.796524 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d783266-afce-4497-a6af-63516b720f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:08.797262 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d783266-afce-4497-a6af-63516b720f3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:08.797682 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d783266-afce-4497-a6af-63516b720f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:08.797963 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d783266-afce-4497-a6af-63516b720f3b admin admin] PATH_INFO: `/v3/projects/ab5e0902a77d4f3fa989d0151ccaad7e/users/1fd9bc8068ee4ead82c355bfb5ea6a9a/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:08.813525 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d783266-afce-4497-a6af-63516b720f3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab5e0902a77d4f3fa989d0151ccaad7e, user_id=1fd9bc8068ee4ead82c355bfb5ea6a9a, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:08.817300 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d783266-afce-4497-a6af-63516b720f3b admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:08.918935 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1352/2715] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:55:08 2022] PUT /identity/v3/projects/ab5e0902a77d4f3fa989d0151ccaad7e/users/1fd9bc8068ee4ead82c355bfb5ea6a9a/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:55:08.922992 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e02e61f-43c5-4d76-abe9-e35b1ba37c8a admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:08.932870 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e02e61f-43c5-4d76-abe9-e35b1ba37c8a admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:09.006096 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f5cd7-e57c-4e90-8dc2-383ddfee1f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:09.006096 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f5cd7-e57c-4e90-8dc2-383ddfee1f2d admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:09.006096 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f5cd7-e57c-4e90-8dc2-383ddfee1f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:09.006096 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f5cd7-e57c-4e90-8dc2-383ddfee1f2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:09.006572 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5f5cd7-e57c-4e90-8dc2-383ddfee1f2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:09.006572 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5f5cd7-e57c-4e90-8dc2-383ddfee1f2d admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:09.015089 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1364/2716] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:55:09.016694 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d783266-afce-4497-a6af-63516b720f3b admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:09.027867 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d783266-afce-4497-a6af-63516b720f3b admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:09.035426 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6456d016-21b4-45a0-aca0-25792ba1d54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:09.037160 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456d016-21b4-45a0-aca0-25792ba1d54f admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:09.037543 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456d016-21b4-45a0-aca0-25792ba1d54f admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:09.037917 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456d016-21b4-45a0-aca0-25792ba1d54f admin admin] PATH_INFO: `/v3/projects/ab5e0902a77d4f3fa989d0151ccaad7e/users/1fd9bc8068ee4ead82c355bfb5ea6a9a/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:09.040966 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6456d016-21b4-45a0-aca0-25792ba1d54f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab5e0902a77d4f3fa989d0151ccaad7e, user_id=1fd9bc8068ee4ead82c355bfb5ea6a9a, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:09.043719 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6456d016-21b4-45a0-aca0-25792ba1d54f admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:09.056086 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1353/2717] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:55:09 2022] PUT /identity/v3/projects/ab5e0902a77d4f3fa989d0151ccaad7e/users/1fd9bc8068ee4ead82c355bfb5ea6a9a/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:55:09.066475 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bee462-086a-479a-ba20-88637cf8aa58 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:09.066764 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bee462-086a-479a-ba20-88637cf8aa58 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:09.067087 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bee462-086a-479a-ba20-88637cf8aa58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:09.071902 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ab9d5-1ccc-4c6f-b135-bb530b9bfa6d None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:09.072274 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ab9d5-1ccc-4c6f-b135-bb530b9bfa6d None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:09.072612 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ab9d5-1ccc-4c6f-b135-bb530b9bfa6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:09.099111 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-c7bee462-086a-479a-ba20-88637cf8aa58 None None] MFA Rules not processed for user `1fd9bc8068ee4ead82c355bfb5ea6a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:09.100475 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-c7bee462-086a-479a-ba20-88637cf8aa58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:09.109880 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-160ab9d5-1ccc-4c6f-b135-bb530b9bfa6d None None] MFA Rules not processed for user `37eb7963e70c4335aeaa77060d2dee64`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:09.111598 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-160ab9d5-1ccc-4c6f-b135-bb530b9bfa6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:09.160307 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:09.188731 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1354/2718] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:55:09.193490 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ab9d5-1ccc-4c6f-b135-bb530b9bfa6d None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:09.196082 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-160ab9d5-1ccc-4c6f-b135-bb530b9bfa6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:09.198680 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1365/2719] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:09 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:55:09.211819 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bee462-086a-479a-ba20-88637cf8aa58 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:09.213470 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-c7bee462-086a-479a-ba20-88637cf8aa58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:09.284008 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ab9d5-1ccc-4c6f-b135-bb530b9bfa6d None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:09.288935 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbe860-4c57-4f5b-8b62-63fce025639a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:09.289616 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbe860-4c57-4f5b-8b62-63fce025639a admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:09.289901 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbe860-4c57-4f5b-8b62-63fce025639a admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:09.290289 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbe860-4c57-4f5b-8b62-63fce025639a admin admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:09.291201 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fbe860-4c57-4f5b-8b62-63fce025639a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:09.293213 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bee462-086a-479a-ba20-88637cf8aa58 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:09.293461 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fbe860-4c57-4f5b-8b62-63fce025639a admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:09.298408 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce989ac-b0ec-4d90-bd46-afb6307a6762 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:09.299242 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce989ac-b0ec-4d90-bd46-afb6307a6762 service cinder] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:09.299519 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce989ac-b0ec-4d90-bd46-afb6307a6762 service cinder] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:09.299789 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce989ac-b0ec-4d90-bd46-afb6307a6762 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:09.309439 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce989ac-b0ec-4d90-bd46-afb6307a6762 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:09.310877 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce989ac-b0ec-4d90-bd46-afb6307a6762 service cinder] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:09.321276 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1366/2720] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:55:09 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:55:09.404732 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1355/2721] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:55:09 2022] POST /identity/v3/projects => generated 371 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:55:09.408738 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce989ac-b0ec-4d90-bd46-afb6307a6762 service cinder] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:09.419773 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce989ac-b0ec-4d90-bd46-afb6307a6762 service cinder] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:09.465011 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbe860-4c57-4f5b-8b62-63fce025639a admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:09.485895 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:09.487351 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8350948-3ed4-42a5-9542-bc2a50ec3d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:09.487979 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8350948-3ed4-42a5-9542-bc2a50ec3d12 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:09.488276 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8350948-3ed4-42a5-9542-bc2a50ec3d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:09.488611 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8350948-3ed4-42a5-9542-bc2a50ec3d12 admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:09.489375 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8350948-3ed4-42a5-9542-bc2a50ec3d12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:09.491474 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8350948-3ed4-42a5-9542-bc2a50ec3d12 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:09.528905 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbe860-4c57-4f5b-8b62-63fce025639a admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:09.533507 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da2ffb-6baf-47f0-bb6b-1f9e92271f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:09.534140 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da2ffb-6baf-47f0-bb6b-1f9e92271f04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:09.534418 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da2ffb-6baf-47f0-bb6b-1f9e92271f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:09.534689 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da2ffb-6baf-47f0-bb6b-1f9e92271f04 admin admin] PATH_INFO: `/v3/users/dc03490050524ab7b11fce5231051e7b` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:09.535891 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21da2ffb-6baf-47f0-bb6b-1f9e92271f04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc03490050524ab7b11fce5231051e7b)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:09.537785 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21da2ffb-6baf-47f0-bb6b-1f9e92271f04 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:09.610404 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1367/2722] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:55:09 2022] POST /identity/v3/users => generated 292 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:55:09.614624 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8350948-3ed4-42a5-9542-bc2a50ec3d12 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:09.625709 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8350948-3ed4-42a5-9542-bc2a50ec3d12 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:09.632631 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a384e-0dda-4ff5-9904-f888c0908d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:09.635485 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a384e-0dda-4ff5-9904-f888c0908d17 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:09.635485 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a384e-0dda-4ff5-9904-f888c0908d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:09.635485 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a384e-0dda-4ff5-9904-f888c0908d17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:09.635800 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a384e-0dda-4ff5-9904-f888c0908d17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:09.637698 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a384e-0dda-4ff5-9904-f888c0908d17 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:09.648780 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1368/2723] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:55:09.654425 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a384e-0dda-4ff5-9904-f888c0908d17 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:09.664216 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a384e-0dda-4ff5-9904-f888c0908d17 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:09.668907 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9379641-a290-4398-9a80-e0df2c9278f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:09.669632 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9379641-a290-4398-9a80-e0df2c9278f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:09.670077 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9379641-a290-4398-9a80-e0df2c9278f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:09.670249 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9379641-a290-4398-9a80-e0df2c9278f0 admin admin] PATH_INFO: `/v3/projects/ffa4221a82b54cd58722c31682460233/users/d200d071a4d040dd8835ada85b6c5dc8/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:09.693281 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9379641-a290-4398-9a80-e0df2c9278f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffa4221a82b54cd58722c31682460233, user_id=d200d071a4d040dd8835ada85b6c5dc8, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:09.693281 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9379641-a290-4398-9a80-e0df2c9278f0 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:09.722535 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-21da2ffb-6baf-47f0-bb6b-1f9e92271f04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc03490050524ab7b11fce5231051e7b'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:09.804273 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1369/2724] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:55:09 2022] PUT /identity/v3/projects/ffa4221a82b54cd58722c31682460233/users/d200d071a4d040dd8835ada85b6c5dc8/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:55:09.808249 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9379641-a290-4398-9a80-e0df2c9278f0 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:09.825843 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-21da2ffb-6baf-47f0-bb6b-1f9e92271f04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc03490050524ab7b11fce5231051e7b'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:09.833349 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-21da2ffb-6baf-47f0-bb6b-1f9e92271f04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc03490050524ab7b11fce5231051e7b'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:09.846320 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-21da2ffb-6baf-47f0-bb6b-1f9e92271f04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc03490050524ab7b11fce5231051e7b'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:09.847057 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-21da2ffb-6baf-47f0-bb6b-1f9e92271f04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc03490050524ab7b11fce5231051e7b'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:09.853271 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:09.853524 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1356/2725] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:55:09 2022] DELETE /identity/v3/users/dc03490050524ab7b11fce5231051e7b => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:55:09.858995 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd80905-c5bf-432a-b74d-96506e1a2a2a None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:09.859696 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd80905-c5bf-432a-b74d-96506e1a2a2a None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:09.860199 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd80905-c5bf-432a-b74d-96506e1a2a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:09.873588 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9379641-a290-4398-9a80-e0df2c9278f0 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:09.881354 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-efd80905-c5bf-432a-b74d-96506e1a2a2a None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:09.882584 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-efd80905-c5bf-432a-b74d-96506e1a2a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:09.934040 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d024e69-c80d-4a9e-bd84-920e8e0c9b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:09.934653 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d024e69-c80d-4a9e-bd84-920e8e0c9b5b admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:09.934930 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d024e69-c80d-4a9e-bd84-920e8e0c9b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:09.935227 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d024e69-c80d-4a9e-bd84-920e8e0c9b5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:09.935912 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d024e69-c80d-4a9e-bd84-920e8e0c9b5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:09.937536 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d024e69-c80d-4a9e-bd84-920e8e0c9b5b admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:09.947484 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1370/2726] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:55:09.951504 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d024e69-c80d-4a9e-bd84-920e8e0c9b5b admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:09.953550 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-4d024e69-c80d-4a9e-bd84-920e8e0c9b5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:09.954093 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1357/2727] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:55:09.966104 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd80905-c5bf-432a-b74d-96506e1a2a2a None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:09.968155 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-efd80905-c5bf-432a-b74d-96506e1a2a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:09.969347 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d024e69-c80d-4a9e-bd84-920e8e0c9b5b admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:09.973979 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50b878-e411-4443-972f-c33e1a2b365d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:09.974645 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50b878-e411-4443-972f-c33e1a2b365d admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:09.974921 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50b878-e411-4443-972f-c33e1a2b365d admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:09.975221 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50b878-e411-4443-972f-c33e1a2b365d admin admin] PATH_INFO: `/v3/projects/ffa4221a82b54cd58722c31682460233/users/d200d071a4d040dd8835ada85b6c5dc8/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:09.977158 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f50b878-e411-4443-972f-c33e1a2b365d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffa4221a82b54cd58722c31682460233, user_id=d200d071a4d040dd8835ada85b6c5dc8, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:09.979821 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f50b878-e411-4443-972f-c33e1a2b365d admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:09.990889 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1371/2728] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:55:09 2022] PUT /identity/v3/projects/ffa4221a82b54cd58722c31682460233/users/d200d071a4d040dd8835ada85b6c5dc8/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:55:10.013970 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:10.028399 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd80905-c5bf-432a-b74d-96506e1a2a2a None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:10.079501 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38ad44-7b69-4abf-b266-84e68c3ff545 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:10.080357 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38ad44-7b69-4abf-b266-84e68c3ff545 service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:10.080671 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38ad44-7b69-4abf-b266-84e68c3ff545 service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:10.080944 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38ad44-7b69-4abf-b266-84e68c3ff545 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:10.144155 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38ad44-7b69-4abf-b266-84e68c3ff545 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:10.145654 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38ad44-7b69-4abf-b266-84e68c3ff545 service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:10.155495 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1358/2729] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:55:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:55:10.645556 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50b878-e411-4443-972f-c33e1a2b365d admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:10.647559 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-0f50b878-e411-4443-972f-c33e1a2b365d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:10.664370 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50b878-e411-4443-972f-c33e1a2b365d admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:10.669457 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae3a12-8514-4d9e-a299-6773a10d6dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:10.677071 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae3a12-8514-4d9e-a299-6773a10d6dd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:10.677071 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae3a12-8514-4d9e-a299-6773a10d6dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:10.677071 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae3a12-8514-4d9e-a299-6773a10d6dd9 admin admin] PATH_INFO: `/v3/projects/279f0cc616e54e8ea128a25d0ddad6b7` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:10.677071 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae3a12-8514-4d9e-a299-6773a10d6dd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=279f0cc616e54e8ea128a25d0ddad6b7)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:10.677071 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae3a12-8514-4d9e-a299-6773a10d6dd9 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:10.809594 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-2fae3a12-8514-4d9e-a299-6773a10d6dd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '279f0cc616e54e8ea128a25d0ddad6b7', 'request_id': 'req-2fae3a12-8514-4d9e-a299-6773a10d6dd9'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:10.866471 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-2fae3a12-8514-4d9e-a299-6773a10d6dd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '279f0cc616e54e8ea128a25d0ddad6b7', 'request_id': 'req-2fae3a12-8514-4d9e-a299-6773a10d6dd9'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:10.872934 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-2fae3a12-8514-4d9e-a299-6773a10d6dd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '279f0cc616e54e8ea128a25d0ddad6b7', 'request_id': 'req-2fae3a12-8514-4d9e-a299-6773a10d6dd9'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:10.884748 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-2fae3a12-8514-4d9e-a299-6773a10d6dd9 admin admin] The token cache is being invalidate because project 279f0cc616e54e8ea128a25d0ddad6b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:55:10.885026 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-2fae3a12-8514-4d9e-a299-6773a10d6dd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:10.885665 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-2fae3a12-8514-4d9e-a299-6773a10d6dd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:10.887494 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1372/2730] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:55:10 2022] DELETE /identity/v3/projects/279f0cc616e54e8ea128a25d0ddad6b7 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:55:10.892066 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38ad44-7b69-4abf-b266-84e68c3ff545 service neutron] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:10.902606 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38ad44-7b69-4abf-b266-84e68c3ff545 service neutron] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:10.963594 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4cb5c-ce01-4aac-9431-7471b0f6d1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:10.964183 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4cb5c-ce01-4aac-9431-7471b0f6d1e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:10.964577 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4cb5c-ce01-4aac-9431-7471b0f6d1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:10.964853 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4cb5c-ce01-4aac-9431-7471b0f6d1e3 admin admin] PATH_INFO: `/v3/users/1fd9bc8068ee4ead82c355bfb5ea6a9a` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:10.966229 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e4cb5c-ce01-4aac-9431-7471b0f6d1e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fd9bc8068ee4ead82c355bfb5ea6a9a)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:10.968552 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e4cb5c-ce01-4aac-9431-7471b0f6d1e3 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:11.101174 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:11.102805 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-c3e4cb5c-ce01-4aac-9431-7471b0f6d1e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fd9bc8068ee4ead82c355bfb5ea6a9a'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:11.157278 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-c3e4cb5c-ce01-4aac-9431-7471b0f6d1e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fd9bc8068ee4ead82c355bfb5ea6a9a'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:11.164717 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-c3e4cb5c-ce01-4aac-9431-7471b0f6d1e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fd9bc8068ee4ead82c355bfb5ea6a9a'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:11.177265 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-c3e4cb5c-ce01-4aac-9431-7471b0f6d1e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fd9bc8068ee4ead82c355bfb5ea6a9a'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:11.182212 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-c3e4cb5c-ce01-4aac-9431-7471b0f6d1e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fd9bc8068ee4ead82c355bfb5ea6a9a'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:11.183810 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1359/2731] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:55:10 2022] DELETE /identity/v3/users/1fd9bc8068ee4ead82c355bfb5ea6a9a => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:55:11.305669 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504a8b2-f1de-448a-8664-12c00d8c8635 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:11.305960 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504a8b2-f1de-448a-8664-12c00d8c8635 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:11.312173 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504a8b2-f1de-448a-8664-12c00d8c8635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:11.338299 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-4504a8b2-f1de-448a-8664-12c00d8c8635 None None] MFA Rules not processed for user `d200d071a4d040dd8835ada85b6c5dc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:11.339848 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-4504a8b2-f1de-448a-8664-12c00d8c8635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:11.394693 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:11.437733 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1373/2732] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:11 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:55:11.447936 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42e645-2e7d-4058-8b44-426ad4b1e85b None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:11.448233 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42e645-2e7d-4058-8b44-426ad4b1e85b None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:11.448516 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42e645-2e7d-4058-8b44-426ad4b1e85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:11.467686 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-5c42e645-2e7d-4058-8b44-426ad4b1e85b None None] MFA Rules not processed for user `37eb7963e70c4335aeaa77060d2dee64`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:11.469543 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-5c42e645-2e7d-4058-8b44-426ad4b1e85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:11.531615 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1360/2733] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:55:11.542753 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504a8b2-f1de-448a-8664-12c00d8c8635 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:11.544332 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-4504a8b2-f1de-448a-8664-12c00d8c8635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:11.620339 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504a8b2-f1de-448a-8664-12c00d8c8635 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:11.626003 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18187c6e-413f-43b3-9e8e-c392a38a8127 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:11.626644 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18187c6e-413f-43b3-9e8e-c392a38a8127 service nova] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:11.626924 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18187c6e-413f-43b3-9e8e-c392a38a8127 service nova] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:11.627220 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18187c6e-413f-43b3-9e8e-c392a38a8127 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:11.629039 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-18187c6e-413f-43b3-9e8e-c392a38a8127 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:11.641013 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18187c6e-413f-43b3-9e8e-c392a38a8127 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:11.642643 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18187c6e-413f-43b3-9e8e-c392a38a8127 service nova] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:11.645204 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42e645-2e7d-4058-8b44-426ad4b1e85b None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:11.646615 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-5c42e645-2e7d-4058-8b44-426ad4b1e85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:11.653534 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1374/2734] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:55:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:55:11.731347 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42e645-2e7d-4058-8b44-426ad4b1e85b None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:11.736185 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a114b3-f5bb-42bd-a137-44cf5e4e5f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:11.741076 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a114b3-f5bb-42bd-a137-44cf5e4e5f1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:11.741076 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a114b3-f5bb-42bd-a137-44cf5e4e5f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:11.741076 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a114b3-f5bb-42bd-a137-44cf5e4e5f1f admin admin] PATH_INFO: `/v3/projects/ab5e0902a77d4f3fa989d0151ccaad7e` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:11.741076 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a114b3-f5bb-42bd-a137-44cf5e4e5f1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab5e0902a77d4f3fa989d0151ccaad7e)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:11.741076 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a114b3-f5bb-42bd-a137-44cf5e4e5f1f admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:11.884898 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-c0a114b3-f5bb-42bd-a137-44cf5e4e5f1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab5e0902a77d4f3fa989d0151ccaad7e', 'request_id': 'req-c0a114b3-f5bb-42bd-a137-44cf5e4e5f1f'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:11.908627 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18187c6e-413f-43b3-9e8e-c392a38a8127 service nova] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:11.910040 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-18187c6e-413f-43b3-9e8e-c392a38a8127 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:11.963148 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-c0a114b3-f5bb-42bd-a137-44cf5e4e5f1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab5e0902a77d4f3fa989d0151ccaad7e', 'request_id': 'req-c0a114b3-f5bb-42bd-a137-44cf5e4e5f1f'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:11.967676 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18187c6e-413f-43b3-9e8e-c392a38a8127 service nova] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:11.970302 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-c0a114b3-f5bb-42bd-a137-44cf5e4e5f1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab5e0902a77d4f3fa989d0151ccaad7e', 'request_id': 'req-c0a114b3-f5bb-42bd-a137-44cf5e4e5f1f'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:11.979660 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:11.985099 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-c0a114b3-f5bb-42bd-a137-44cf5e4e5f1f admin admin] The token cache is being invalidate because project ab5e0902a77d4f3fa989d0151ccaad7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:55:11.985771 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-c0a114b3-f5bb-42bd-a137-44cf5e4e5f1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:11.986066 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-c0a114b3-f5bb-42bd-a137-44cf5e4e5f1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:11.988133 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1361/2735] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:55:11 2022] DELETE /identity/v3/projects/ab5e0902a77d4f3fa989d0151ccaad7e => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:55:11.992544 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd363de6-b42d-4043-b30c-380b18f540cf None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:11.992829 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd363de6-b42d-4043-b30c-380b18f540cf None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:11.993111 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd363de6-b42d-4043-b30c-380b18f540cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:12.011804 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-fd363de6-b42d-4043-b30c-380b18f540cf None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:12.013165 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-fd363de6-b42d-4043-b30c-380b18f540cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:12.018499 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdae2a8-c61c-4536-bcb0-ee54eb0ed184 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:12.019219 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdae2a8-c61c-4536-bcb0-ee54eb0ed184 service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:12.019604 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdae2a8-c61c-4536-bcb0-ee54eb0ed184 service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:12.019880 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdae2a8-c61c-4536-bcb0-ee54eb0ed184 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:12.021947 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-bbdae2a8-c61c-4536-bcb0-ee54eb0ed184 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:12.033420 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdae2a8-c61c-4536-bcb0-ee54eb0ed184 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:12.034870 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdae2a8-c61c-4536-bcb0-ee54eb0ed184 service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:12.043214 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1375/2736] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:55:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:55:12.079339 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1362/2737] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:55:12.086329 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabd43c-f0fe-4dd4-a0b5-0497557e3cc0 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:12.086620 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabd43c-f0fe-4dd4-a0b5-0497557e3cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:12.086895 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabd43c-f0fe-4dd4-a0b5-0497557e3cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:12.108776 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-dcabd43c-f0fe-4dd4-a0b5-0497557e3cc0 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:12.110200 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-dcabd43c-f0fe-4dd4-a0b5-0497557e3cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:12.121016 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1376/2738] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:55:12.123920 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd363de6-b42d-4043-b30c-380b18f540cf None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:12.134090 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd363de6-b42d-4043-b30c-380b18f540cf None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:12.139728 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3698d-ce6f-4262-a8c2-887d27e08bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:12.140347 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3698d-ce6f-4262-a8c2-887d27e08bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:12.144894 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3698d-ce6f-4262-a8c2-887d27e08bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:12.144894 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3698d-ce6f-4262-a8c2-887d27e08bf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:12.144894 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f3698d-ce6f-4262-a8c2-887d27e08bf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:55:12.144894 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f3698d-ce6f-4262-a8c2-887d27e08bf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:12.144894 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f3698d-ce6f-4262-a8c2-887d27e08bf7 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:12.156124 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1363/2739] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:55:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:55:12.160940 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcabd43c-f0fe-4dd4-a0b5-0497557e3cc0 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:12.170981 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcabd43c-f0fe-4dd4-a0b5-0497557e3cc0 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:12.175915 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89540a-146e-4a83-9228-80f6ddfe794b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:12.176599 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89540a-146e-4a83-9228-80f6ddfe794b admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:12.176948 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89540a-146e-4a83-9228-80f6ddfe794b admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:12.177288 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89540a-146e-4a83-9228-80f6ddfe794b admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:12.178088 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f89540a-146e-4a83-9228-80f6ddfe794b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:12.180059 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f89540a-146e-4a83-9228-80f6ddfe794b admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:12.198286 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:12.291138 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1377/2740] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:55:12 2022] POST /identity/v3/projects => generated 371 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:55:12.295666 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3698d-ce6f-4262-a8c2-887d27e08bf7 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:12.307936 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3698d-ce6f-4262-a8c2-887d27e08bf7 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:12.366318 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f28acc-9cba-47c0-a589-5aec2869b97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:12.366934 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f28acc-9cba-47c0-a589-5aec2869b97d admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:12.367244 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f28acc-9cba-47c0-a589-5aec2869b97d admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:12.367521 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f28acc-9cba-47c0-a589-5aec2869b97d admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:12.368180 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f28acc-9cba-47c0-a589-5aec2869b97d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:12.370162 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f28acc-9cba-47c0-a589-5aec2869b97d admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:12.456454 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1364/2741] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:55:12 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:55:12.460815 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89540a-146e-4a83-9228-80f6ddfe794b admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:12.487711 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89540a-146e-4a83-9228-80f6ddfe794b admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:12.487711 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c496d-b1fc-4b99-8a55-b298d2484f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:12.487711 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c496d-b1fc-4b99-8a55-b298d2484f03 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:12.487711 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c496d-b1fc-4b99-8a55-b298d2484f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:12.488391 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c496d-b1fc-4b99-8a55-b298d2484f03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:12.488391 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c496d-b1fc-4b99-8a55-b298d2484f03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:12.488391 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c496d-b1fc-4b99-8a55-b298d2484f03 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:12.499820 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1378/2742] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:55:12.504895 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f28acc-9cba-47c0-a589-5aec2869b97d admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:12.514902 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f28acc-9cba-47c0-a589-5aec2869b97d admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:12.519589 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cca602-7998-4955-b003-f027960231ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:12.520303 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cca602-7998-4955-b003-f027960231ef admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:12.520486 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cca602-7998-4955-b003-f027960231ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:12.520763 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cca602-7998-4955-b003-f027960231ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:12.521464 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cca602-7998-4955-b003-f027960231ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:12.523071 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cca602-7998-4955-b003-f027960231ef admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:12.536704 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1365/2743] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:55:12.541026 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c496d-b1fc-4b99-8a55-b298d2484f03 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:12.551700 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c496d-b1fc-4b99-8a55-b298d2484f03 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:12.556420 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807907e7-d1fc-4ef8-8aed-845290eda839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:12.557082 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807907e7-d1fc-4ef8-8aed-845290eda839 admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:12.557359 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807907e7-d1fc-4ef8-8aed-845290eda839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:12.557631 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807907e7-d1fc-4ef8-8aed-845290eda839 admin admin] PATH_INFO: `/v3/projects/f0b65d232b6148aabb7b105785b6356f/users/31d628ff91b54e0abeec62d4a4a5803a/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:12.573538 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807907e7-d1fc-4ef8-8aed-845290eda839 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0b65d232b6148aabb7b105785b6356f, user_id=31d628ff91b54e0abeec62d4a4a5803a, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:12.576833 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807907e7-d1fc-4ef8-8aed-845290eda839 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:12.690486 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1379/2744] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:55:12 2022] PUT /identity/v3/projects/f0b65d232b6148aabb7b105785b6356f/users/31d628ff91b54e0abeec62d4a4a5803a/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:55:12.701699 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f76fc6-0edc-42dc-9d5e-26820f45241b None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:12.701995 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f76fc6-0edc-42dc-9d5e-26820f45241b None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:12.702283 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f76fc6-0edc-42dc-9d5e-26820f45241b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:12.732248 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-f2f76fc6-0edc-42dc-9d5e-26820f45241b None None] MFA Rules not processed for user `31d628ff91b54e0abeec62d4a4a5803a`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:12.733495 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-f2f76fc6-0edc-42dc-9d5e-26820f45241b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:12.790438 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:12.802185 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1366/2745] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:55:12.806601 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807907e7-d1fc-4ef8-8aed-845290eda839 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:12.877116 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807907e7-d1fc-4ef8-8aed-845290eda839 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:12.881965 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61cb76-b0df-4300-936e-a36822aae0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:12.882734 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61cb76-b0df-4300-936e-a36822aae0fe admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:12.883054 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61cb76-b0df-4300-936e-a36822aae0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:12.883324 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61cb76-b0df-4300-936e-a36822aae0fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:12.884206 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b61cb76-b0df-4300-936e-a36822aae0fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:12.886519 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b61cb76-b0df-4300-936e-a36822aae0fe admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:12.982692 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1380/2746] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:55:12 2022] POST /identity/v3/projects => generated 371 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:55:12.987131 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f76fc6-0edc-42dc-9d5e-26820f45241b None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:12.997612 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f76fc6-0edc-42dc-9d5e-26820f45241b None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:13.059428 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247c155-ad1f-46ff-916e-b1f38b395f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:13.059983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247c155-ad1f-46ff-916e-b1f38b395f64 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:13.060262 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247c155-ad1f-46ff-916e-b1f38b395f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:13.060534 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247c155-ad1f-46ff-916e-b1f38b395f64 admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:13.061203 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2247c155-ad1f-46ff-916e-b1f38b395f64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:13.063280 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2247c155-ad1f-46ff-916e-b1f38b395f64 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:13.161532 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1367/2747] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:55:12 2022] POST /identity/v3/users => generated 292 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:55:13.165644 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61cb76-b0df-4300-936e-a36822aae0fe admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:13.176985 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61cb76-b0df-4300-936e-a36822aae0fe admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:13.181736 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c39fd3-ad01-4ebd-bb0d-5ecb02a10c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:13.182342 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c39fd3-ad01-4ebd-bb0d-5ecb02a10c1c admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:13.190475 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c39fd3-ad01-4ebd-bb0d-5ecb02a10c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:13.190475 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c39fd3-ad01-4ebd-bb0d-5ecb02a10c1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:13.190475 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c39fd3-ad01-4ebd-bb0d-5ecb02a10c1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:13.190475 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c39fd3-ad01-4ebd-bb0d-5ecb02a10c1c admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:13.195901 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1381/2748] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:55:13.200011 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247c155-ad1f-46ff-916e-b1f38b395f64 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:13.211073 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247c155-ad1f-46ff-916e-b1f38b395f64 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:13.215858 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6ddfe-fda5-4d24-8ff4-f4d91520303f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:13.216520 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6ddfe-fda5-4d24-8ff4-f4d91520303f admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:13.216798 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6ddfe-fda5-4d24-8ff4-f4d91520303f admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:13.217071 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6ddfe-fda5-4d24-8ff4-f4d91520303f admin admin] PATH_INFO: `/v3/projects/ab110aa0dffc466c88cb758bf76382f3/users/a2a1c1cf75d243039777b9981f3e5fc2/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:13.233521 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6ddfe-fda5-4d24-8ff4-f4d91520303f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab110aa0dffc466c88cb758bf76382f3, user_id=a2a1c1cf75d243039777b9981f3e5fc2, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:13.236359 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6ddfe-fda5-4d24-8ff4-f4d91520303f admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:13.323614 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1368/2749] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:55:13 2022] PUT /identity/v3/projects/ab110aa0dffc466c88cb758bf76382f3/users/a2a1c1cf75d243039777b9981f3e5fc2/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:55:13.327656 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c39fd3-ad01-4ebd-bb0d-5ecb02a10c1c admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:13.338794 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c39fd3-ad01-4ebd-bb0d-5ecb02a10c1c admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:13.398607 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e0d4a-1b44-4c6a-94eb-cf885078f20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:13.399259 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e0d4a-1b44-4c6a-94eb-cf885078f20f admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:13.399540 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e0d4a-1b44-4c6a-94eb-cf885078f20f admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:13.399812 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e0d4a-1b44-4c6a-94eb-cf885078f20f admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:13.400495 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e0d4a-1b44-4c6a-94eb-cf885078f20f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:13.402135 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e0d4a-1b44-4c6a-94eb-cf885078f20f admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:13.412448 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1382/2750] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:55:13.416900 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6ddfe-fda5-4d24-8ff4-f4d91520303f admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:13.427915 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6ddfe-fda5-4d24-8ff4-f4d91520303f admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:13.433514 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280984be-bab0-4f40-8ac0-380e28fc6098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:13.434182 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280984be-bab0-4f40-8ac0-380e28fc6098 admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:13.434463 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280984be-bab0-4f40-8ac0-380e28fc6098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:13.434740 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280984be-bab0-4f40-8ac0-380e28fc6098 admin admin] PATH_INFO: `/v3/projects/ab110aa0dffc466c88cb758bf76382f3/users/a2a1c1cf75d243039777b9981f3e5fc2/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:13.437015 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280984be-bab0-4f40-8ac0-380e28fc6098 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab110aa0dffc466c88cb758bf76382f3, user_id=a2a1c1cf75d243039777b9981f3e5fc2, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:13.439715 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280984be-bab0-4f40-8ac0-380e28fc6098 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:13.452278 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1369/2751] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:55:13 2022] PUT /identity/v3/projects/ab110aa0dffc466c88cb758bf76382f3/users/a2a1c1cf75d243039777b9981f3e5fc2/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:55:13.463522 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099878fa-549a-44db-a85e-113123d099a3 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:13.464532 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099878fa-549a-44db-a85e-113123d099a3 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:13.464532 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099878fa-549a-44db-a85e-113123d099a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:13.493133 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-099878fa-549a-44db-a85e-113123d099a3 None None] MFA Rules not processed for user `a2a1c1cf75d243039777b9981f3e5fc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:13.494406 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-099878fa-549a-44db-a85e-113123d099a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:13.514607 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:13.574454 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1383/2752] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:13 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:55:13.592919 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280984be-bab0-4f40-8ac0-380e28fc6098 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:13.595594 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-280984be-bab0-4f40-8ac0-380e28fc6098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:13.658213 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280984be-bab0-4f40-8ac0-380e28fc6098 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:13.661930 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988cae88-3088-47b5-a8a8-7bf97ba7acab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:13.662553 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988cae88-3088-47b5-a8a8-7bf97ba7acab service cinder] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:13.662897 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988cae88-3088-47b5-a8a8-7bf97ba7acab service cinder] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:13.663209 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988cae88-3088-47b5-a8a8-7bf97ba7acab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:13.672429 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988cae88-3088-47b5-a8a8-7bf97ba7acab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:13.680054 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988cae88-3088-47b5-a8a8-7bf97ba7acab service cinder] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:13.684481 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1370/2753] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:55:13 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:55:13.931062 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099878fa-549a-44db-a85e-113123d099a3 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:13.942127 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099878fa-549a-44db-a85e-113123d099a3 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:13.946044 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac364af-7da9-44be-aba7-32a8fec05f5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:13.946679 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac364af-7da9-44be-aba7-32a8fec05f5d service cinder] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:13.946993 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac364af-7da9-44be-aba7-32a8fec05f5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:13.947338 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac364af-7da9-44be-aba7-32a8fec05f5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:14.009285 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac364af-7da9-44be-aba7-32a8fec05f5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:14.011136 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac364af-7da9-44be-aba7-32a8fec05f5d service cinder] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:14.020181 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1384/2754] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:55:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:55:23.679363 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=73,keystone:INSERT=5 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:24.016263 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=48 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:25.241554 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988cae88-3088-47b5-a8a8-7bf97ba7acab service cinder] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:25.242873 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-988cae88-3088-47b5-a8a8-7bf97ba7acab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:25.253919 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988cae88-3088-47b5-a8a8-7bf97ba7acab service cinder] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:25.257535 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189df10b-eba7-4d4e-a87c-ce4f23375f22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:25.258427 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189df10b-eba7-4d4e-a87c-ce4f23375f22 service cinder] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:25.258706 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189df10b-eba7-4d4e-a87c-ce4f23375f22 service cinder] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:25.259009 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189df10b-eba7-4d4e-a87c-ce4f23375f22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:25.260737 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-189df10b-eba7-4d4e-a87c-ce4f23375f22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:25.333241 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189df10b-eba7-4d4e-a87c-ce4f23375f22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:25.334833 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189df10b-eba7-4d4e-a87c-ce4f23375f22 service cinder] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:25.344332 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1371/2755] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:55:25 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:55:32.106668 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac364af-7da9-44be-aba7-32a8fec05f5d service cinder] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:32.108190 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-5ac364af-7da9-44be-aba7-32a8fec05f5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:32.179628 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac364af-7da9-44be-aba7-32a8fec05f5d service cinder] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:32.184500 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f5910-db3b-4cc1-bd87-61ebd795f21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:32.185126 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f5910-db3b-4cc1-bd87-61ebd795f21a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:32.185400 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f5910-db3b-4cc1-bd87-61ebd795f21a admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:32.185695 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f5910-db3b-4cc1-bd87-61ebd795f21a admin admin] PATH_INFO: `/v3/users/1b9409ba7be54808812a6b90976406d7` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:32.186895 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1f5910-db3b-4cc1-bd87-61ebd795f21a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b9409ba7be54808812a6b90976406d7)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:32.188831 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1f5910-db3b-4cc1-bd87-61ebd795f21a admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:32.378023 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-7a1f5910-db3b-4cc1-bd87-61ebd795f21a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b9409ba7be54808812a6b90976406d7'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:32.450386 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-7a1f5910-db3b-4cc1-bd87-61ebd795f21a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b9409ba7be54808812a6b90976406d7'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:32.458234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-7a1f5910-db3b-4cc1-bd87-61ebd795f21a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b9409ba7be54808812a6b90976406d7'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:32.458872 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-7a1f5910-db3b-4cc1-bd87-61ebd795f21a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b9409ba7be54808812a6b90976406d7'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:32.470692 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-7a1f5910-db3b-4cc1-bd87-61ebd795f21a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b9409ba7be54808812a6b90976406d7'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:32.476607 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1385/2756] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:55:32 2022] DELETE /identity/v3/users/1b9409ba7be54808812a6b90976406d7 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:55:32.481349 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17668f67-e63f-4543-984a-fd91c1d27888 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:32.481805 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17668f67-e63f-4543-984a-fd91c1d27888 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:32.481931 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17668f67-e63f-4543-984a-fd91c1d27888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:32.500972 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-17668f67-e63f-4543-984a-fd91c1d27888 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:32.502160 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-17668f67-e63f-4543-984a-fd91c1d27888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:32.559072 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1372/2757] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:55:32.569178 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f5910-db3b-4cc1-bd87-61ebd795f21a admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:32.570603 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-7a1f5910-db3b-4cc1-bd87-61ebd795f21a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:32.626199 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f5910-db3b-4cc1-bd87-61ebd795f21a admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:32.630410 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20690fcd-8385-4b1d-b5e3-db5647dd4505 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:32.630975 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20690fcd-8385-4b1d-b5e3-db5647dd4505 service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:32.631274 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20690fcd-8385-4b1d-b5e3-db5647dd4505 service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:32.631549 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20690fcd-8385-4b1d-b5e3-db5647dd4505 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:32.640467 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20690fcd-8385-4b1d-b5e3-db5647dd4505 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:32.641891 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20690fcd-8385-4b1d-b5e3-db5647dd4505 service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:32.651831 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1386/2758] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:55:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:55:33.098405 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17668f67-e63f-4543-984a-fd91c1d27888 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:33.100424 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-17668f67-e63f-4543-984a-fd91c1d27888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:33.112796 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17668f67-e63f-4543-984a-fd91c1d27888 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:33.122679 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d1f7c-8b30-44cf-8cd2-c39e7064ce0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:33.123424 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d1f7c-8b30-44cf-8cd2-c39e7064ce0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:33.123707 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d1f7c-8b30-44cf-8cd2-c39e7064ce0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:33.123987 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d1f7c-8b30-44cf-8cd2-c39e7064ce0d admin admin] PATH_INFO: `/v3/projects/cbded8c76d3a46f89e1ef7e4d3109a9a` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:33.125191 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d1f7c-8b30-44cf-8cd2-c39e7064ce0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbded8c76d3a46f89e1ef7e4d3109a9a)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:33.127523 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d1f7c-8b30-44cf-8cd2-c39e7064ce0d admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:33.222752 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-ee2d1f7c-8b30-44cf-8cd2-c39e7064ce0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbded8c76d3a46f89e1ef7e4d3109a9a', 'request_id': 'req-ee2d1f7c-8b30-44cf-8cd2-c39e7064ce0d'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:33.307927 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-ee2d1f7c-8b30-44cf-8cd2-c39e7064ce0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbded8c76d3a46f89e1ef7e4d3109a9a', 'request_id': 'req-ee2d1f7c-8b30-44cf-8cd2-c39e7064ce0d'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:33.314195 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-ee2d1f7c-8b30-44cf-8cd2-c39e7064ce0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbded8c76d3a46f89e1ef7e4d3109a9a', 'request_id': 'req-ee2d1f7c-8b30-44cf-8cd2-c39e7064ce0d'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:33.325301 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-ee2d1f7c-8b30-44cf-8cd2-c39e7064ce0d admin admin] The token cache is being invalidate because project cbded8c76d3a46f89e1ef7e4d3109a9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:55:33.325585 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-ee2d1f7c-8b30-44cf-8cd2-c39e7064ce0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:33.326191 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-ee2d1f7c-8b30-44cf-8cd2-c39e7064ce0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:33.327727 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1373/2759] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:55:33 2022] DELETE /identity/v3/projects/cbded8c76d3a46f89e1ef7e4d3109a9a => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:55:33.334138 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e07bed-afab-4b95-a37a-4af19af800d2 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:33.334642 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e07bed-afab-4b95-a37a-4af19af800d2 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:33.334818 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e07bed-afab-4b95-a37a-4af19af800d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:33.354974 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-06e07bed-afab-4b95-a37a-4af19af800d2 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:33.356178 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-06e07bed-afab-4b95-a37a-4af19af800d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:33.373564 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:33.413809 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1387/2760] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:55:33.422824 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd5713-93a4-402c-870a-fc47daea99aa None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:33.423155 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd5713-93a4-402c-870a-fc47daea99aa None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:33.423466 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd5713-93a4-402c-870a-fc47daea99aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:33.444020 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-49bd5713-93a4-402c-870a-fc47daea99aa None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:33.445216 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-49bd5713-93a4-402c-870a-fc47daea99aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:33.453053 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1374/2761] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:55:33.457980 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e07bed-afab-4b95-a37a-4af19af800d2 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:33.467494 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e07bed-afab-4b95-a37a-4af19af800d2 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:33.472053 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c24f6-a95a-4c8b-b29b-8eae98a84fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:33.473210 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c24f6-a95a-4c8b-b29b-8eae98a84fdd admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:33.473488 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c24f6-a95a-4c8b-b29b-8eae98a84fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:33.473755 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c24f6-a95a-4c8b-b29b-8eae98a84fdd admin admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:33.474438 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c24f6-a95a-4c8b-b29b-8eae98a84fdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:55:33.474739 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c24f6-a95a-4c8b-b29b-8eae98a84fdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:33.476377 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c24f6-a95a-4c8b-b29b-8eae98a84fdd admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:33.487591 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1388/2762] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:55:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:55:33.492366 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd5713-93a4-402c-870a-fc47daea99aa None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:33.501563 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd5713-93a4-402c-870a-fc47daea99aa None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:33.506203 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800258d4-f34e-4d6a-8788-3fe216a6d4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:33.506803 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800258d4-f34e-4d6a-8788-3fe216a6d4c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:33.507115 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800258d4-f34e-4d6a-8788-3fe216a6d4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:33.507385 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800258d4-f34e-4d6a-8788-3fe216a6d4c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:33.508039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800258d4-f34e-4d6a-8788-3fe216a6d4c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:33.509945 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800258d4-f34e-4d6a-8788-3fe216a6d4c8 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:33.520403 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:33.617215 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1375/2763] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:55:33 2022] POST /identity/v3/projects => generated 373 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:55:33.621393 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c24f6-a95a-4c8b-b29b-8eae98a84fdd admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:33.632928 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c24f6-a95a-4c8b-b29b-8eae98a84fdd admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:33.692491 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cecbc0-9142-453d-a011-51ae594c1e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:33.693112 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cecbc0-9142-453d-a011-51ae594c1e6d admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:33.693392 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cecbc0-9142-453d-a011-51ae594c1e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:33.693667 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cecbc0-9142-453d-a011-51ae594c1e6d admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:33.694319 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cecbc0-9142-453d-a011-51ae594c1e6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:33.696285 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cecbc0-9142-453d-a011-51ae594c1e6d admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:33.839773 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1389/2764] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:55:33 2022] POST /identity/v3/users => generated 287 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:55:33.843907 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800258d4-f34e-4d6a-8788-3fe216a6d4c8 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:33.853917 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800258d4-f34e-4d6a-8788-3fe216a6d4c8 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:33.858607 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba825d-2b7b-4828-ae8b-20393b915bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:33.859275 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba825d-2b7b-4828-ae8b-20393b915bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:33.859558 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba825d-2b7b-4828-ae8b-20393b915bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:33.859831 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba825d-2b7b-4828-ae8b-20393b915bb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:33.860584 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ba825d-2b7b-4828-ae8b-20393b915bb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:33.862206 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ba825d-2b7b-4828-ae8b-20393b915bb2 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:33.872683 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1376/2765] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:55:33.876807 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cecbc0-9142-453d-a011-51ae594c1e6d admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:33.887292 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cecbc0-9142-453d-a011-51ae594c1e6d admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:33.892174 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51076d42-126b-4d72-9f3a-2c9da14f00d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:33.895359 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51076d42-126b-4d72-9f3a-2c9da14f00d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:33.895359 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51076d42-126b-4d72-9f3a-2c9da14f00d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:33.895359 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51076d42-126b-4d72-9f3a-2c9da14f00d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:33.895359 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51076d42-126b-4d72-9f3a-2c9da14f00d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:33.896549 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51076d42-126b-4d72-9f3a-2c9da14f00d3 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:33.906391 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1390/2766] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:55:33.910520 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba825d-2b7b-4828-ae8b-20393b915bb2 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:33.924037 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba825d-2b7b-4828-ae8b-20393b915bb2 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:33.924931 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa804f90-1f3c-42a4-8fe3-1690aafacd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:33.925587 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa804f90-1f3c-42a4-8fe3-1690aafacd54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:33.925866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa804f90-1f3c-42a4-8fe3-1690aafacd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:33.926136 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa804f90-1f3c-42a4-8fe3-1690aafacd54 admin admin] PATH_INFO: `/v3/projects/341d618de60b49eca42327deeb008976/users/844bb53e0b3d4355aa3dd8c9101ee178/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:33.942135 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa804f90-1f3c-42a4-8fe3-1690aafacd54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=341d618de60b49eca42327deeb008976, user_id=844bb53e0b3d4355aa3dd8c9101ee178, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:33.944837 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa804f90-1f3c-42a4-8fe3-1690aafacd54 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:33.993605 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1377/2767] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:55:33 2022] PUT /identity/v3/projects/341d618de60b49eca42327deeb008976/users/844bb53e0b3d4355aa3dd8c9101ee178/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:55:33.998775 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970d4ca-ddb1-4e84-8546-f291cf1a56f8 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:33.999117 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970d4ca-ddb1-4e84-8546-f291cf1a56f8 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:33.999396 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970d4ca-ddb1-4e84-8546-f291cf1a56f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:34.018902 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-c970d4ca-ddb1-4e84-8546-f291cf1a56f8 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:34.020903 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-c970d4ca-ddb1-4e84-8546-f291cf1a56f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:34.079176 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1391/2768] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:55:34.089599 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa804f90-1f3c-42a4-8fe3-1690aafacd54 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:34.091307 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-fa804f90-1f3c-42a4-8fe3-1690aafacd54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:34.147564 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa804f90-1f3c-42a4-8fe3-1690aafacd54 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:34.151424 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83cb35-1f64-4747-8f09-6989efbbfd82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:34.152100 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83cb35-1f64-4747-8f09-6989efbbfd82 service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:34.152387 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83cb35-1f64-4747-8f09-6989efbbfd82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:34.152657 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83cb35-1f64-4747-8f09-6989efbbfd82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:34.167448 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd83cb35-1f64-4747-8f09-6989efbbfd82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:34.168897 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd83cb35-1f64-4747-8f09-6989efbbfd82 service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:34.179908 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1378/2769] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:55:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:55:39.647417 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96fc9b-79a7-461a-93c1-02de20876dfd None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:39.647417 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96fc9b-79a7-461a-93c1-02de20876dfd None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:39.647417 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96fc9b-79a7-461a-93c1-02de20876dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:39.689101 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-1b96fc9b-79a7-461a-93c1-02de20876dfd None None] MFA Rules not processed for user `844bb53e0b3d4355aa3dd8c9101ee178`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:39.690466 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-1b96fc9b-79a7-461a-93c1-02de20876dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:39.713641 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:39.795330 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1392/2770] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:55:39.800320 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83cb35-1f64-4747-8f09-6989efbbfd82 service neutron] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:39.810524 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83cb35-1f64-4747-8f09-6989efbbfd82 service neutron] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:39.818125 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59209e5-850b-48a2-8d1c-431b1fb074d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:39.818755 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59209e5-850b-48a2-8d1c-431b1fb074d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:39.819069 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59209e5-850b-48a2-8d1c-431b1fb074d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:39.821631 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59209e5-850b-48a2-8d1c-431b1fb074d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:39.822378 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59209e5-850b-48a2-8d1c-431b1fb074d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:39.824560 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59209e5-850b-48a2-8d1c-431b1fb074d1 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:39.980512 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1379/2771] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:55:39 2022] POST /identity/v3/projects => generated 373 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:55:39.984687 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b96fc9b-79a7-461a-93c1-02de20876dfd None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:39.996073 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b96fc9b-79a7-461a-93c1-02de20876dfd None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:40.060004 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3515de-be94-4b8b-866d-7de257f1fe9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:40.061394 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3515de-be94-4b8b-866d-7de257f1fe9a admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:40.061907 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3515de-be94-4b8b-866d-7de257f1fe9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:40.062513 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3515de-be94-4b8b-866d-7de257f1fe9a admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:40.063546 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3515de-be94-4b8b-866d-7de257f1fe9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:40.067270 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3515de-be94-4b8b-866d-7de257f1fe9a admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:40.172196 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1393/2772] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:55:39 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:55:40.176710 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59209e5-850b-48a2-8d1c-431b1fb074d1 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:40.187444 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59209e5-850b-48a2-8d1c-431b1fb074d1 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:40.192872 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1551f-ad25-4453-8e12-6ae2d29deedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:40.193402 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1551f-ad25-4453-8e12-6ae2d29deedf admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:40.193680 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1551f-ad25-4453-8e12-6ae2d29deedf admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:40.193972 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1551f-ad25-4453-8e12-6ae2d29deedf admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:40.194639 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e1551f-ad25-4453-8e12-6ae2d29deedf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:40.196378 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e1551f-ad25-4453-8e12-6ae2d29deedf admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:40.207523 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1380/2773] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:55:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:55:40.211464 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3515de-be94-4b8b-866d-7de257f1fe9a admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:40.222156 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3515de-be94-4b8b-866d-7de257f1fe9a admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:40.228018 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ad0a0-23ef-4182-9d93-84979adb5c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:40.228771 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ad0a0-23ef-4182-9d93-84979adb5c38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:40.231300 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ad0a0-23ef-4182-9d93-84979adb5c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:40.231300 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ad0a0-23ef-4182-9d93-84979adb5c38 admin admin] PATH_INFO: `/v3/projects/78ebd9980fb94348b5f961943372606d/users/115ef97f708d42228b15f92fca32d9cc/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:40.245727 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ad0a0-23ef-4182-9d93-84979adb5c38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78ebd9980fb94348b5f961943372606d, user_id=115ef97f708d42228b15f92fca32d9cc, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:40.248465 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ad0a0-23ef-4182-9d93-84979adb5c38 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:40.343196 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1394/2774] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:55:40 2022] PUT /identity/v3/projects/78ebd9980fb94348b5f961943372606d/users/115ef97f708d42228b15f92fca32d9cc/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:55:40.347537 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1551f-ad25-4453-8e12-6ae2d29deedf admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:40.358026 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1551f-ad25-4453-8e12-6ae2d29deedf admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:40.418311 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07400bb6-2b64-47ac-a2f1-8a0e86a10326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:40.418935 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07400bb6-2b64-47ac-a2f1-8a0e86a10326 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:40.419241 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07400bb6-2b64-47ac-a2f1-8a0e86a10326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:40.419516 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07400bb6-2b64-47ac-a2f1-8a0e86a10326 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:40.420204 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07400bb6-2b64-47ac-a2f1-8a0e86a10326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:40.421880 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07400bb6-2b64-47ac-a2f1-8a0e86a10326 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:40.432247 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1381/2775] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:55:40 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:55:40.436407 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ad0a0-23ef-4182-9d93-84979adb5c38 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:40.449896 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ad0a0-23ef-4182-9d93-84979adb5c38 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:40.454906 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645aa0ec-c8f7-4a83-a55c-e85adc274904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:40.456025 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645aa0ec-c8f7-4a83-a55c-e85adc274904 admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:40.456318 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645aa0ec-c8f7-4a83-a55c-e85adc274904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:40.456931 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645aa0ec-c8f7-4a83-a55c-e85adc274904 admin admin] PATH_INFO: `/v3/projects/78ebd9980fb94348b5f961943372606d/users/115ef97f708d42228b15f92fca32d9cc/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:40.458857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645aa0ec-c8f7-4a83-a55c-e85adc274904 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78ebd9980fb94348b5f961943372606d, user_id=115ef97f708d42228b15f92fca32d9cc, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:40.461856 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645aa0ec-c8f7-4a83-a55c-e85adc274904 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:40.473586 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1395/2776] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:55:40 2022] PUT /identity/v3/projects/78ebd9980fb94348b5f961943372606d/users/115ef97f708d42228b15f92fca32d9cc/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:55:46.152117 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157dfd83-503d-4405-a479-25c487ee77d8 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:46.153300 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157dfd83-503d-4405-a479-25c487ee77d8 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:46.153300 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157dfd83-503d-4405-a479-25c487ee77d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:46.184096 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-157dfd83-503d-4405-a479-25c487ee77d8 None None] MFA Rules not processed for user `115ef97f708d42228b15f92fca32d9cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:46.189026 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-157dfd83-503d-4405-a479-25c487ee77d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:46.194616 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:46.260379 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1382/2777] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:46 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:55:46.279125 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645aa0ec-c8f7-4a83-a55c-e85adc274904 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:46.282265 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-645aa0ec-c8f7-4a83-a55c-e85adc274904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:46.362077 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645aa0ec-c8f7-4a83-a55c-e85adc274904 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:46.369496 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01354911-00f9-4584-a5e9-0ab2e67087f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:46.370200 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01354911-00f9-4584-a5e9-0ab2e67087f0 service nova] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:46.370529 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01354911-00f9-4584-a5e9-0ab2e67087f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:46.370799 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01354911-00f9-4584-a5e9-0ab2e67087f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:46.377261 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:46.432738 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01354911-00f9-4584-a5e9-0ab2e67087f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:46.434336 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01354911-00f9-4584-a5e9-0ab2e67087f0 service nova] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:46.444219 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1396/2778] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:55:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:55:49.214584 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339959a3-6137-4a0b-ab4a-f5b85b2206dc None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:49.215265 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339959a3-6137-4a0b-ab4a-f5b85b2206dc None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:49.215265 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339959a3-6137-4a0b-ab4a-f5b85b2206dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:49.236716 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-339959a3-6137-4a0b-ab4a-f5b85b2206dc None None] MFA Rules not processed for user `844bb53e0b3d4355aa3dd8c9101ee178`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:49.238137 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-339959a3-6137-4a0b-ab4a-f5b85b2206dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:49.246562 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1383/2779] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:55:50.287357 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01354911-00f9-4584-a5e9-0ab2e67087f0 service nova] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:50.288957 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-01354911-00f9-4584-a5e9-0ab2e67087f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:50.337305 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339959a3-6137-4a0b-ab4a-f5b85b2206dc None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:50.339728 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-339959a3-6137-4a0b-ab4a-f5b85b2206dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:50.391743 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01354911-00f9-4584-a5e9-0ab2e67087f0 service nova] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:50.397426 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90f1228-3c1c-4edd-953e-78e2f286666f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:50.398068 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f1228-3c1c-4edd-953e-78e2f286666f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:50.398345 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f1228-3c1c-4edd-953e-78e2f286666f admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:50.398658 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f1228-3c1c-4edd-953e-78e2f286666f admin admin] PATH_INFO: `/v3/users/37eb7963e70c4335aeaa77060d2dee64` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:50.400618 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90f1228-3c1c-4edd-953e-78e2f286666f admin admin] RBAC: Authorizing `identity:delete_user(user_id=37eb7963e70c4335aeaa77060d2dee64)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:50.402753 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90f1228-3c1c-4edd-953e-78e2f286666f admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:50.445158 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339959a3-6137-4a0b-ab4a-f5b85b2206dc None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:50.454777 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55192ad-dc1c-43c9-a363-0f6c64b44844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:50.455545 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55192ad-dc1c-43c9-a363-0f6c64b44844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:50.455902 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55192ad-dc1c-43c9-a363-0f6c64b44844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:50.456348 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55192ad-dc1c-43c9-a363-0f6c64b44844 admin admin] PATH_INFO: `/v3/users/31d628ff91b54e0abeec62d4a4a5803a` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:50.457730 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55192ad-dc1c-43c9-a363-0f6c64b44844 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31d628ff91b54e0abeec62d4a4a5803a)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:50.460386 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55192ad-dc1c-43c9-a363-0f6c64b44844 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:50.573274 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-d90f1228-3c1c-4edd-953e-78e2f286666f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37eb7963e70c4335aeaa77060d2dee64'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:50.588360 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-a55192ad-dc1c-43c9-a363-0f6c64b44844 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31d628ff91b54e0abeec62d4a4a5803a'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:50.646230 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-d90f1228-3c1c-4edd-953e-78e2f286666f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37eb7963e70c4335aeaa77060d2dee64'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:50.654553 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-d90f1228-3c1c-4edd-953e-78e2f286666f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37eb7963e70c4335aeaa77060d2dee64'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:50.654741 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-d90f1228-3c1c-4edd-953e-78e2f286666f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37eb7963e70c4335aeaa77060d2dee64'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:50.667868 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-d90f1228-3c1c-4edd-953e-78e2f286666f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37eb7963e70c4335aeaa77060d2dee64'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:50.673829 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1397/2780] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:55:50 2022] DELETE /identity/v3/users/37eb7963e70c4335aeaa77060d2dee64 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:55:50.702723 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-a55192ad-dc1c-43c9-a363-0f6c64b44844 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31d628ff91b54e0abeec62d4a4a5803a'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:50.712498 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-a55192ad-dc1c-43c9-a363-0f6c64b44844 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31d628ff91b54e0abeec62d4a4a5803a'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:50.726038 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-a55192ad-dc1c-43c9-a363-0f6c64b44844 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31d628ff91b54e0abeec62d4a4a5803a'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:50.726754 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-a55192ad-dc1c-43c9-a363-0f6c64b44844 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31d628ff91b54e0abeec62d4a4a5803a'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:50.732994 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1384/2781] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:55:50 2022] DELETE /identity/v3/users/31d628ff91b54e0abeec62d4a4a5803a => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:55:50.737688 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a9335-6a9a-4a55-8e99-36d6ae5ff97e None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:50.737938 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a9335-6a9a-4a55-8e99-36d6ae5ff97e None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:50.738280 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a9335-6a9a-4a55-8e99-36d6ae5ff97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:50.765645 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-374a9335-6a9a-4a55-8e99-36d6ae5ff97e None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:50.766877 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-374a9335-6a9a-4a55-8e99-36d6ae5ff97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:50.798496 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:50.851630 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1398/2782] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:55:50.861564 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55192ad-dc1c-43c9-a363-0f6c64b44844 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:50.863306 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-a55192ad-dc1c-43c9-a363-0f6c64b44844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:50.888809 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:50.925924 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55192ad-dc1c-43c9-a363-0f6c64b44844 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:50.930111 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d632b4-1674-4603-a8d4-f9f07b04d2a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:50.930734 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d632b4-1674-4603-a8d4-f9f07b04d2a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:50.931049 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d632b4-1674-4603-a8d4-f9f07b04d2a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:50.931328 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d632b4-1674-4603-a8d4-f9f07b04d2a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:50.940308 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d632b4-1674-4603-a8d4-f9f07b04d2a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:50.941752 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d632b4-1674-4603-a8d4-f9f07b04d2a2 service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:50.953343 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1385/2783] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:55:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:55:50.956258 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a9335-6a9a-4a55-8e99-36d6ae5ff97e None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:50.957809 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-374a9335-6a9a-4a55-8e99-36d6ae5ff97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:50.970062 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a9335-6a9a-4a55-8e99-36d6ae5ff97e None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:50.977842 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b57b84-8613-4137-ba5d-0d52c79182fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:50.978390 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b57b84-8613-4137-ba5d-0d52c79182fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:50.978675 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b57b84-8613-4137-ba5d-0d52c79182fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:50.978997 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b57b84-8613-4137-ba5d-0d52c79182fc admin admin] PATH_INFO: `/v3/projects/fe473ec54cca4e6eb55cf4acbd200acb` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:50.980452 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b57b84-8613-4137-ba5d-0d52c79182fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe473ec54cca4e6eb55cf4acbd200acb)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:50.982638 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b57b84-8613-4137-ba5d-0d52c79182fc admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:51.129000 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-67b57b84-8613-4137-ba5d-0d52c79182fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe473ec54cca4e6eb55cf4acbd200acb', 'request_id': 'req-67b57b84-8613-4137-ba5d-0d52c79182fc'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:51.212224 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-67b57b84-8613-4137-ba5d-0d52c79182fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe473ec54cca4e6eb55cf4acbd200acb', 'request_id': 'req-67b57b84-8613-4137-ba5d-0d52c79182fc'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:51.219037 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-67b57b84-8613-4137-ba5d-0d52c79182fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe473ec54cca4e6eb55cf4acbd200acb', 'request_id': 'req-67b57b84-8613-4137-ba5d-0d52c79182fc'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:51.231332 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-67b57b84-8613-4137-ba5d-0d52c79182fc admin admin] The token cache is being invalidate because project fe473ec54cca4e6eb55cf4acbd200acb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:55:51.231693 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-67b57b84-8613-4137-ba5d-0d52c79182fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:51.232360 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-67b57b84-8613-4137-ba5d-0d52c79182fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:51.234026 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1399/2784] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:55:50 2022] DELETE /identity/v3/projects/fe473ec54cca4e6eb55cf4acbd200acb => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:55:51.238188 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d632b4-1674-4603-a8d4-f9f07b04d2a2 service neutron] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:51.248562 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d632b4-1674-4603-a8d4-f9f07b04d2a2 service neutron] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:51.319534 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e992dc-9418-46a0-829a-3b76b04f2f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:51.323752 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e992dc-9418-46a0-829a-3b76b04f2f58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:51.324158 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e992dc-9418-46a0-829a-3b76b04f2f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:51.324749 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e992dc-9418-46a0-829a-3b76b04f2f58 admin admin] PATH_INFO: `/v3/users/d200d071a4d040dd8835ada85b6c5dc8` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:51.326575 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e992dc-9418-46a0-829a-3b76b04f2f58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d200d071a4d040dd8835ada85b6c5dc8)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:51.328671 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e992dc-9418-46a0-829a-3b76b04f2f58 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:51.403470 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b57b84-8613-4137-ba5d-0d52c79182fc admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:51.403470 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-67b57b84-8613-4137-ba5d-0d52c79182fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:51.424178 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b57b84-8613-4137-ba5d-0d52c79182fc admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:51.430261 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b7d804-beeb-470a-aba3-eed72f800c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:51.430916 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7d804-beeb-470a-aba3-eed72f800c8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:51.431301 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7d804-beeb-470a-aba3-eed72f800c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:51.431761 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7d804-beeb-470a-aba3-eed72f800c8c admin admin] PATH_INFO: `/v3/projects/f0b65d232b6148aabb7b105785b6356f` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:51.433232 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b7d804-beeb-470a-aba3-eed72f800c8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0b65d232b6148aabb7b105785b6356f)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:51.435483 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b7d804-beeb-470a-aba3-eed72f800c8c admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:51.518925 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-37e992dc-9418-46a0-829a-3b76b04f2f58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd200d071a4d040dd8835ada85b6c5dc8'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:51.569315 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-21b7d804-beeb-470a-aba3-eed72f800c8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0b65d232b6148aabb7b105785b6356f', 'request_id': 'req-21b7d804-beeb-470a-aba3-eed72f800c8c'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:51.603182 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-37e992dc-9418-46a0-829a-3b76b04f2f58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd200d071a4d040dd8835ada85b6c5dc8'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:51.611911 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-37e992dc-9418-46a0-829a-3b76b04f2f58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd200d071a4d040dd8835ada85b6c5dc8'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:51.625504 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-37e992dc-9418-46a0-829a-3b76b04f2f58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd200d071a4d040dd8835ada85b6c5dc8'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:51.626245 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-37e992dc-9418-46a0-829a-3b76b04f2f58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd200d071a4d040dd8835ada85b6c5dc8'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:51.634061 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1386/2785] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:55:51 2022] DELETE /identity/v3/users/d200d071a4d040dd8835ada85b6c5dc8 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:55:51.652878 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-21b7d804-beeb-470a-aba3-eed72f800c8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0b65d232b6148aabb7b105785b6356f', 'request_id': 'req-21b7d804-beeb-470a-aba3-eed72f800c8c'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:51.660149 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-21b7d804-beeb-470a-aba3-eed72f800c8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0b65d232b6148aabb7b105785b6356f', 'request_id': 'req-21b7d804-beeb-470a-aba3-eed72f800c8c'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:51.673422 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-21b7d804-beeb-470a-aba3-eed72f800c8c admin admin] The token cache is being invalidate because project f0b65d232b6148aabb7b105785b6356f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:55:51.673757 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-21b7d804-beeb-470a-aba3-eed72f800c8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:51.674406 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-21b7d804-beeb-470a-aba3-eed72f800c8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:51.679519 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1400/2786] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:55:51 2022] DELETE /identity/v3/projects/f0b65d232b6148aabb7b105785b6356f => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:55:51.680847 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e992dc-9418-46a0-829a-3b76b04f2f58 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:51.682365 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-37e992dc-9418-46a0-829a-3b76b04f2f58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:51.733352 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:51.757019 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e992dc-9418-46a0-829a-3b76b04f2f58 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:51.761935 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2833c-cc1c-4e6e-af57-9278f99c8e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:51.762590 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2833c-cc1c-4e6e-af57-9278f99c8e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:51.762873 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2833c-cc1c-4e6e-af57-9278f99c8e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:51.763177 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2833c-cc1c-4e6e-af57-9278f99c8e6d admin admin] PATH_INFO: `/v3/users/a2a1c1cf75d243039777b9981f3e5fc2` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:51.764406 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2833c-cc1c-4e6e-af57-9278f99c8e6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2a1c1cf75d243039777b9981f3e5fc2)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:51.767349 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2833c-cc1c-4e6e-af57-9278f99c8e6d admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:51.973977 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b7d804-beeb-470a-aba3-eed72f800c8c admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:51.981357 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-21b7d804-beeb-470a-aba3-eed72f800c8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:52.018220 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:52.043904 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-e7c2833c-cc1c-4e6e-af57-9278f99c8e6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2a1c1cf75d243039777b9981f3e5fc2'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:52.049403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b7d804-beeb-470a-aba3-eed72f800c8c admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:52.055498 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e8569-beb4-48f1-9a5b-18f2948a5db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:52.056340 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e8569-beb4-48f1-9a5b-18f2948a5db3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:52.056619 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e8569-beb4-48f1-9a5b-18f2948a5db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:52.056895 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e8569-beb4-48f1-9a5b-18f2948a5db3 admin admin] PATH_INFO: `/v3/projects/ffa4221a82b54cd58722c31682460233` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:52.058050 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e8569-beb4-48f1-9a5b-18f2948a5db3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffa4221a82b54cd58722c31682460233)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:52.059991 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e8569-beb4-48f1-9a5b-18f2948a5db3 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:52.102892 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-e7c2833c-cc1c-4e6e-af57-9278f99c8e6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2a1c1cf75d243039777b9981f3e5fc2'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:52.110371 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-e7c2833c-cc1c-4e6e-af57-9278f99c8e6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2a1c1cf75d243039777b9981f3e5fc2'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:52.123598 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-e7c2833c-cc1c-4e6e-af57-9278f99c8e6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2a1c1cf75d243039777b9981f3e5fc2'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:52.124312 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-e7c2833c-cc1c-4e6e-af57-9278f99c8e6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2a1c1cf75d243039777b9981f3e5fc2'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:52.130216 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1387/2787] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:55:51 2022] DELETE /identity/v3/users/a2a1c1cf75d243039777b9981f3e5fc2 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:55:52.168055 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-3a9e8569-beb4-48f1-9a5b-18f2948a5db3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffa4221a82b54cd58722c31682460233', 'request_id': 'req-3a9e8569-beb4-48f1-9a5b-18f2948a5db3'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:52.229518 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-3a9e8569-beb4-48f1-9a5b-18f2948a5db3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffa4221a82b54cd58722c31682460233', 'request_id': 'req-3a9e8569-beb4-48f1-9a5b-18f2948a5db3'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:52.235906 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-3a9e8569-beb4-48f1-9a5b-18f2948a5db3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffa4221a82b54cd58722c31682460233', 'request_id': 'req-3a9e8569-beb4-48f1-9a5b-18f2948a5db3'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:52.247478 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-3a9e8569-beb4-48f1-9a5b-18f2948a5db3 admin admin] The token cache is being invalidate because project ffa4221a82b54cd58722c31682460233 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:55:52.247763 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-3a9e8569-beb4-48f1-9a5b-18f2948a5db3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:52.248401 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-3a9e8569-beb4-48f1-9a5b-18f2948a5db3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:52.249885 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1401/2788] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:55:51 2022] DELETE /identity/v3/projects/ffa4221a82b54cd58722c31682460233 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:55:52.256984 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205de99-d718-4512-b3c7-cb99c8dbdd10 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:52.257280 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205de99-d718-4512-b3c7-cb99c8dbdd10 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:52.258544 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205de99-d718-4512-b3c7-cb99c8dbdd10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:52.282260 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-2205de99-d718-4512-b3c7-cb99c8dbdd10 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:52.283702 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-2205de99-d718-4512-b3c7-cb99c8dbdd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:52.351731 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1388/2789] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:55:52.360770 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d49756-968b-4519-a26f-601ed0787edd None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:52.361066 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d49756-968b-4519-a26f-601ed0787edd None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:52.361367 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d49756-968b-4519-a26f-601ed0787edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:52.386421 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-50d49756-968b-4519-a26f-601ed0787edd None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:52.387809 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-50d49756-968b-4519-a26f-601ed0787edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:52.396542 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1402/2790] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:55:52.400913 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205de99-d718-4512-b3c7-cb99c8dbdd10 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:52.412122 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205de99-d718-4512-b3c7-cb99c8dbdd10 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:52.417398 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe2130-d2eb-48d1-b51a-09d892442028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:52.418147 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe2130-d2eb-48d1-b51a-09d892442028 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:52.425087 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe2130-d2eb-48d1-b51a-09d892442028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:52.425087 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe2130-d2eb-48d1-b51a-09d892442028 admin admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:52.425087 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe2130-d2eb-48d1-b51a-09d892442028 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:55:52.425087 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe2130-d2eb-48d1-b51a-09d892442028 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:52.425087 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe2130-d2eb-48d1-b51a-09d892442028 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:52.434302 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1389/2791] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:55:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:55:52.439110 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d49756-968b-4519-a26f-601ed0787edd None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:52.449526 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d49756-968b-4519-a26f-601ed0787edd None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:52.455417 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b3324-3212-4328-826d-0fa179e8fd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:52.456250 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b3324-3212-4328-826d-0fa179e8fd2d admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:52.456525 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b3324-3212-4328-826d-0fa179e8fd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:52.456952 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b3324-3212-4328-826d-0fa179e8fd2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:52.458474 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b3324-3212-4328-826d-0fa179e8fd2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:52.461405 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b3324-3212-4328-826d-0fa179e8fd2d admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:52.561721 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1403/2792] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:55:52 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:55:52.568053 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe2130-d2eb-48d1-b51a-09d892442028 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:52.578929 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe2130-d2eb-48d1-b51a-09d892442028 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:52.591316 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b3324-3212-4328-826d-0fa179e8fd2d admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:52.594086 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-b25b3324-3212-4328-826d-0fa179e8fd2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:52.634842 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:52.648353 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76bf52-531c-4651-ad80-e9ef180c65a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:52.648984 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76bf52-531c-4651-ad80-e9ef180c65a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:52.649260 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76bf52-531c-4651-ad80-e9ef180c65a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:52.649535 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76bf52-531c-4651-ad80-e9ef180c65a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:52.650204 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76bf52-531c-4651-ad80-e9ef180c65a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:52.652278 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76bf52-531c-4651-ad80-e9ef180c65a1 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:52.665961 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b3324-3212-4328-826d-0fa179e8fd2d admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:52.671087 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a0d9b-4f97-4b22-a904-b97c042207d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:52.671763 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a0d9b-4f97-4b22-a904-b97c042207d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:52.672094 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a0d9b-4f97-4b22-a904-b97c042207d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:52.672371 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a0d9b-4f97-4b22-a904-b97c042207d6 admin admin] PATH_INFO: `/v3/projects/ab110aa0dffc466c88cb758bf76382f3` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:52.673543 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a0d9b-4f97-4b22-a904-b97c042207d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab110aa0dffc466c88cb758bf76382f3)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:52.675523 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a0d9b-4f97-4b22-a904-b97c042207d6 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:52.768270 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1390/2793] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:55:52 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:55:52.772545 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76bf52-531c-4651-ad80-e9ef180c65a1 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:52.782445 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76bf52-531c-4651-ad80-e9ef180c65a1 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:52.787123 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa704f8b-41be-4ad1-8330-6884b6a8514a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:52.787810 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa704f8b-41be-4ad1-8330-6884b6a8514a admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:52.788434 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa704f8b-41be-4ad1-8330-6884b6a8514a admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:52.788913 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa704f8b-41be-4ad1-8330-6884b6a8514a admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:52.790051 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa704f8b-41be-4ad1-8330-6884b6a8514a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:52.791826 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa704f8b-41be-4ad1-8330-6884b6a8514a admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:52.799348 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:52.802817 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1391/2794] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:55:52.807555 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-ce5a0d9b-4f97-4b22-a904-b97c042207d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab110aa0dffc466c88cb758bf76382f3', 'request_id': 'req-ce5a0d9b-4f97-4b22-a904-b97c042207d6'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:52.812886 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa704f8b-41be-4ad1-8330-6884b6a8514a admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:52.828490 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa704f8b-41be-4ad1-8330-6884b6a8514a admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:52.862853 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-ce5a0d9b-4f97-4b22-a904-b97c042207d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab110aa0dffc466c88cb758bf76382f3', 'request_id': 'req-ce5a0d9b-4f97-4b22-a904-b97c042207d6'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:52.871891 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-ce5a0d9b-4f97-4b22-a904-b97c042207d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab110aa0dffc466c88cb758bf76382f3', 'request_id': 'req-ce5a0d9b-4f97-4b22-a904-b97c042207d6'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:52.888128 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9bc49c-b694-4eb4-8f73-b0c82c780fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:52.888770 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9bc49c-b694-4eb4-8f73-b0c82c780fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:52.889244 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9bc49c-b694-4eb4-8f73-b0c82c780fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:52.889529 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9bc49c-b694-4eb4-8f73-b0c82c780fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:52.890310 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9bc49c-b694-4eb4-8f73-b0c82c780fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:52.892360 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9bc49c-b694-4eb4-8f73-b0c82c780fd0 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:52.897111 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-ce5a0d9b-4f97-4b22-a904-b97c042207d6 admin admin] The token cache is being invalidate because project ab110aa0dffc466c88cb758bf76382f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:55:52.897393 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-ce5a0d9b-4f97-4b22-a904-b97c042207d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:52.898033 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-ce5a0d9b-4f97-4b22-a904-b97c042207d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:52.901599 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1404/2795] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:55:52 2022] DELETE /identity/v3/projects/ab110aa0dffc466c88cb758bf76382f3 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:55:52.904311 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1392/2796] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:55:52.907919 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf989f7-df55-4245-8a3e-06962849c90d None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:52.908347 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf989f7-df55-4245-8a3e-06962849c90d None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:52.908533 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9bc49c-b694-4eb4-8f73-b0c82c780fd0 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:52.908657 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf989f7-df55-4245-8a3e-06962849c90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:52.910262 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-1c9bc49c-b694-4eb4-8f73-b0c82c780fd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:52.966339 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9bc49c-b694-4eb4-8f73-b0c82c780fd0 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:52.970274 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-fbf989f7-df55-4245-8a3e-06962849c90d None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:52.971569 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-fbf989f7-df55-4245-8a3e-06962849c90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:52.985116 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fdf69-a44d-4525-a701-f03f25e463d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:52.985788 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fdf69-a44d-4525-a701-f03f25e463d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:52.986072 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fdf69-a44d-4525-a701-f03f25e463d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:52.986351 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fdf69-a44d-4525-a701-f03f25e463d8 admin admin] PATH_INFO: `/v3/projects/cd23ca6282ef46d4a499055af5d42fd3/users/8ba208850cca4d1f89d23131c792d386/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:52.990209 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1405/2797] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:55:52.998276 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53a7bc-caad-4da6-b2bc-a617be38627a None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:53.001708 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53a7bc-caad-4da6-b2bc-a617be38627a None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:53.001708 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53a7bc-caad-4da6-b2bc-a617be38627a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:53.002906 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374fdf69-a44d-4525-a701-f03f25e463d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd23ca6282ef46d4a499055af5d42fd3, user_id=8ba208850cca4d1f89d23131c792d386, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:53.006188 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374fdf69-a44d-4525-a701-f03f25e463d8 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:53.020536 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-4f53a7bc-caad-4da6-b2bc-a617be38627a None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:53.021800 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-4f53a7bc-caad-4da6-b2bc-a617be38627a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:53.029729 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1406/2798] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:55:53.034000 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f53a7bc-caad-4da6-b2bc-a617be38627a None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:53.043623 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f53a7bc-caad-4da6-b2bc-a617be38627a None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:53.049793 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e3abc-b1c3-4fb5-b123-0eb9051dcb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:53.050429 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e3abc-b1c3-4fb5-b123-0eb9051dcb52 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:53.050708 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e3abc-b1c3-4fb5-b123-0eb9051dcb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:53.051012 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e3abc-b1c3-4fb5-b123-0eb9051dcb52 admin admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:53.052312 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e3abc-b1c3-4fb5-b123-0eb9051dcb52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:55:53.052993 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e3abc-b1c3-4fb5-b123-0eb9051dcb52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:53.053163 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1393/2799] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:55:52 2022] PUT /identity/v3/projects/cd23ca6282ef46d4a499055af5d42fd3/users/8ba208850cca4d1f89d23131c792d386/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:55:53.054223 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e3abc-b1c3-4fb5-b123-0eb9051dcb52 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:53.070193 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1407/2800] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:55:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:55:53.072810 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fdf69-a44d-4525-a701-f03f25e463d8 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:53.122440 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b84fcc-552f-4f79-9c7e-b21435eae371 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:53.122727 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b84fcc-552f-4f79-9c7e-b21435eae371 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:53.123008 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b84fcc-552f-4f79-9c7e-b21435eae371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:53.132749 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:53.147215 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fdf69-a44d-4525-a701-f03f25e463d8 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:53.154277 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc470ec-fd89-486a-9398-647c255e90a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:53.155175 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc470ec-fd89-486a-9398-647c255e90a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:53.155854 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc470ec-fd89-486a-9398-647c255e90a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:53.156327 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc470ec-fd89-486a-9398-647c255e90a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:53.156701 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-63b84fcc-552f-4f79-9c7e-b21435eae371 None None] MFA Rules not processed for user `8ba208850cca4d1f89d23131c792d386`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:53.157274 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc470ec-fd89-486a-9398-647c255e90a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:53.157878 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-63b84fcc-552f-4f79-9c7e-b21435eae371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:53.159218 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc470ec-fd89-486a-9398-647c255e90a7 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:53.225505 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1408/2801] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:55:53.230070 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b84fcc-552f-4f79-9c7e-b21435eae371 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:53.241627 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b84fcc-552f-4f79-9c7e-b21435eae371 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:53.242747 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1394/2802] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:55:53 2022] POST /identity/v3/projects => generated 371 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:55:53.246983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc470ec-fd89-486a-9398-647c255e90a7 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:53.285120 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:53.305934 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95680497-a0f7-4bd1-926f-624b1d1aec5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:53.306558 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95680497-a0f7-4bd1-926f-624b1d1aec5d admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:53.306839 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95680497-a0f7-4bd1-926f-624b1d1aec5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:53.307240 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95680497-a0f7-4bd1-926f-624b1d1aec5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:53.307906 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95680497-a0f7-4bd1-926f-624b1d1aec5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:53.309844 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95680497-a0f7-4bd1-926f-624b1d1aec5d admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:53.326491 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc470ec-fd89-486a-9398-647c255e90a7 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:53.330248 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b39ccdd-dae6-4197-b21e-7ae3cb7e893d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:53.330873 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39ccdd-dae6-4197-b21e-7ae3cb7e893d admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:53.331191 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39ccdd-dae6-4197-b21e-7ae3cb7e893d admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:53.331471 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39ccdd-dae6-4197-b21e-7ae3cb7e893d admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:53.332138 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b39ccdd-dae6-4197-b21e-7ae3cb7e893d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:53.334144 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b39ccdd-dae6-4197-b21e-7ae3cb7e893d admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:53.390644 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1409/2803] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:55:53 2022] POST /identity/v3/projects => generated 385 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:55:53.395091 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95680497-a0f7-4bd1-926f-624b1d1aec5d admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:53.404121 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1395/2804] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:55:53 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:55:53.405126 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b39ccdd-dae6-4197-b21e-7ae3cb7e893d admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:53.415914 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b39ccdd-dae6-4197-b21e-7ae3cb7e893d admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:53.470456 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95680497-a0f7-4bd1-926f-624b1d1aec5d admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:53.476482 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef8f6c-3655-4d8c-a497-591083ee471c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:53.477168 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef8f6c-3655-4d8c-a497-591083ee471c admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:53.477523 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef8f6c-3655-4d8c-a497-591083ee471c admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:53.477870 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef8f6c-3655-4d8c-a497-591083ee471c admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:53.478543 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef8f6c-3655-4d8c-a497-591083ee471c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:53.480552 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef8f6c-3655-4d8c-a497-591083ee471c admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:53.481386 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b13909-8376-4883-b832-27b251017986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:53.482403 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b13909-8376-4883-b832-27b251017986 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:53.482762 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b13909-8376-4883-b832-27b251017986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:53.483132 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b13909-8376-4883-b832-27b251017986 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:53.483894 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b13909-8376-4883-b832-27b251017986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:53.487046 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b13909-8376-4883-b832-27b251017986 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:53.501011 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1396/2805] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:55:53.502078 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b13909-8376-4883-b832-27b251017986 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:53.512020 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b13909-8376-4883-b832-27b251017986 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:53.517190 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981c7ac-1b6c-46a2-a704-53be52ab359c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:53.517797 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981c7ac-1b6c-46a2-a704-53be52ab359c admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:53.518069 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981c7ac-1b6c-46a2-a704-53be52ab359c admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:53.518343 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981c7ac-1b6c-46a2-a704-53be52ab359c admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:53.519062 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981c7ac-1b6c-46a2-a704-53be52ab359c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:53.520641 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981c7ac-1b6c-46a2-a704-53be52ab359c admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:53.530482 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1397/2806] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:55:53.540467 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981c7ac-1b6c-46a2-a704-53be52ab359c admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:53.551072 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981c7ac-1b6c-46a2-a704-53be52ab359c admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:53.557952 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1410/2807] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:55:53 2022] POST /identity/v3/users => generated 299 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:55:53.559153 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef8f6c-3655-4d8c-a497-591083ee471c admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:53.559424 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a8eff-9289-4ef8-a97b-70c20847e2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:53.560216 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a8eff-9289-4ef8-a97b-70c20847e2bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:53.560569 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a8eff-9289-4ef8-a97b-70c20847e2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:53.565947 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a8eff-9289-4ef8-a97b-70c20847e2bf admin admin] PATH_INFO: `/v3/projects/699917aee1204b19850a4df07e6d89aa/users/079a5bc9d9104ebf833fdbc46dbabc74/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:53.568899 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef8f6c-3655-4d8c-a497-591083ee471c admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:53.573602 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf4e72-f517-452e-bf2d-feed6ace0cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:53.574209 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf4e72-f517-452e-bf2d-feed6ace0cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:53.574494 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf4e72-f517-452e-bf2d-feed6ace0cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:53.574770 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf4e72-f517-452e-bf2d-feed6ace0cc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:53.575495 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecf4e72-f517-452e-bf2d-feed6ace0cc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:53.577032 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a8eff-9289-4ef8-a97b-70c20847e2bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=699917aee1204b19850a4df07e6d89aa, user_id=079a5bc9d9104ebf833fdbc46dbabc74, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:53.577479 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecf4e72-f517-452e-bf2d-feed6ace0cc1 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:53.579671 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a8eff-9289-4ef8-a97b-70c20847e2bf admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:53.587436 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1411/2808] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:55:53.591676 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf4e72-f517-452e-bf2d-feed6ace0cc1 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:53.602120 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf4e72-f517-452e-bf2d-feed6ace0cc1 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:53.607244 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51ecbe-4d0b-4eb9-8038-cedee08b9777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:53.607920 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51ecbe-4d0b-4eb9-8038-cedee08b9777 admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:53.608200 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51ecbe-4d0b-4eb9-8038-cedee08b9777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:53.608474 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51ecbe-4d0b-4eb9-8038-cedee08b9777 admin admin] PATH_INFO: `/v3/projects/79e702a89c8945caa87d4e4c116f8d0b/users/8e7ced7b5789415b8fbeb957143ec22e/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:53.625365 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d51ecbe-4d0b-4eb9-8038-cedee08b9777 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79e702a89c8945caa87d4e4c116f8d0b, user_id=8e7ced7b5789415b8fbeb957143ec22e, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:53.628292 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d51ecbe-4d0b-4eb9-8038-cedee08b9777 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:53.646293 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1398/2809] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:55:53 2022] PUT /identity/v3/projects/699917aee1204b19850a4df07e6d89aa/users/079a5bc9d9104ebf833fdbc46dbabc74/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:55:53.656691 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7009c7d-1221-4f00-b30b-a421e126ed82 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:53.656980 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7009c7d-1221-4f00-b30b-a421e126ed82 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:53.657256 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7009c7d-1221-4f00-b30b-a421e126ed82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:53.690258 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-c7009c7d-1221-4f00-b30b-a421e126ed82 None None] MFA Rules not processed for user `079a5bc9d9104ebf833fdbc46dbabc74`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:53.691527 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-c7009c7d-1221-4f00-b30b-a421e126ed82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:53.701062 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:53.703436 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1412/2810] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:55:53 2022] PUT /identity/v3/projects/79e702a89c8945caa87d4e4c116f8d0b/users/8e7ced7b5789415b8fbeb957143ec22e/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:55:53.707564 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51ecbe-4d0b-4eb9-8038-cedee08b9777 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:53.765421 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1399/2811] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:55:53.771190 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7009c7d-1221-4f00-b30b-a421e126ed82 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:53.775490 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51ecbe-4d0b-4eb9-8038-cedee08b9777 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:53.780539 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3b788-3adc-4956-9846-cbd89aee510c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:53.781169 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3b788-3adc-4956-9846-cbd89aee510c admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:53.781440 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3b788-3adc-4956-9846-cbd89aee510c admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:53.781715 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3b788-3adc-4956-9846-cbd89aee510c admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:53.782409 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc3b788-3adc-4956-9846-cbd89aee510c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:53.784138 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc3b788-3adc-4956-9846-cbd89aee510c admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:53.794986 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1413/2812] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:55:53.799362 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3b788-3adc-4956-9846-cbd89aee510c admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:53.810342 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3b788-3adc-4956-9846-cbd89aee510c admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:53.815920 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff53926-b646-4f13-b520-3040420af9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:53.816605 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff53926-b646-4f13-b520-3040420af9e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:53.816885 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff53926-b646-4f13-b520-3040420af9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:53.817188 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff53926-b646-4f13-b520-3040420af9e6 admin admin] PATH_INFO: `/v3/projects/79e702a89c8945caa87d4e4c116f8d0b/users/8e7ced7b5789415b8fbeb957143ec22e/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:53.819217 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff53926-b646-4f13-b520-3040420af9e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79e702a89c8945caa87d4e4c116f8d0b, user_id=8e7ced7b5789415b8fbeb957143ec22e, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:53.821865 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff53926-b646-4f13-b520-3040420af9e6 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:53.829661 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:53.834314 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1414/2813] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:55:53 2022] PUT /identity/v3/projects/79e702a89c8945caa87d4e4c116f8d0b/users/8e7ced7b5789415b8fbeb957143ec22e/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:55:53.844686 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a2b1d-f8af-41c7-a036-56ab3658b12a None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:53.844971 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a2b1d-f8af-41c7-a036-56ab3658b12a None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:53.845301 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a2b1d-f8af-41c7-a036-56ab3658b12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:53.856526 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7009c7d-1221-4f00-b30b-a421e126ed82 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:53.879295 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-053a2b1d-f8af-41c7-a036-56ab3658b12a None None] MFA Rules not processed for user `8e7ced7b5789415b8fbeb957143ec22e`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:53.880836 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-053a2b1d-f8af-41c7-a036-56ab3658b12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:53.923783 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bba86-0d8f-4714-a17f-ddfc9e31df81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:53.924542 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bba86-0d8f-4714-a17f-ddfc9e31df81 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:53.924814 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bba86-0d8f-4714-a17f-ddfc9e31df81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:53.927799 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bba86-0d8f-4714-a17f-ddfc9e31df81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:53.927799 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607bba86-0d8f-4714-a17f-ddfc9e31df81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:53.928021 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607bba86-0d8f-4714-a17f-ddfc9e31df81 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:53.954061 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1415/2814] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:53 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:55:53.965516 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a2b1d-f8af-41c7-a036-56ab3658b12a None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:53.966931 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-053a2b1d-f8af-41c7-a036-56ab3658b12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:54.003912 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1400/2815] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:55:53 2022] POST /identity/v3/projects => generated 373 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:55:54.008039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bba86-0d8f-4714-a17f-ddfc9e31df81 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:54.046288 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a2b1d-f8af-41c7-a036-56ab3658b12a None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:54.060708 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:54.077816 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bba86-0d8f-4714-a17f-ddfc9e31df81 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:54.083897 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba099d-7625-43f9-b1fc-2801d9b66490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:54.090507 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba099d-7625-43f9-b1fc-2801d9b66490 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:54.090507 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba099d-7625-43f9-b1fc-2801d9b66490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:54.090507 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba099d-7625-43f9-b1fc-2801d9b66490 admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:54.090507 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba099d-7625-43f9-b1fc-2801d9b66490 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:54.090507 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba099d-7625-43f9-b1fc-2801d9b66490 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:54.099178 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdddedcd-9664-4c03-aaaa-63f6f3ea8b6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:54.102059 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddedcd-9664-4c03-aaaa-63f6f3ea8b6d service cinder] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:54.102059 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddedcd-9664-4c03-aaaa-63f6f3ea8b6d service cinder] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:54.102059 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddedcd-9664-4c03-aaaa-63f6f3ea8b6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:54.142080 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:54.154810 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1401/2816] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:55:54 2022] POST /identity/v3/users => generated 293 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:55:54.158562 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdddedcd-9664-4c03-aaaa-63f6f3ea8b6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:54.158775 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba099d-7625-43f9-b1fc-2801d9b66490 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:54.160077 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdddedcd-9664-4c03-aaaa-63f6f3ea8b6d service cinder] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:54.168737 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba099d-7625-43f9-b1fc-2801d9b66490 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:54.169751 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1416/2817] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:55:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:55:54.173972 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9ad0c-840c-4270-926c-4193e9577870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:54.175031 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9ad0c-840c-4270-926c-4193e9577870 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:54.175533 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9ad0c-840c-4270-926c-4193e9577870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:54.175963 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9ad0c-840c-4270-926c-4193e9577870 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:54.176936 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef9ad0c-840c-4270-926c-4193e9577870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:54.178872 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef9ad0c-840c-4270-926c-4193e9577870 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:54.190901 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1402/2818] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:55:54.195786 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdddedcd-9664-4c03-aaaa-63f6f3ea8b6d service cinder] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:54.207652 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdddedcd-9664-4c03-aaaa-63f6f3ea8b6d service cinder] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:54.214705 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf7ad9-7cb4-49bd-a7eb-65ae83b40069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:54.214705 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf7ad9-7cb4-49bd-a7eb-65ae83b40069 admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:54.214705 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf7ad9-7cb4-49bd-a7eb-65ae83b40069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:54.214705 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf7ad9-7cb4-49bd-a7eb-65ae83b40069 admin admin] PATH_INFO: `/v3/projects/46e2cf3180a946b2adfef44ed9d1aaf9/users/8d037b2b707141b6a2b325fde2e81e3c/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:54.240257 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcf7ad9-7cb4-49bd-a7eb-65ae83b40069 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46e2cf3180a946b2adfef44ed9d1aaf9, user_id=8d037b2b707141b6a2b325fde2e81e3c, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:54.244076 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcf7ad9-7cb4-49bd-a7eb-65ae83b40069 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:54.315754 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1417/2819] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:55:54 2022] PUT /identity/v3/projects/46e2cf3180a946b2adfef44ed9d1aaf9/users/8d037b2b707141b6a2b325fde2e81e3c/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:55:54.320224 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9ad0c-840c-4270-926c-4193e9577870 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:54.330244 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9ad0c-840c-4270-926c-4193e9577870 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:54.389651 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765037d-671b-477e-9e14-5366b3152fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:54.390189 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765037d-671b-477e-9e14-5366b3152fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:54.390470 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765037d-671b-477e-9e14-5366b3152fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:54.390743 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765037d-671b-477e-9e14-5366b3152fa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:54.391483 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9765037d-671b-477e-9e14-5366b3152fa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:54.393098 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9765037d-671b-477e-9e14-5366b3152fa6 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:54.404092 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1403/2820] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:55:54.408817 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf7ad9-7cb4-49bd-a7eb-65ae83b40069 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:54.419539 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf7ad9-7cb4-49bd-a7eb-65ae83b40069 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:54.424244 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379689b3-cc76-4996-8508-4f8d91c57398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:54.424908 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379689b3-cc76-4996-8508-4f8d91c57398 admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:54.425204 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379689b3-cc76-4996-8508-4f8d91c57398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:54.425465 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379689b3-cc76-4996-8508-4f8d91c57398 admin admin] PATH_INFO: `/v3/projects/46e2cf3180a946b2adfef44ed9d1aaf9/users/8d037b2b707141b6a2b325fde2e81e3c/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:54.428022 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379689b3-cc76-4996-8508-4f8d91c57398 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46e2cf3180a946b2adfef44ed9d1aaf9, user_id=8d037b2b707141b6a2b325fde2e81e3c, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:54.431559 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379689b3-cc76-4996-8508-4f8d91c57398 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:54.445188 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1418/2821] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:55:54 2022] PUT /identity/v3/projects/46e2cf3180a946b2adfef44ed9d1aaf9/users/8d037b2b707141b6a2b325fde2e81e3c/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:55:54.457628 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd8614-8c61-4230-8d15-37787c15e93e None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:54.458039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd8614-8c61-4230-8d15-37787c15e93e None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:54.458415 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd8614-8c61-4230-8d15-37787c15e93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:54.486426 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-8cbd8614-8c61-4230-8d15-37787c15e93e None None] MFA Rules not processed for user `8d037b2b707141b6a2b325fde2e81e3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:54.487658 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-8cbd8614-8c61-4230-8d15-37787c15e93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:54.564513 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1404/2822] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:54 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:55:54.575977 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379689b3-cc76-4996-8508-4f8d91c57398 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:54.639009 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379689b3-cc76-4996-8508-4f8d91c57398 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:54.645749 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a225e06-b693-4509-8654-904a77672c19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:54.645749 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a225e06-b693-4509-8654-904a77672c19 service cinder] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:54.645749 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a225e06-b693-4509-8654-904a77672c19 service cinder] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:54.645749 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a225e06-b693-4509-8654-904a77672c19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:54.655490 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a225e06-b693-4509-8654-904a77672c19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:54.656950 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a225e06-b693-4509-8654-904a77672c19 service cinder] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:54.666606 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1419/2823] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:55:54 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:55:55.527157 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd8614-8c61-4230-8d15-37787c15e93e None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:55.577129 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:55.598392 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd8614-8c61-4230-8d15-37787c15e93e None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:55.603110 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f39dff-a1a7-40dc-baa2-96870cf760a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:55.603797 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f39dff-a1a7-40dc-baa2-96870cf760a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:55.604083 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f39dff-a1a7-40dc-baa2-96870cf760a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:55.604500 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f39dff-a1a7-40dc-baa2-96870cf760a6 admin admin] PATH_INFO: `/v3/users/079a5bc9d9104ebf833fdbc46dbabc74` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:55.605647 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f39dff-a1a7-40dc-baa2-96870cf760a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=079a5bc9d9104ebf833fdbc46dbabc74)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:55.607617 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f39dff-a1a7-40dc-baa2-96870cf760a6 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:55.838078 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-65f39dff-a1a7-40dc-baa2-96870cf760a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '079a5bc9d9104ebf833fdbc46dbabc74'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:55.965944 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-65f39dff-a1a7-40dc-baa2-96870cf760a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '079a5bc9d9104ebf833fdbc46dbabc74'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:55.975465 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-65f39dff-a1a7-40dc-baa2-96870cf760a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '079a5bc9d9104ebf833fdbc46dbabc74'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:55.994828 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-65f39dff-a1a7-40dc-baa2-96870cf760a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '079a5bc9d9104ebf833fdbc46dbabc74'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:55.995580 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-65f39dff-a1a7-40dc-baa2-96870cf760a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '079a5bc9d9104ebf833fdbc46dbabc74'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:56.001518 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1405/2824] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:55:55 2022] DELETE /identity/v3/users/079a5bc9d9104ebf833fdbc46dbabc74 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:55:56.006626 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4718c-6c71-4dde-a06e-f70b0ba635ce None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:56.007119 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4718c-6c71-4dde-a06e-f70b0ba635ce None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:56.007804 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4718c-6c71-4dde-a06e-f70b0ba635ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:56.027920 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-25e4718c-6c71-4dde-a06e-f70b0ba635ce None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:56.029177 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-25e4718c-6c71-4dde-a06e-f70b0ba635ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:56.096406 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1420/2825] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:55:56.106752 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f39dff-a1a7-40dc-baa2-96870cf760a6 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:56.108240 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-65f39dff-a1a7-40dc-baa2-96870cf760a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:56.172540 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f39dff-a1a7-40dc-baa2-96870cf760a6 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:56.176345 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba22e0-381e-46cc-b809-c56f375e709d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:56.177501 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba22e0-381e-46cc-b809-c56f375e709d service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:56.177775 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba22e0-381e-46cc-b809-c56f375e709d service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:56.178042 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba22e0-381e-46cc-b809-c56f375e709d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:56.188746 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ba22e0-381e-46cc-b809-c56f375e709d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:56.190163 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ba22e0-381e-46cc-b809-c56f375e709d service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:56.201496 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1406/2826] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:55:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:55:56.663367 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4718c-6c71-4dde-a06e-f70b0ba635ce None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:56.665689 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-25e4718c-6c71-4dde-a06e-f70b0ba635ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:56.682444 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4718c-6c71-4dde-a06e-f70b0ba635ce None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:56.688706 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eeee20-3773-4dc4-ba96-2133c93db16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:56.689474 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eeee20-3773-4dc4-ba96-2133c93db16f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:56.689827 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eeee20-3773-4dc4-ba96-2133c93db16f admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:56.690133 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eeee20-3773-4dc4-ba96-2133c93db16f admin admin] PATH_INFO: `/v3/projects/699917aee1204b19850a4df07e6d89aa` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:56.691491 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eeee20-3773-4dc4-ba96-2133c93db16f admin admin] RBAC: Authorizing `identity:delete_project(project_id=699917aee1204b19850a4df07e6d89aa)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:56.703020 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eeee20-3773-4dc4-ba96-2133c93db16f admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:56.809598 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:56.816056 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-06eeee20-3773-4dc4-ba96-2133c93db16f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '699917aee1204b19850a4df07e6d89aa', 'request_id': 'req-06eeee20-3773-4dc4-ba96-2133c93db16f'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:56.903579 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-06eeee20-3773-4dc4-ba96-2133c93db16f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '699917aee1204b19850a4df07e6d89aa', 'request_id': 'req-06eeee20-3773-4dc4-ba96-2133c93db16f'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:56.909939 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-06eeee20-3773-4dc4-ba96-2133c93db16f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '699917aee1204b19850a4df07e6d89aa', 'request_id': 'req-06eeee20-3773-4dc4-ba96-2133c93db16f'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:56.920968 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-06eeee20-3773-4dc4-ba96-2133c93db16f admin admin] The token cache is being invalidate because project 699917aee1204b19850a4df07e6d89aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:55:56.921302 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-06eeee20-3773-4dc4-ba96-2133c93db16f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:56.921947 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-06eeee20-3773-4dc4-ba96-2133c93db16f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:56.923455 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1421/2827] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:55:56 2022] DELETE /identity/v3/projects/699917aee1204b19850a4df07e6d89aa => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:55:56.927944 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba22e0-381e-46cc-b809-c56f375e709d service neutron] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:56.937729 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba22e0-381e-46cc-b809-c56f375e709d service neutron] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:56.995232 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1596dcf-3589-439b-84ab-b306d70c3b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:56.995866 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1596dcf-3589-439b-84ab-b306d70c3b19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:56.996144 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1596dcf-3589-439b-84ab-b306d70c3b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:56.996413 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1596dcf-3589-439b-84ab-b306d70c3b19 admin admin] PATH_INFO: `/v3/users/8d037b2b707141b6a2b325fde2e81e3c` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:56.997554 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1596dcf-3589-439b-84ab-b306d70c3b19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d037b2b707141b6a2b325fde2e81e3c)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:56.999517 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1596dcf-3589-439b-84ab-b306d70c3b19 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:57.005686 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:57.140040 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-a1596dcf-3589-439b-84ab-b306d70c3b19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d037b2b707141b6a2b325fde2e81e3c'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:57.194466 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-a1596dcf-3589-439b-84ab-b306d70c3b19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d037b2b707141b6a2b325fde2e81e3c'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:57.201818 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-a1596dcf-3589-439b-84ab-b306d70c3b19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d037b2b707141b6a2b325fde2e81e3c'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:57.213389 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-a1596dcf-3589-439b-84ab-b306d70c3b19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d037b2b707141b6a2b325fde2e81e3c'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:57.214027 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-a1596dcf-3589-439b-84ab-b306d70c3b19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d037b2b707141b6a2b325fde2e81e3c'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:57.219869 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1407/2828] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:55:56 2022] DELETE /identity/v3/users/8d037b2b707141b6a2b325fde2e81e3c => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:55:57.631307 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eeee20-3773-4dc4-ba96-2133c93db16f admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:57.642929 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-06eeee20-3773-4dc4-ba96-2133c93db16f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:57.646139 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eeee20-3773-4dc4-ba96-2133c93db16f admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:57.712367 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a881123-5b51-4def-a5c1-1ec0cfd6ed73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:57.713055 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a881123-5b51-4def-a5c1-1ec0cfd6ed73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:57.713347 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a881123-5b51-4def-a5c1-1ec0cfd6ed73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:57.713624 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a881123-5b51-4def-a5c1-1ec0cfd6ed73 admin admin] PATH_INFO: `/v3/projects/46e2cf3180a946b2adfef44ed9d1aaf9` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:57.714847 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a881123-5b51-4def-a5c1-1ec0cfd6ed73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46e2cf3180a946b2adfef44ed9d1aaf9)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:57.716872 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a881123-5b51-4def-a5c1-1ec0cfd6ed73 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:57.872481 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-4a881123-5b51-4def-a5c1-1ec0cfd6ed73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46e2cf3180a946b2adfef44ed9d1aaf9', 'request_id': 'req-4a881123-5b51-4def-a5c1-1ec0cfd6ed73'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:57.961005 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-4a881123-5b51-4def-a5c1-1ec0cfd6ed73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46e2cf3180a946b2adfef44ed9d1aaf9', 'request_id': 'req-4a881123-5b51-4def-a5c1-1ec0cfd6ed73'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:57.967007 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-4a881123-5b51-4def-a5c1-1ec0cfd6ed73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46e2cf3180a946b2adfef44ed9d1aaf9', 'request_id': 'req-4a881123-5b51-4def-a5c1-1ec0cfd6ed73'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:57.977990 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-4a881123-5b51-4def-a5c1-1ec0cfd6ed73 admin admin] The token cache is being invalidate because project 46e2cf3180a946b2adfef44ed9d1aaf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:55:57.978278 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-4a881123-5b51-4def-a5c1-1ec0cfd6ed73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:57.978895 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-4a881123-5b51-4def-a5c1-1ec0cfd6ed73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:57.980631 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1422/2829] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:55:57 2022] DELETE /identity/v3/projects/46e2cf3180a946b2adfef44ed9d1aaf9 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:55:57.986181 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb9207-deb4-4ea8-bbe4-9fda7170b8ac None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:57.986715 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb9207-deb4-4ea8-bbe4-9fda7170b8ac None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:57.986809 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb9207-deb4-4ea8-bbe4-9fda7170b8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:58.006469 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-b4eb9207-deb4-4ea8-bbe4-9fda7170b8ac None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:58.008201 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-b4eb9207-deb4-4ea8-bbe4-9fda7170b8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:58.071016 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1408/2830] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:55:58.079105 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f652c29-5342-4640-ba67-9dcb8776dc58 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:58.079322 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f652c29-5342-4640-ba67-9dcb8776dc58 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:58.079602 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f652c29-5342-4640-ba67-9dcb8776dc58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:58.099595 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-4f652c29-5342-4640-ba67-9dcb8776dc58 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:58.100822 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-4f652c29-5342-4640-ba67-9dcb8776dc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:58.112990 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1423/2831] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:55:58.118377 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb9207-deb4-4ea8-bbe4-9fda7170b8ac None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:58.129023 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb9207-deb4-4ea8-bbe4-9fda7170b8ac None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:58.134300 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef88e2-c98f-42c7-b8cb-31d6b2775a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:58.134922 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef88e2-c98f-42c7-b8cb-31d6b2775a3d admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:58.135234 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef88e2-c98f-42c7-b8cb-31d6b2775a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:58.135657 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef88e2-c98f-42c7-b8cb-31d6b2775a3d admin admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:58.136400 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef88e2-c98f-42c7-b8cb-31d6b2775a3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:55:58.136707 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef88e2-c98f-42c7-b8cb-31d6b2775a3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:58.138304 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef88e2-c98f-42c7-b8cb-31d6b2775a3d admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:58.150762 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1409/2832] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:55:58.155377 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f652c29-5342-4640-ba67-9dcb8776dc58 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:58.165083 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f652c29-5342-4640-ba67-9dcb8776dc58 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:58.169921 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4af74-7895-4ed8-a3fa-19deae564cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:58.170627 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4af74-7895-4ed8-a3fa-19deae564cd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:58.170907 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4af74-7895-4ed8-a3fa-19deae564cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:58.171209 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4af74-7895-4ed8-a3fa-19deae564cd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:58.171940 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4af74-7895-4ed8-a3fa-19deae564cd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:58.173867 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4af74-7895-4ed8-a3fa-19deae564cd9 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:58.278341 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1424/2833] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:55:58 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:55:58.283018 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef88e2-c98f-42c7-b8cb-31d6b2775a3d admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:58.294080 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef88e2-c98f-42c7-b8cb-31d6b2775a3d admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:58.362034 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad12cb5-69d3-41c3-9a95-cd0d0df36974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:58.362657 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad12cb5-69d3-41c3-9a95-cd0d0df36974 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:58.363091 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad12cb5-69d3-41c3-9a95-cd0d0df36974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:58.363371 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad12cb5-69d3-41c3-9a95-cd0d0df36974 admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:58.364052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad12cb5-69d3-41c3-9a95-cd0d0df36974 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:58.366297 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad12cb5-69d3-41c3-9a95-cd0d0df36974 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:58.458264 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1410/2834] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:55:58 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:55:58.462415 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4af74-7895-4ed8-a3fa-19deae564cd9 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:58.472899 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4af74-7895-4ed8-a3fa-19deae564cd9 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:58.478005 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44afa547-ec0d-466d-ab55-9b0d1cc7b40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:58.478604 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44afa547-ec0d-466d-ab55-9b0d1cc7b40d admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:58.478988 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44afa547-ec0d-466d-ab55-9b0d1cc7b40d admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:58.482014 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44afa547-ec0d-466d-ab55-9b0d1cc7b40d admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:58.482014 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44afa547-ec0d-466d-ab55-9b0d1cc7b40d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:58.482014 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44afa547-ec0d-466d-ab55-9b0d1cc7b40d admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:58.492603 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1425/2835] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:55:58.498099 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad12cb5-69d3-41c3-9a95-cd0d0df36974 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:58.507446 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:58.507446 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad12cb5-69d3-41c3-9a95-cd0d0df36974 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:58.511822 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a24a7e-5bbc-4c8e-964e-e3ac36406a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:58.512432 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a24a7e-5bbc-4c8e-964e-e3ac36406a80 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:58.512713 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a24a7e-5bbc-4c8e-964e-e3ac36406a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:58.512985 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a24a7e-5bbc-4c8e-964e-e3ac36406a80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:58.513672 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a24a7e-5bbc-4c8e-964e-e3ac36406a80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:58.515288 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a24a7e-5bbc-4c8e-964e-e3ac36406a80 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:58.525595 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1411/2836] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:55:58.529861 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44afa547-ec0d-466d-ab55-9b0d1cc7b40d admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:58.540368 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44afa547-ec0d-466d-ab55-9b0d1cc7b40d admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:58.544925 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a9f2a8-6dd0-4134-ba13-56a0c18a56ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:58.545575 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9f2a8-6dd0-4134-ba13-56a0c18a56ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:58.545852 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9f2a8-6dd0-4134-ba13-56a0c18a56ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:58.546125 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9f2a8-6dd0-4134-ba13-56a0c18a56ba admin admin] PATH_INFO: `/v3/projects/675fa1b150324b449bf2de5d427d76dc/users/8d285c0c962a40b099fc5e23ce66866e/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:58.561966 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a9f2a8-6dd0-4134-ba13-56a0c18a56ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=675fa1b150324b449bf2de5d427d76dc, user_id=8d285c0c962a40b099fc5e23ce66866e, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:58.567926 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a9f2a8-6dd0-4134-ba13-56a0c18a56ba admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:58.567926 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:58.634660 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1426/2837] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:55:58 2022] PUT /identity/v3/projects/675fa1b150324b449bf2de5d427d76dc/users/8d285c0c962a40b099fc5e23ce66866e/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:55:58.646336 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f06c8-0340-43e7-a551-ed353a1725c3 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:58.646621 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f06c8-0340-43e7-a551-ed353a1725c3 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:58.646898 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f06c8-0340-43e7-a551-ed353a1725c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:58.675303 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-5f2f06c8-0340-43e7-a551-ed353a1725c3 None None] MFA Rules not processed for user `8d285c0c962a40b099fc5e23ce66866e`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:58.676508 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-5f2f06c8-0340-43e7-a551-ed353a1725c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:58.748215 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1412/2838] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:55:58.752664 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a9f2a8-6dd0-4134-ba13-56a0c18a56ba admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:58.822354 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a9f2a8-6dd0-4134-ba13-56a0c18a56ba admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:58.829142 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a70a4c-1648-41be-a3b2-c6c70d5d35e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:58.829762 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a70a4c-1648-41be-a3b2-c6c70d5d35e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:58.830042 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a70a4c-1648-41be-a3b2-c6c70d5d35e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:58.830316 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a70a4c-1648-41be-a3b2-c6c70d5d35e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:58.831005 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a70a4c-1648-41be-a3b2-c6c70d5d35e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:58.832912 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a70a4c-1648-41be-a3b2-c6c70d5d35e0 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:58.912331 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1427/2839] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:55:58 2022] POST /identity/v3/projects => generated 385 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:55:58.915762 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f06c8-0340-43e7-a551-ed353a1725c3 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:58.926780 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f06c8-0340-43e7-a551-ed353a1725c3 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:58.983361 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b3783-e7b5-4bfd-91d3-453d95025047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:58.983916 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b3783-e7b5-4bfd-91d3-453d95025047 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:58.984202 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b3783-e7b5-4bfd-91d3-453d95025047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:58.984478 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b3783-e7b5-4bfd-91d3-453d95025047 admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:58.985173 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b3783-e7b5-4bfd-91d3-453d95025047 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:58.987119 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b3783-e7b5-4bfd-91d3-453d95025047 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:59.082994 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1413/2840] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:55:58 2022] POST /identity/v3/users => generated 299 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:55:59.085914 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a70a4c-1648-41be-a3b2-c6c70d5d35e0 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:59.096686 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a70a4c-1648-41be-a3b2-c6c70d5d35e0 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:59.101809 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc6cd2-9e9a-45cf-a045-e34dc776f676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:59.102458 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc6cd2-9e9a-45cf-a045-e34dc776f676 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:59.102737 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc6cd2-9e9a-45cf-a045-e34dc776f676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:59.103043 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc6cd2-9e9a-45cf-a045-e34dc776f676 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:59.103725 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc6cd2-9e9a-45cf-a045-e34dc776f676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:59.105312 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc6cd2-9e9a-45cf-a045-e34dc776f676 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:59.117917 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1428/2841] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:55:59.122179 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b3783-e7b5-4bfd-91d3-453d95025047 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:59.132476 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b3783-e7b5-4bfd-91d3-453d95025047 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:59.137453 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add8483-33ae-4c4a-aebe-94c643633d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:59.138063 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add8483-33ae-4c4a-aebe-94c643633d44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:59.138452 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add8483-33ae-4c4a-aebe-94c643633d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:59.138769 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add8483-33ae-4c4a-aebe-94c643633d44 admin admin] PATH_INFO: `/v3/projects/a5432d259e2640bca0c0f39c230c5bea/users/97ca2fdf9ed14de0828e9a5b04c35c78/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:59.155167 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1add8483-33ae-4c4a-aebe-94c643633d44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5432d259e2640bca0c0f39c230c5bea, user_id=97ca2fdf9ed14de0828e9a5b04c35c78, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:59.158129 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1add8483-33ae-4c4a-aebe-94c643633d44 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:59.213141 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1414/2842] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:55:59 2022] PUT /identity/v3/projects/a5432d259e2640bca0c0f39c230c5bea/users/97ca2fdf9ed14de0828e9a5b04c35c78/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:55:59.217224 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc6cd2-9e9a-45cf-a045-e34dc776f676 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:59.228356 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc6cd2-9e9a-45cf-a045-e34dc776f676 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:59.287865 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b3fb60-24c2-4061-954f-adb72ceb6230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:59.289650 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3fb60-24c2-4061-954f-adb72ceb6230 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:59.290544 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3fb60-24c2-4061-954f-adb72ceb6230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:59.290835 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3fb60-24c2-4061-954f-adb72ceb6230 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:59.291641 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b3fb60-24c2-4061-954f-adb72ceb6230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:59.293237 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b3fb60-24c2-4061-954f-adb72ceb6230 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:59.303599 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1429/2843] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:55:59.308796 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add8483-33ae-4c4a-aebe-94c643633d44 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:59.320348 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add8483-33ae-4c4a-aebe-94c643633d44 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:59.325161 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af5569-d0e1-4bf7-823d-aeeef5682715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:59.325834 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af5569-d0e1-4bf7-823d-aeeef5682715 admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:59.326120 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af5569-d0e1-4bf7-823d-aeeef5682715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:59.326396 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af5569-d0e1-4bf7-823d-aeeef5682715 admin admin] PATH_INFO: `/v3/projects/a5432d259e2640bca0c0f39c230c5bea/users/97ca2fdf9ed14de0828e9a5b04c35c78/roles/83afe883a303495b966480fb9b5bb7dd` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:59.328395 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af5569-d0e1-4bf7-823d-aeeef5682715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5432d259e2640bca0c0f39c230c5bea, user_id=97ca2fdf9ed14de0828e9a5b04c35c78, role_id=83afe883a303495b966480fb9b5bb7dd)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:59.331044 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af5569-d0e1-4bf7-823d-aeeef5682715 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:59.342025 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1415/2844] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:55:59 2022] PUT /identity/v3/projects/a5432d259e2640bca0c0f39c230c5bea/users/97ca2fdf9ed14de0828e9a5b04c35c78/roles/83afe883a303495b966480fb9b5bb7dd => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:55:59.353661 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c56193-695c-42b6-b565-a24a46fa10d0 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:59.353958 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c56193-695c-42b6-b565-a24a46fa10d0 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:59.354233 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c56193-695c-42b6-b565-a24a46fa10d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:59.384407 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-95c56193-695c-42b6-b565-a24a46fa10d0 None None] MFA Rules not processed for user `97ca2fdf9ed14de0828e9a5b04c35c78`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:55:59.385699 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-95c56193-695c-42b6-b565-a24a46fa10d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:59.410684 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af5569-d0e1-4bf7-823d-aeeef5682715 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:59.413093 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-d6af5569-d0e1-4bf7-823d-aeeef5682715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:59.443619 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:59.452798 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:55:59.463127 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1430/2845] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:59 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:55:59.475032 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c56193-695c-42b6-b565-a24a46fa10d0 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:59.479851 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-95c56193-695c-42b6-b565-a24a46fa10d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:59.481696 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af5569-d0e1-4bf7-823d-aeeef5682715 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:59.485530 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277758c-bbdd-4bb5-bbab-46102c37b36f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:59.486157 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277758c-bbdd-4bb5-bbab-46102c37b36f service cinder] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:59.486437 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277758c-bbdd-4bb5-bbab-46102c37b36f service cinder] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:59.486849 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277758c-bbdd-4bb5-bbab-46102c37b36f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:59.488666 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-b277758c-bbdd-4bb5-bbab-46102c37b36f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:55:59.492419 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c56193-695c-42b6-b565-a24a46fa10d0 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:59.496219 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0bef4-b45d-4f6c-8fd2-f1b138a5b83e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:59.496857 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0bef4-b45d-4f6c-8fd2-f1b138a5b83e service cinder] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:59.501260 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0bef4-b45d-4f6c-8fd2-f1b138a5b83e service cinder] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:59.501260 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0bef4-b45d-4f6c-8fd2-f1b138a5b83e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:59.506536 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f0bef4-b45d-4f6c-8fd2-f1b138a5b83e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:59.508991 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f0bef4-b45d-4f6c-8fd2-f1b138a5b83e service cinder] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:59.518616 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1431/2846] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:55:59 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:55:59.550205 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0bef4-b45d-4f6c-8fd2-f1b138a5b83e service cinder] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:55:59.560331 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b277758c-bbdd-4bb5-bbab-46102c37b36f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:59.561769 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b277758c-bbdd-4bb5-bbab-46102c37b36f service cinder] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:59.573599 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1416/2847] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:55:59 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:55:59.618263 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0bef4-b45d-4f6c-8fd2-f1b138a5b83e service cinder] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:55:59.623279 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee6879-c558-4131-8da0-b99608bac61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:55:59.623935 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee6879-c558-4131-8da0-b99608bac61f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:59.624214 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee6879-c558-4131-8da0-b99608bac61f admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:59.624482 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee6879-c558-4131-8da0-b99608bac61f admin admin] PATH_INFO: `/v3/users/8d285c0c962a40b099fc5e23ce66866e` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:55:59.625659 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee6879-c558-4131-8da0-b99608bac61f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d285c0c962a40b099fc5e23ce66866e)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:55:59.627673 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee6879-c558-4131-8da0-b99608bac61f admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:55:59.833335 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-9cee6879-c558-4131-8da0-b99608bac61f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d285c0c962a40b099fc5e23ce66866e'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:59.943298 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-9cee6879-c558-4131-8da0-b99608bac61f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d285c0c962a40b099fc5e23ce66866e'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:59.955334 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-9cee6879-c558-4131-8da0-b99608bac61f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d285c0c962a40b099fc5e23ce66866e'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:59.956177 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-9cee6879-c558-4131-8da0-b99608bac61f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d285c0c962a40b099fc5e23ce66866e'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:59.968078 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-9cee6879-c558-4131-8da0-b99608bac61f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d285c0c962a40b099fc5e23ce66866e'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:55:59.974002 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1432/2848] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:55:59 2022] DELETE /identity/v3/users/8d285c0c962a40b099fc5e23ce66866e => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:55:59.979229 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d44e34-2ce5-489c-bfaf-ba58a4af7a3d None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:55:59.979519 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d44e34-2ce5-489c-bfaf-ba58a4af7a3d None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:55:59.979800 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d44e34-2ce5-489c-bfaf-ba58a4af7a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:00.002199 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-98d44e34-2ce5-489c-bfaf-ba58a4af7a3d None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:56:00.003557 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-98d44e34-2ce5-489c-bfaf-ba58a4af7a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:56:00.063525 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1417/2849] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:56:00.073577 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee6879-c558-4131-8da0-b99608bac61f admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:56:00.075069 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-9cee6879-c558-4131-8da0-b99608bac61f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:56:00.137547 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee6879-c558-4131-8da0-b99608bac61f admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:56:00.141422 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455984bf-2da6-46c0-a2ab-9085c607ae41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:56:00.142061 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455984bf-2da6-46c0-a2ab-9085c607ae41 service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:00.142344 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455984bf-2da6-46c0-a2ab-9085c607ae41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:00.142620 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455984bf-2da6-46c0-a2ab-9085c607ae41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:00.152461 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455984bf-2da6-46c0-a2ab-9085c607ae41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:56:00.153868 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455984bf-2da6-46c0-a2ab-9085c607ae41 service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:56:00.159431 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:56:00.165311 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1433/2850] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:56:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:56:00.619988 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d44e34-2ce5-489c-bfaf-ba58a4af7a3d None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:56:00.621507 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-98d44e34-2ce5-489c-bfaf-ba58a4af7a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:56:00.635604 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d44e34-2ce5-489c-bfaf-ba58a4af7a3d None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:56:00.640419 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b82f9-9228-48a1-9447-8be4bc8c3b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:56:00.641373 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b82f9-9228-48a1-9447-8be4bc8c3b56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:00.641657 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b82f9-9228-48a1-9447-8be4bc8c3b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:00.641932 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b82f9-9228-48a1-9447-8be4bc8c3b56 admin admin] PATH_INFO: `/v3/projects/675fa1b150324b449bf2de5d427d76dc` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:00.643309 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b82f9-9228-48a1-9447-8be4bc8c3b56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=675fa1b150324b449bf2de5d427d76dc)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:56:00.645375 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b82f9-9228-48a1-9447-8be4bc8c3b56 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:56:00.780755 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-087b82f9-9228-48a1-9447-8be4bc8c3b56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '675fa1b150324b449bf2de5d427d76dc', 'request_id': 'req-087b82f9-9228-48a1-9447-8be4bc8c3b56'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:00.857874 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-087b82f9-9228-48a1-9447-8be4bc8c3b56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '675fa1b150324b449bf2de5d427d76dc', 'request_id': 'req-087b82f9-9228-48a1-9447-8be4bc8c3b56'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:00.866783 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-087b82f9-9228-48a1-9447-8be4bc8c3b56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '675fa1b150324b449bf2de5d427d76dc', 'request_id': 'req-087b82f9-9228-48a1-9447-8be4bc8c3b56'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:00.875997 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-087b82f9-9228-48a1-9447-8be4bc8c3b56 admin admin] The token cache is being invalidate because project 675fa1b150324b449bf2de5d427d76dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:56:00.876287 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-087b82f9-9228-48a1-9447-8be4bc8c3b56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:00.876950 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-087b82f9-9228-48a1-9447-8be4bc8c3b56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:00.878512 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1418/2851] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:56:00 2022] DELETE /identity/v3/projects/675fa1b150324b449bf2de5d427d76dc => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:56:00.883331 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455984bf-2da6-46c0-a2ab-9085c607ae41 service neutron] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:56:00.894261 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455984bf-2da6-46c0-a2ab-9085c607ae41 service neutron] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:56:00.952384 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde0aef-52ee-400a-8df9-d1e677dcb02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:56:00.953031 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde0aef-52ee-400a-8df9-d1e677dcb02c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:00.953304 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde0aef-52ee-400a-8df9-d1e677dcb02c admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:00.953577 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde0aef-52ee-400a-8df9-d1e677dcb02c admin admin] PATH_INFO: `/v3/users/97ca2fdf9ed14de0828e9a5b04c35c78` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:00.954749 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde0aef-52ee-400a-8df9-d1e677dcb02c admin admin] RBAC: Authorizing `identity:delete_user(user_id=97ca2fdf9ed14de0828e9a5b04c35c78)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:56:00.956766 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde0aef-52ee-400a-8df9-d1e677dcb02c admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:56:01.105693 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-5fde0aef-52ee-400a-8df9-d1e677dcb02c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97ca2fdf9ed14de0828e9a5b04c35c78'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:01.155016 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-5fde0aef-52ee-400a-8df9-d1e677dcb02c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97ca2fdf9ed14de0828e9a5b04c35c78'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:01.162387 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-5fde0aef-52ee-400a-8df9-d1e677dcb02c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97ca2fdf9ed14de0828e9a5b04c35c78'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:01.163136 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-5fde0aef-52ee-400a-8df9-d1e677dcb02c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97ca2fdf9ed14de0828e9a5b04c35c78'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:01.177878 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-5fde0aef-52ee-400a-8df9-d1e677dcb02c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97ca2fdf9ed14de0828e9a5b04c35c78'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:01.184602 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1434/2852] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:56:00 2022] DELETE /identity/v3/users/97ca2fdf9ed14de0828e9a5b04c35c78 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:56:01.614758 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b82f9-9228-48a1-9447-8be4bc8c3b56 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:56:01.616709 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-087b82f9-9228-48a1-9447-8be4bc8c3b56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:56:01.632267 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b82f9-9228-48a1-9447-8be4bc8c3b56 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:56:01.637537 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:56:01.695331 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef37e4-f97f-48ec-b089-7cac3b42a90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:56:01.695906 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef37e4-f97f-48ec-b089-7cac3b42a90e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:01.696191 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef37e4-f97f-48ec-b089-7cac3b42a90e admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:01.696466 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef37e4-f97f-48ec-b089-7cac3b42a90e admin admin] PATH_INFO: `/v3/projects/a5432d259e2640bca0c0f39c230c5bea` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:01.697743 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef37e4-f97f-48ec-b089-7cac3b42a90e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5432d259e2640bca0c0f39c230c5bea)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:56:01.699700 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef37e4-f97f-48ec-b089-7cac3b42a90e admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:56:01.848133 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-2fef37e4-f97f-48ec-b089-7cac3b42a90e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5432d259e2640bca0c0f39c230c5bea', 'request_id': 'req-2fef37e4-f97f-48ec-b089-7cac3b42a90e'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:01.920483 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-2fef37e4-f97f-48ec-b089-7cac3b42a90e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5432d259e2640bca0c0f39c230c5bea', 'request_id': 'req-2fef37e4-f97f-48ec-b089-7cac3b42a90e'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:01.926441 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-2fef37e4-f97f-48ec-b089-7cac3b42a90e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5432d259e2640bca0c0f39c230c5bea', 'request_id': 'req-2fef37e4-f97f-48ec-b089-7cac3b42a90e'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:01.937693 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-2fef37e4-f97f-48ec-b089-7cac3b42a90e admin admin] The token cache is being invalidate because project a5432d259e2640bca0c0f39c230c5bea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:56:01.937981 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-2fef37e4-f97f-48ec-b089-7cac3b42a90e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:01.938613 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-2fef37e4-f97f-48ec-b089-7cac3b42a90e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:01.940128 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1419/2853] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:56:01 2022] DELETE /identity/v3/projects/a5432d259e2640bca0c0f39c230c5bea => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:56:01.946226 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc590c1-ef89-42fc-b571-e6bab9f94fed None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:01.946687 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc590c1-ef89-42fc-b571-e6bab9f94fed None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:01.946822 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc590c1-ef89-42fc-b571-e6bab9f94fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:01.967782 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-7cc590c1-ef89-42fc-b571-e6bab9f94fed None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:56:01.969014 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-7cc590c1-ef89-42fc-b571-e6bab9f94fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:56:02.036095 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1435/2854] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:56:02.044500 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93e458-e721-408e-a848-1606b05b1eaa None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:02.044827 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93e458-e721-408e-a848-1606b05b1eaa None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:02.045072 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93e458-e721-408e-a848-1606b05b1eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:02.064521 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-cb93e458-e721-408e-a848-1606b05b1eaa None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:56:02.065718 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-cb93e458-e721-408e-a848-1606b05b1eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:56:02.074932 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1420/2855] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:56:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:56:02.081682 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc590c1-ef89-42fc-b571-e6bab9f94fed None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:56:02.091940 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc590c1-ef89-42fc-b571-e6bab9f94fed None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:56:02.096501 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05b57b-32b8-42ef-b754-f80b3356606c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:56:02.097097 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05b57b-32b8-42ef-b754-f80b3356606c admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:02.097375 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05b57b-32b8-42ef-b754-f80b3356606c admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:02.097645 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05b57b-32b8-42ef-b754-f80b3356606c admin admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:02.098328 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e05b57b-32b8-42ef-b754-f80b3356606c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:56:02.098627 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e05b57b-32b8-42ef-b754-f80b3356606c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:56:02.100247 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e05b57b-32b8-42ef-b754-f80b3356606c admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:56:02.112068 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1436/2856] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:56:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:56:02.116559 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93e458-e721-408e-a848-1606b05b1eaa None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:56:02.126030 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93e458-e721-408e-a848-1606b05b1eaa None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:56:02.130674 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387607e-0efe-4ff9-9bbe-b7b9d0d75298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:56:02.131376 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387607e-0efe-4ff9-9bbe-b7b9d0d75298 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:02.131657 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387607e-0efe-4ff9-9bbe-b7b9d0d75298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:02.131933 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387607e-0efe-4ff9-9bbe-b7b9d0d75298 admin admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:02.132634 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387607e-0efe-4ff9-9bbe-b7b9d0d75298 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:56:02.134537 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387607e-0efe-4ff9-9bbe-b7b9d0d75298 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:56:02.253463 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1421/2857] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:56:02 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:56:02.258276 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05b57b-32b8-42ef-b754-f80b3356606c admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:56:02.271771 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05b57b-32b8-42ef-b754-f80b3356606c admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:56:02.281540 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:56:02.337141 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00b204-6816-455a-a08d-d3dd73f825c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:56:02.337758 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00b204-6816-455a-a08d-d3dd73f825c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:02.338038 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00b204-6816-455a-a08d-d3dd73f825c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:02.338311 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00b204-6816-455a-a08d-d3dd73f825c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:02.338999 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a00b204-6816-455a-a08d-d3dd73f825c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:56:02.340940 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a00b204-6816-455a-a08d-d3dd73f825c8 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:56:02.423493 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1437/2858] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:56:02 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:56:02.427703 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387607e-0efe-4ff9-9bbe-b7b9d0d75298 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:56:02.437861 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387607e-0efe-4ff9-9bbe-b7b9d0d75298 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:56:02.442627 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94d905-3170-4bd3-b7ad-54770b26aa19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:56:02.443269 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94d905-3170-4bd3-b7ad-54770b26aa19 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:02.443578 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94d905-3170-4bd3-b7ad-54770b26aa19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:02.443853 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94d905-3170-4bd3-b7ad-54770b26aa19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:02.444566 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d94d905-3170-4bd3-b7ad-54770b26aa19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:56:02.446728 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d94d905-3170-4bd3-b7ad-54770b26aa19 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:56:02.456466 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1422/2859] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:56:02.460282 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00b204-6816-455a-a08d-d3dd73f825c8 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:56:02.470690 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00b204-6816-455a-a08d-d3dd73f825c8 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:56:02.475277 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b38a03-e342-4300-bf24-3d9161177df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:56:02.475868 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b38a03-e342-4300-bf24-3d9161177df8 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:02.476171 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b38a03-e342-4300-bf24-3d9161177df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:02.476449 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b38a03-e342-4300-bf24-3d9161177df8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:02.477124 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b38a03-e342-4300-bf24-3d9161177df8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:56:02.478697 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b38a03-e342-4300-bf24-3d9161177df8 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:56:02.488863 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1438/2860] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:56:02.492983 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94d905-3170-4bd3-b7ad-54770b26aa19 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:56:02.502659 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94d905-3170-4bd3-b7ad-54770b26aa19 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:56:02.507860 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418cf46-f932-4f20-ad89-7d70bfdbb00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:56:02.508434 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418cf46-f932-4f20-ad89-7d70bfdbb00f admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:02.508717 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418cf46-f932-4f20-ad89-7d70bfdbb00f admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:02.508992 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418cf46-f932-4f20-ad89-7d70bfdbb00f admin admin] PATH_INFO: `/v3/projects/0739996b1c8742288fe42c21e92f1630/users/80712b66186540769ec404bea18a9871/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:02.523603 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d418cf46-f932-4f20-ad89-7d70bfdbb00f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0739996b1c8742288fe42c21e92f1630, user_id=80712b66186540769ec404bea18a9871, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:56:02.526246 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d418cf46-f932-4f20-ad89-7d70bfdbb00f admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:56:02.594842 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1423/2861] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:56:02 2022] PUT /identity/v3/projects/0739996b1c8742288fe42c21e92f1630/users/80712b66186540769ec404bea18a9871/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:56:02.606202 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a7c5e-c1cc-4242-9b8f-6ae5b7658b53 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:02.606519 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a7c5e-c1cc-4242-9b8f-6ae5b7658b53 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:02.606795 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a7c5e-c1cc-4242-9b8f-6ae5b7658b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:02.636098 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-8e9a7c5e-c1cc-4242-9b8f-6ae5b7658b53 None None] MFA Rules not processed for user `80712b66186540769ec404bea18a9871`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:56:02.637288 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-8e9a7c5e-c1cc-4242-9b8f-6ae5b7658b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:56:02.699235 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1439/2862] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:56:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:56:02.709780 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418cf46-f932-4f20-ad89-7d70bfdbb00f admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:56:02.711576 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-d418cf46-f932-4f20-ad89-7d70bfdbb00f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:56:02.745913 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:56:02.771306 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418cf46-f932-4f20-ad89-7d70bfdbb00f admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:56:02.771306 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd39a5-5d32-4a83-a2b0-5b3295ab7fda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:56:02.771594 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd39a5-5d32-4a83-a2b0-5b3295ab7fda service cinder] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:02.771708 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd39a5-5d32-4a83-a2b0-5b3295ab7fda service cinder] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:02.771936 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd39a5-5d32-4a83-a2b0-5b3295ab7fda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:02.780296 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd39a5-5d32-4a83-a2b0-5b3295ab7fda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:56:02.781724 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd39a5-5d32-4a83-a2b0-5b3295ab7fda service cinder] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:56:02.790903 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1424/2863] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:56:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:56:04.954966 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a7c5e-c1cc-4242-9b8f-6ae5b7658b53 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:56:04.956376 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-8e9a7c5e-c1cc-4242-9b8f-6ae5b7658b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:56:05.047640 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:56:05.057018 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a7c5e-c1cc-4242-9b8f-6ae5b7658b53 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:56:05.062058 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7eec4-3e52-4317-a2a8-5b81af5e2aa6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647f2cb18a41d6a9e124e886faa994', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:56:05.062665 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7eec4-3e52-4317-a2a8-5b81af5e2aa6 service placement] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:05.063006 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7eec4-3e52-4317-a2a8-5b81af5e2aa6 service placement] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:05.063285 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7eec4-3e52-4317-a2a8-5b81af5e2aa6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:05.065011 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-45c7eec4-3e52-4317-a2a8-5b81af5e2aa6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:56:05.078984 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c7eec4-3e52-4317-a2a8-5b81af5e2aa6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:56:05.080720 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c7eec4-3e52-4317-a2a8-5b81af5e2aa6 service placement] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:56:05.091473 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1440/2864] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:56:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:56:05.370153 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd39a5-5d32-4a83-a2b0-5b3295ab7fda service cinder] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:56:05.371914 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-16fd39a5-5d32-4a83-a2b0-5b3295ab7fda service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:56:05.442548 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd39a5-5d32-4a83-a2b0-5b3295ab7fda service cinder] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:56:05.447177 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66443b-bd34-4670-bb6b-bff919bba11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:56:05.447820 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66443b-bd34-4670-bb6b-bff919bba11e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:05.448092 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66443b-bd34-4670-bb6b-bff919bba11e admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:05.448394 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66443b-bd34-4670-bb6b-bff919bba11e admin admin] PATH_INFO: `/v3/users/8ba208850cca4d1f89d23131c792d386` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:05.449576 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b66443b-bd34-4670-bb6b-bff919bba11e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ba208850cca4d1f89d23131c792d386)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:56:05.451535 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b66443b-bd34-4670-bb6b-bff919bba11e admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:56:05.700316 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-4b66443b-bd34-4670-bb6b-bff919bba11e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ba208850cca4d1f89d23131c792d386'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:05.783751 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-4b66443b-bd34-4670-bb6b-bff919bba11e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ba208850cca4d1f89d23131c792d386'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:05.791914 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-4b66443b-bd34-4670-bb6b-bff919bba11e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ba208850cca4d1f89d23131c792d386'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:05.815615 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-4b66443b-bd34-4670-bb6b-bff919bba11e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ba208850cca4d1f89d23131c792d386'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:05.816558 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-4b66443b-bd34-4670-bb6b-bff919bba11e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ba208850cca4d1f89d23131c792d386'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:05.822933 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1425/2865] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:56:05 2022] DELETE /identity/v3/users/8ba208850cca4d1f89d23131c792d386 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:56:05.835269 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c8e1a-d162-4d22-bff7-6615ca713ca0 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:05.835269 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c8e1a-d162-4d22-bff7-6615ca713ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:05.835269 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c8e1a-d162-4d22-bff7-6615ca713ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:05.847167 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-574c8e1a-d162-4d22-bff7-6615ca713ca0 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:56:05.848355 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-574c8e1a-d162-4d22-bff7-6615ca713ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:56:05.906468 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1441/2866] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:56:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:56:05.917178 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66443b-bd34-4670-bb6b-bff919bba11e admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:56:05.918625 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-4b66443b-bd34-4670-bb6b-bff919bba11e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:56:05.973700 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66443b-bd34-4670-bb6b-bff919bba11e admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:56:05.977785 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ef3b3-2692-4808-9040-4820ea62ca07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:56:05.978394 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ef3b3-2692-4808-9040-4820ea62ca07 service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:05.978671 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ef3b3-2692-4808-9040-4820ea62ca07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:05.978942 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ef3b3-2692-4808-9040-4820ea62ca07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:05.987964 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7ef3b3-2692-4808-9040-4820ea62ca07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:56:05.989391 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7ef3b3-2692-4808-9040-4820ea62ca07 service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:56:05.993765 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:56:06.000234 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1426/2867] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:56:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:56:06.433549 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c8e1a-d162-4d22-bff7-6615ca713ca0 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:56:06.435843 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-574c8e1a-d162-4d22-bff7-6615ca713ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:56:06.454822 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c8e1a-d162-4d22-bff7-6615ca713ca0 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:56:06.459462 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b413eb-4112-4787-a2d5-cdeee83f6174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:56:06.460105 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b413eb-4112-4787-a2d5-cdeee83f6174 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:06.460386 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b413eb-4112-4787-a2d5-cdeee83f6174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:06.460733 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b413eb-4112-4787-a2d5-cdeee83f6174 admin admin] PATH_INFO: `/v3/projects/cd23ca6282ef46d4a499055af5d42fd3` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:06.461861 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b413eb-4112-4787-a2d5-cdeee83f6174 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd23ca6282ef46d4a499055af5d42fd3)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:56:06.463849 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b413eb-4112-4787-a2d5-cdeee83f6174 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:56:06.569166 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-86b413eb-4112-4787-a2d5-cdeee83f6174 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd23ca6282ef46d4a499055af5d42fd3', 'request_id': 'req-86b413eb-4112-4787-a2d5-cdeee83f6174'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:06.635720 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-86b413eb-4112-4787-a2d5-cdeee83f6174 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd23ca6282ef46d4a499055af5d42fd3', 'request_id': 'req-86b413eb-4112-4787-a2d5-cdeee83f6174'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:06.642616 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-86b413eb-4112-4787-a2d5-cdeee83f6174 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd23ca6282ef46d4a499055af5d42fd3', 'request_id': 'req-86b413eb-4112-4787-a2d5-cdeee83f6174'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:06.657107 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-86b413eb-4112-4787-a2d5-cdeee83f6174 admin admin] The token cache is being invalidate because project cd23ca6282ef46d4a499055af5d42fd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:56:06.657469 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-86b413eb-4112-4787-a2d5-cdeee83f6174 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:06.658129 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-86b413eb-4112-4787-a2d5-cdeee83f6174 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:06.659863 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1442/2868] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:56:06 2022] DELETE /identity/v3/projects/cd23ca6282ef46d4a499055af5d42fd3 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:56:06.663716 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ef3b3-2692-4808-9040-4820ea62ca07 service neutron] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:56:06.673435 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ef3b3-2692-4808-9040-4820ea62ca07 service neutron] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:56:06.731955 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300fb850-e2e3-427d-835c-e4b9dac883f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:56:06.732600 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fb850-e2e3-427d-835c-e4b9dac883f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:06.732989 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fb850-e2e3-427d-835c-e4b9dac883f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:06.733276 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fb850-e2e3-427d-835c-e4b9dac883f4 admin admin] PATH_INFO: `/v3/users/8e7ced7b5789415b8fbeb957143ec22e` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:06.734448 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300fb850-e2e3-427d-835c-e4b9dac883f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e7ced7b5789415b8fbeb957143ec22e)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:56:06.736427 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300fb850-e2e3-427d-835c-e4b9dac883f4 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:56:06.947842 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-300fb850-e2e3-427d-835c-e4b9dac883f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e7ced7b5789415b8fbeb957143ec22e'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:07.012463 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-300fb850-e2e3-427d-835c-e4b9dac883f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e7ced7b5789415b8fbeb957143ec22e'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:07.019891 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-300fb850-e2e3-427d-835c-e4b9dac883f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e7ced7b5789415b8fbeb957143ec22e'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:07.031490 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-300fb850-e2e3-427d-835c-e4b9dac883f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e7ced7b5789415b8fbeb957143ec22e'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:07.032145 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-300fb850-e2e3-427d-835c-e4b9dac883f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e7ced7b5789415b8fbeb957143ec22e'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:07.037911 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1427/2869] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:56:06 2022] DELETE /identity/v3/users/8e7ced7b5789415b8fbeb957143ec22e => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:56:07.487634 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b413eb-4112-4787-a2d5-cdeee83f6174 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:56:07.491073 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-86b413eb-4112-4787-a2d5-cdeee83f6174 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:56:07.522003 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b413eb-4112-4787-a2d5-cdeee83f6174 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:56:07.602942 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb9328-a456-48a5-a9bb-b4ec20cc83df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:56:07.603896 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb9328-a456-48a5-a9bb-b4ec20cc83df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:07.604375 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb9328-a456-48a5-a9bb-b4ec20cc83df admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:07.604808 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb9328-a456-48a5-a9bb-b4ec20cc83df admin admin] PATH_INFO: `/v3/projects/79e702a89c8945caa87d4e4c116f8d0b` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:07.606279 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb9328-a456-48a5-a9bb-b4ec20cc83df admin admin] RBAC: Authorizing `identity:delete_project(project_id=79e702a89c8945caa87d4e4c116f8d0b)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:56:07.608393 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb9328-a456-48a5-a9bb-b4ec20cc83df admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:56:07.620103 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:56:07.722178 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-c7fb9328-a456-48a5-a9bb-b4ec20cc83df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79e702a89c8945caa87d4e4c116f8d0b', 'request_id': 'req-c7fb9328-a456-48a5-a9bb-b4ec20cc83df'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:07.791295 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-c7fb9328-a456-48a5-a9bb-b4ec20cc83df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79e702a89c8945caa87d4e4c116f8d0b', 'request_id': 'req-c7fb9328-a456-48a5-a9bb-b4ec20cc83df'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:07.798020 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-c7fb9328-a456-48a5-a9bb-b4ec20cc83df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79e702a89c8945caa87d4e4c116f8d0b', 'request_id': 'req-c7fb9328-a456-48a5-a9bb-b4ec20cc83df'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:07.811289 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-c7fb9328-a456-48a5-a9bb-b4ec20cc83df admin admin] The token cache is being invalidate because project 79e702a89c8945caa87d4e4c116f8d0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:56:07.811573 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-c7fb9328-a456-48a5-a9bb-b4ec20cc83df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:07.812225 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-c7fb9328-a456-48a5-a9bb-b4ec20cc83df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:07.813836 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1443/2870] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:56:07 2022] DELETE /identity/v3/projects/79e702a89c8945caa87d4e4c116f8d0b => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:56:07.819728 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0533e-fcb7-4d4d-85ff-c034be0d2df7 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:07.821086 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0533e-fcb7-4d4d-85ff-c034be0d2df7 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:07.821086 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0533e-fcb7-4d4d-85ff-c034be0d2df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:07.841385 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-1cc0533e-fcb7-4d4d-85ff-c034be0d2df7 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:56:07.842594 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-1cc0533e-fcb7-4d4d-85ff-c034be0d2df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:56:07.915773 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1428/2871] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:56:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:56:07.925481 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f5255-66a6-4c20-86ff-652ae08cc0ec None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:07.926019 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f5255-66a6-4c20-86ff-652ae08cc0ec None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:07.926304 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f5255-66a6-4c20-86ff-652ae08cc0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:07.951530 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-7e2f5255-66a6-4c20-86ff-652ae08cc0ec None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:56:07.952881 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-7e2f5255-66a6-4c20-86ff-652ae08cc0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:56:07.961304 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1444/2872] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:56:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:56:07.965964 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0533e-fcb7-4d4d-85ff-c034be0d2df7 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:56:07.976457 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0533e-fcb7-4d4d-85ff-c034be0d2df7 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:56:07.982204 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f3886-eeb2-493f-9f5b-0328268a5017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:56:07.982919 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f3886-eeb2-493f-9f5b-0328268a5017 admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:07.983293 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f3886-eeb2-493f-9f5b-0328268a5017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:07.983634 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f3886-eeb2-493f-9f5b-0328268a5017 admin admin] PATH_INFO: `/v3/domains` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:07.984437 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f3886-eeb2-493f-9f5b-0328268a5017 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80822) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:56:07.984848 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f3886-eeb2-493f-9f5b-0328268a5017 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:56:07.986498 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f3886-eeb2-493f-9f5b-0328268a5017 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:56:07.999999 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1429/2873] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:56:08.004772 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f5255-66a6-4c20-86ff-652ae08cc0ec None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:56:08.014554 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f5255-66a6-4c20-86ff-652ae08cc0ec None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:56:08.019184 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a8661-b4aa-45b0-96ac-8cb6b11c99cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:56:08.019793 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a8661-b4aa-45b0-96ac-8cb6b11c99cd admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:08.020071 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a8661-b4aa-45b0-96ac-8cb6b11c99cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:08.020343 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a8661-b4aa-45b0-96ac-8cb6b11c99cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:08.020996 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a8661-b4aa-45b0-96ac-8cb6b11c99cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:56:08.023019 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a8661-b4aa-45b0-96ac-8cb6b11c99cd admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:56:08.425430 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1445/2874] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:56:08 2022] POST /identity/v3/projects => generated 385 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:56:08.430142 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f3886-eeb2-493f-9f5b-0328268a5017 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:56:08.436325 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:56:08.440052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f3886-eeb2-493f-9f5b-0328268a5017 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:56:08.495808 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8d287-cfee-4e84-b24c-c86fdbb02eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:56:08.496437 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8d287-cfee-4e84-b24c-c86fdbb02eed admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:08.496773 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8d287-cfee-4e84-b24c-c86fdbb02eed admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:08.497090 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8d287-cfee-4e84-b24c-c86fdbb02eed admin admin] PATH_INFO: `/v3/users` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:08.497761 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a8d287-cfee-4e84-b24c-c86fdbb02eed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:56:08.499715 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a8d287-cfee-4e84-b24c-c86fdbb02eed admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:56:08.621041 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1430/2875] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:56:08 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:56:08.622525 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a8661-b4aa-45b0-96ac-8cb6b11c99cd admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:56:08.652932 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a8661-b4aa-45b0-96ac-8cb6b11c99cd admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:56:08.659202 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e337a5-2d7b-472b-a9e0-f7d2d478ae00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:56:08.665225 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e337a5-2d7b-472b-a9e0-f7d2d478ae00 admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:08.665225 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e337a5-2d7b-472b-a9e0-f7d2d478ae00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:08.665225 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e337a5-2d7b-472b-a9e0-f7d2d478ae00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:08.665225 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e337a5-2d7b-472b-a9e0-f7d2d478ae00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:56:08.665225 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e337a5-2d7b-472b-a9e0-f7d2d478ae00 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:56:08.680465 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1446/2876] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:56:08.681740 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8d287-cfee-4e84-b24c-c86fdbb02eed admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:56:08.693031 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8d287-cfee-4e84-b24c-c86fdbb02eed admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:56:08.704717 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad8763-79a7-414b-89f2-4f2b9c3e150e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:56:08.705609 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad8763-79a7-414b-89f2-4f2b9c3e150e admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:08.706736 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad8763-79a7-414b-89f2-4f2b9c3e150e admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:08.707233 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad8763-79a7-414b-89f2-4f2b9c3e150e admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:08.708468 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ad8763-79a7-414b-89f2-4f2b9c3e150e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:56:08.710459 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ad8763-79a7-414b-89f2-4f2b9c3e150e admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:56:08.737183 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1431/2877] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:56:08.739555 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e337a5-2d7b-472b-a9e0-f7d2d478ae00 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:56:08.759158 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e337a5-2d7b-472b-a9e0-f7d2d478ae00 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:56:08.775942 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da83c8-7b62-48db-84b4-91f9f09129ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:56:08.777113 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da83c8-7b62-48db-84b4-91f9f09129ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:08.777630 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da83c8-7b62-48db-84b4-91f9f09129ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:08.778766 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da83c8-7b62-48db-84b4-91f9f09129ac admin admin] PATH_INFO: `/v3/projects/5d676f6c3ab94739ae3842ff196d9af2/users/95ec27b048ec4de48cca6818add90ce2/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:08.803273 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40da83c8-7b62-48db-84b4-91f9f09129ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d676f6c3ab94739ae3842ff196d9af2, user_id=95ec27b048ec4de48cca6818add90ce2, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:56:08.808276 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40da83c8-7b62-48db-84b4-91f9f09129ac admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:56:08.902659 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1447/2878] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:56:08 2022] PUT /identity/v3/projects/5d676f6c3ab94739ae3842ff196d9af2/users/95ec27b048ec4de48cca6818add90ce2/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:56:08.916572 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f36f7-7712-499d-9f8a-8c0c63e8f16a None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:08.917210 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f36f7-7712-499d-9f8a-8c0c63e8f16a None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:08.917210 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f36f7-7712-499d-9f8a-8c0c63e8f16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:08.948473 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-629f36f7-7712-499d-9f8a-8c0c63e8f16a None None] MFA Rules not processed for user `95ec27b048ec4de48cca6818add90ce2`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:56:08.949780 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-629f36f7-7712-499d-9f8a-8c0c63e8f16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:56:09.029875 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1432/2879] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:56:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:56:09.044761 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da83c8-7b62-48db-84b4-91f9f09129ac admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:56:09.046456 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-40da83c8-7b62-48db-84b4-91f9f09129ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:56:09.109440 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da83c8-7b62-48db-84b4-91f9f09129ac admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:56:09.113575 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d77b4-64ed-4f32-a183-0cb153c5ef06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:56:09.114260 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d77b4-64ed-4f32-a183-0cb153c5ef06 service cinder] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:09.114600 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d77b4-64ed-4f32-a183-0cb153c5ef06 service cinder] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:09.114912 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d77b4-64ed-4f32-a183-0cb153c5ef06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:09.126133 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604d77b4-64ed-4f32-a183-0cb153c5ef06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:56:09.127631 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604d77b4-64ed-4f32-a183-0cb153c5ef06 service cinder] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:56:09.137749 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1448/2880] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:56:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:56:09.160224 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f36f7-7712-499d-9f8a-8c0c63e8f16a None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:56:09.221069 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f36f7-7712-499d-9f8a-8c0c63e8f16a None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:56:09.225683 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fedd1b-dc1f-4fdf-9527-59ea609e27e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:56:09.226325 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fedd1b-dc1f-4fdf-9527-59ea609e27e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:09.226634 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fedd1b-dc1f-4fdf-9527-59ea609e27e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:09.226911 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fedd1b-dc1f-4fdf-9527-59ea609e27e9 admin admin] PATH_INFO: `/v3/users/95ec27b048ec4de48cca6818add90ce2` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:09.228161 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fedd1b-dc1f-4fdf-9527-59ea609e27e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95ec27b048ec4de48cca6818add90ce2)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:56:09.230090 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fedd1b-dc1f-4fdf-9527-59ea609e27e9 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:56:09.361956 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:56:09.443376 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-80fedd1b-dc1f-4fdf-9527-59ea609e27e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95ec27b048ec4de48cca6818add90ce2'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:09.521262 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-80fedd1b-dc1f-4fdf-9527-59ea609e27e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95ec27b048ec4de48cca6818add90ce2'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:09.529048 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-80fedd1b-dc1f-4fdf-9527-59ea609e27e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95ec27b048ec4de48cca6818add90ce2'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:09.541120 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-80fedd1b-dc1f-4fdf-9527-59ea609e27e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95ec27b048ec4de48cca6818add90ce2'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:09.541754 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-80fedd1b-dc1f-4fdf-9527-59ea609e27e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95ec27b048ec4de48cca6818add90ce2'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:09.547538 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1433/2881] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:56:09 2022] DELETE /identity/v3/users/95ec27b048ec4de48cca6818add90ce2 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:56:09.552199 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2c7bb-1240-487e-980f-8e1ecbe5e8dc None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:09.553214 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2c7bb-1240-487e-980f-8e1ecbe5e8dc None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:09.553502 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2c7bb-1240-487e-980f-8e1ecbe5e8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:09.574118 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-64f2c7bb-1240-487e-980f-8e1ecbe5e8dc None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:56:09.575618 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-64f2c7bb-1240-487e-980f-8e1ecbe5e8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:56:09.617968 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:56:09.646415 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1449/2882] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:56:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:56:09.656518 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fedd1b-dc1f-4fdf-9527-59ea609e27e9 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:56:09.660547 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-80fedd1b-dc1f-4fdf-9527-59ea609e27e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:56:09.718712 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fedd1b-dc1f-4fdf-9527-59ea609e27e9 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:56:09.722592 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d12be7-3901-4cb2-9da9-12b3d0b338ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:56:09.723469 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d12be7-3901-4cb2-9da9-12b3d0b338ac service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:09.723751 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d12be7-3901-4cb2-9da9-12b3d0b338ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:09.724029 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d12be7-3901-4cb2-9da9-12b3d0b338ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:09.734464 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d12be7-3901-4cb2-9da9-12b3d0b338ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:56:09.736111 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d12be7-3901-4cb2-9da9-12b3d0b338ac service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:56:09.747001 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1434/2883] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:56:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:56:10.053490 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2c7bb-1240-487e-980f-8e1ecbe5e8dc None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:56:10.054976 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-64f2c7bb-1240-487e-980f-8e1ecbe5e8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:56:10.067264 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2c7bb-1240-487e-980f-8e1ecbe5e8dc None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:56:10.073082 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254bb82-5477-4d28-a69b-3e69c7e7a84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:56:10.073877 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254bb82-5477-4d28-a69b-3e69c7e7a84b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:10.074229 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254bb82-5477-4d28-a69b-3e69c7e7a84b admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:10.074570 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254bb82-5477-4d28-a69b-3e69c7e7a84b admin admin] PATH_INFO: `/v3/users/80712b66186540769ec404bea18a9871` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:10.075864 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c254bb82-5477-4d28-a69b-3e69c7e7a84b admin admin] RBAC: Authorizing `identity:delete_user(user_id=80712b66186540769ec404bea18a9871)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:56:10.077905 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c254bb82-5477-4d28-a69b-3e69c7e7a84b admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:56:10.232552 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d12be7-3901-4cb2-9da9-12b3d0b338ac service neutron] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:56:10.234288 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-71d12be7-3901-4cb2-9da9-12b3d0b338ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:56:10.264593 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d12be7-3901-4cb2-9da9-12b3d0b338ac service neutron] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:56:10.269446 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b17825-9d05-40af-a767-2fbb1aeeccdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:56:10.270092 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b17825-9d05-40af-a767-2fbb1aeeccdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:10.270368 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b17825-9d05-40af-a767-2fbb1aeeccdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:10.270650 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b17825-9d05-40af-a767-2fbb1aeeccdd admin admin] PATH_INFO: `/v3/projects/5d676f6c3ab94739ae3842ff196d9af2` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:10.271956 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b17825-9d05-40af-a767-2fbb1aeeccdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d676f6c3ab94739ae3842ff196d9af2)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:56:10.273949 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b17825-9d05-40af-a767-2fbb1aeeccdd admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:56:10.316337 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-c254bb82-5477-4d28-a69b-3e69c7e7a84b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80712b66186540769ec404bea18a9871'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:10.362037 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-90b17825-9d05-40af-a767-2fbb1aeeccdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d676f6c3ab94739ae3842ff196d9af2', 'request_id': 'req-90b17825-9d05-40af-a767-2fbb1aeeccdd'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:10.372983 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-c254bb82-5477-4d28-a69b-3e69c7e7a84b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80712b66186540769ec404bea18a9871'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:10.383439 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-c254bb82-5477-4d28-a69b-3e69c7e7a84b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80712b66186540769ec404bea18a9871'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:10.383439 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-c254bb82-5477-4d28-a69b-3e69c7e7a84b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80712b66186540769ec404bea18a9871'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:10.393871 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-c254bb82-5477-4d28-a69b-3e69c7e7a84b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80712b66186540769ec404bea18a9871'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:10.399709 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1450/2884] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:56:10 2022] DELETE /identity/v3/users/80712b66186540769ec404bea18a9871 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:56:10.404006 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd41fb-8923-481c-9600-ef21f99e0028 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:10.404295 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd41fb-8923-481c-9600-ef21f99e0028 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:10.404580 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd41fb-8923-481c-9600-ef21f99e0028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:10.422974 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-5ccd41fb-8923-481c-9600-ef21f99e0028 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:56:10.424193 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-5ccd41fb-8923-481c-9600-ef21f99e0028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:56:10.471177 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-90b17825-9d05-40af-a767-2fbb1aeeccdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d676f6c3ab94739ae3842ff196d9af2', 'request_id': 'req-90b17825-9d05-40af-a767-2fbb1aeeccdd'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:10.477694 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-90b17825-9d05-40af-a767-2fbb1aeeccdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d676f6c3ab94739ae3842ff196d9af2', 'request_id': 'req-90b17825-9d05-40af-a767-2fbb1aeeccdd'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:10.482027 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1451/2885] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:56:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:56:10.489189 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-90b17825-9d05-40af-a767-2fbb1aeeccdd admin admin] The token cache is being invalidate because project 5d676f6c3ab94739ae3842ff196d9af2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:56:10.489484 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-90b17825-9d05-40af-a767-2fbb1aeeccdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:10.490132 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-90b17825-9d05-40af-a767-2fbb1aeeccdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:10.491989 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1435/2886] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:56:10 2022] DELETE /identity/v3/projects/5d676f6c3ab94739ae3842ff196d9af2 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:56:10.508506 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd41fb-8923-481c-9600-ef21f99e0028 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:56:10.508506 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-5ccd41fb-8923-481c-9600-ef21f99e0028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:56:10.558468 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd41fb-8923-481c-9600-ef21f99e0028 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:56:10.562263 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09a030-bc5f-4ebc-a607-fe263e238ed8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:56:10.562907 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09a030-bc5f-4ebc-a607-fe263e238ed8 service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:10.563294 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09a030-bc5f-4ebc-a607-fe263e238ed8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:10.563574 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09a030-bc5f-4ebc-a607-fe263e238ed8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:10.565493 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-9d09a030-bc5f-4ebc-a607-fe263e238ed8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:56:10.574809 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:56:10.579071 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d09a030-bc5f-4ebc-a607-fe263e238ed8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:56:10.580686 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d09a030-bc5f-4ebc-a607-fe263e238ed8 service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:56:10.591393 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1452/2887] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:56:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:56:10.956664 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b17825-9d05-40af-a767-2fbb1aeeccdd admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:56:10.958617 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-90b17825-9d05-40af-a767-2fbb1aeeccdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:56:10.979672 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:56:11.024130 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b17825-9d05-40af-a767-2fbb1aeeccdd admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:56:11.028718 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed001d-7b25-4a33-ace8-33b2525841d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:56:11.029356 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed001d-7b25-4a33-ace8-33b2525841d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:11.029638 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed001d-7b25-4a33-ace8-33b2525841d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:11.029914 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed001d-7b25-4a33-ace8-33b2525841d3 admin admin] PATH_INFO: `/v3/projects/0739996b1c8742288fe42c21e92f1630` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:11.031125 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aed001d-7b25-4a33-ace8-33b2525841d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0739996b1c8742288fe42c21e92f1630)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:56:11.033039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aed001d-7b25-4a33-ace8-33b2525841d3 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:56:11.137007 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-3aed001d-7b25-4a33-ace8-33b2525841d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0739996b1c8742288fe42c21e92f1630', 'request_id': 'req-3aed001d-7b25-4a33-ace8-33b2525841d3'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:11.218682 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-3aed001d-7b25-4a33-ace8-33b2525841d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0739996b1c8742288fe42c21e92f1630', 'request_id': 'req-3aed001d-7b25-4a33-ace8-33b2525841d3'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:11.224870 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-3aed001d-7b25-4a33-ace8-33b2525841d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0739996b1c8742288fe42c21e92f1630', 'request_id': 'req-3aed001d-7b25-4a33-ace8-33b2525841d3'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:11.236974 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-3aed001d-7b25-4a33-ace8-33b2525841d3 admin admin] The token cache is being invalidate because project 0739996b1c8742288fe42c21e92f1630 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:56:11.237576 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-3aed001d-7b25-4a33-ace8-33b2525841d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:11.238105 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-3aed001d-7b25-4a33-ace8-33b2525841d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:11.239869 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1436/2888] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:56:10 2022] DELETE /identity/v3/projects/0739996b1c8742288fe42c21e92f1630 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:56:11.244852 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8651d9-7dcb-4448-b8db-dd87ab1406c7 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:11.245320 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8651d9-7dcb-4448-b8db-dd87ab1406c7 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:11.245430 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8651d9-7dcb-4448-b8db-dd87ab1406c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:11.265593 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-fb8651d9-7dcb-4448-b8db-dd87ab1406c7 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:56:11.266795 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-fb8651d9-7dcb-4448-b8db-dd87ab1406c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:56:11.334234 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1453/2889] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:56:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:56:11.342368 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85609b47-46c4-46fa-863d-6934858c3648 None None] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:11.342697 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85609b47-46c4-46fa-863d-6934858c3648 None None] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:11.343001 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85609b47-46c4-46fa-863d-6934858c3648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:11.362192 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.auth.core [None req-85609b47-46c4-46fa-863d-6934858c3648 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80822) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:56:11.363418 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-85609b47-46c4-46fa-863d-6934858c3648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:56:11.371538 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1437/2890] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:56:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:56:11.375548 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8651d9-7dcb-4448-b8db-dd87ab1406c7 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:56:11.385834 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8651d9-7dcb-4448-b8db-dd87ab1406c7 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:56:11.390424 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61f82f-e4e0-4e46-bd03-b39a788bfd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:56:11.391059 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61f82f-e4e0-4e46-bd03-b39a788bfd8c admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:11.391343 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61f82f-e4e0-4e46-bd03-b39a788bfd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:11.391619 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61f82f-e4e0-4e46-bd03-b39a788bfd8c admin admin] PATH_INFO: `/v3/domains` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:11.392305 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d61f82f-e4e0-4e46-bd03-b39a788bfd8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80823) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:56:11.392609 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d61f82f-e4e0-4e46-bd03-b39a788bfd8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:56:11.394221 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d61f82f-e4e0-4e46-bd03-b39a788bfd8c admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:56:11.406143 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1454/2891] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 5 02:56:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:56:11.410276 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85609b47-46c4-46fa-863d-6934858c3648 None None] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:56:11.419448 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85609b47-46c4-46fa-863d-6934858c3648 None None] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:56:11.424060 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4266f616-b296-4cd0-a1d6-d0a7b4743581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:56:11.424690 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266f616-b296-4cd0-a1d6-d0a7b4743581 admin admin] REQUEST_METHOD: `POST` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:11.424975 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266f616-b296-4cd0-a1d6-d0a7b4743581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:11.425254 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266f616-b296-4cd0-a1d6-d0a7b4743581 admin admin] PATH_INFO: `/v3/projects` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:11.425919 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4266f616-b296-4cd0-a1d6-d0a7b4743581 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:56:11.427852 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4266f616-b296-4cd0-a1d6-d0a7b4743581 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:56:11.608522 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1438/2892] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 5 02:56:11 2022] POST /identity/v3/projects => generated 391 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:56:11.612836 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61f82f-e4e0-4e46-bd03-b39a788bfd8c admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:56:11.623506 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61f82f-e4e0-4e46-bd03-b39a788bfd8c admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:56:11.677882 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a04bc2-0ca2-4fbe-86c6-7cca930d9ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:56:11.678495 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a04bc2-0ca2-4fbe-86c6-7cca930d9ef4 admin admin] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:11.678776 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a04bc2-0ca2-4fbe-86c6-7cca930d9ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:11.679086 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a04bc2-0ca2-4fbe-86c6-7cca930d9ef4 admin admin] PATH_INFO: `/v3/users` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:11.680270 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a04bc2-0ca2-4fbe-86c6-7cca930d9ef4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:56:11.682201 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a04bc2-0ca2-4fbe-86c6-7cca930d9ef4 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:56:11.778542 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1455/2893] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 5 02:56:11 2022] POST /identity/v3/users => generated 296 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:56:11.783240 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4266f616-b296-4cd0-a1d6-d0a7b4743581 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:56:11.793765 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4266f616-b296-4cd0-a1d6-d0a7b4743581 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:56:11.798393 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1794b-27b4-4064-8652-4babb7b6da0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:56:11.799044 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1794b-27b4-4064-8652-4babb7b6da0a admin admin] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:11.799331 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1794b-27b4-4064-8652-4babb7b6da0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:11.799609 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1794b-27b4-4064-8652-4babb7b6da0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:11.800303 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1794b-27b4-4064-8652-4babb7b6da0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:56:11.801901 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1794b-27b4-4064-8652-4babb7b6da0a admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:56:11.812345 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1439/2894] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:56:11.816215 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a04bc2-0ca2-4fbe-86c6-7cca930d9ef4 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:56:11.827235 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a04bc2-0ca2-4fbe-86c6-7cca930d9ef4 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:56:11.831846 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b78405-b083-439a-8486-ec431453ddff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:56:11.832506 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b78405-b083-439a-8486-ec431453ddff admin admin] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:11.832791 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b78405-b083-439a-8486-ec431453ddff admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:11.833070 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b78405-b083-439a-8486-ec431453ddff admin admin] PATH_INFO: `/v3/roles` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:11.833765 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b78405-b083-439a-8486-ec431453ddff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:56:11.835411 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b78405-b083-439a-8486-ec431453ddff admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:56:11.846798 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1456/2895] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 5 02:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:56:11.850843 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1794b-27b4-4064-8652-4babb7b6da0a admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:56:11.860719 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1794b-27b4-4064-8652-4babb7b6da0a admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:56:11.865254 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a9617-687d-46a9-aa35-b40c702140df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:56:11.867771 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a9617-687d-46a9-aa35-b40c702140df admin admin] REQUEST_METHOD: `PUT` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:11.867771 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a9617-687d-46a9-aa35-b40c702140df admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:11.867771 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a9617-687d-46a9-aa35-b40c702140df admin admin] PATH_INFO: `/v3/projects/ece17f427d294553acc8900b241729fd/users/77a9c6f393f14d00885dc315fddc25a3/roles/dd9e162a1a25432d871c4c2c0ab779a5` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:11.881291 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a9617-687d-46a9-aa35-b40c702140df admin admin] RBAC: Authorizing `identity:create_grant(project_id=ece17f427d294553acc8900b241729fd, user_id=77a9c6f393f14d00885dc315fddc25a3, role_id=dd9e162a1a25432d871c4c2c0ab779a5)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:56:11.884593 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a9617-687d-46a9-aa35-b40c702140df admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:56:11.972611 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1440/2896] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 5 02:56:11 2022] PUT /identity/v3/projects/ece17f427d294553acc8900b241729fd/users/77a9c6f393f14d00885dc315fddc25a3/roles/dd9e162a1a25432d871c4c2c0ab779a5 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:56:11.983290 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2088940-23e7-44f1-b7ba-81b708c991fb None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:11.983581 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2088940-23e7-44f1-b7ba-81b708c991fb None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:11.983856 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2088940-23e7-44f1-b7ba-81b708c991fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:12.011926 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-f2088940-23e7-44f1-b7ba-81b708c991fb None None] MFA Rules not processed for user `77a9c6f393f14d00885dc315fddc25a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:56:12.016101 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-f2088940-23e7-44f1-b7ba-81b708c991fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:56:12.058271 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:56:12.075022 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1457/2897] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:56:11 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:56:12.085493 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a9617-687d-46a9-aa35-b40c702140df admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:56:12.087244 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-e05a9617-687d-46a9-aa35-b40c702140df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:56:12.135176 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:56:12.145772 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a9617-687d-46a9-aa35-b40c702140df admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:56:12.153264 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6698b3-c133-4868-9de9-18126ff3ae0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e60a3568771842e294858e5868068f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:56:12.153264 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6698b3-c133-4868-9de9-18126ff3ae0e service cinder] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:12.153264 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6698b3-c133-4868-9de9-18126ff3ae0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:12.153264 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6698b3-c133-4868-9de9-18126ff3ae0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:12.159359 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6698b3-c133-4868-9de9-18126ff3ae0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:56:12.160881 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6698b3-c133-4868-9de9-18126ff3ae0e service cinder] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:56:12.170478 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1441/2898] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:56:12 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:56:16.259648 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2088940-23e7-44f1-b7ba-81b708c991fb None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:56:16.262513 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-f2088940-23e7-44f1-b7ba-81b708c991fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:56:16.344222 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2088940-23e7-44f1-b7ba-81b708c991fb None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:56:16.347826 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f354e03-d08e-44cf-9c18-bd6d10dc43ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:56:16.348436 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f354e03-d08e-44cf-9c18-bd6d10dc43ec service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:16.348718 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f354e03-d08e-44cf-9c18-bd6d10dc43ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:16.349062 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f354e03-d08e-44cf-9c18-bd6d10dc43ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:16.350773 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-7f354e03-d08e-44cf-9c18-bd6d10dc43ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:56:16.413241 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f354e03-d08e-44cf-9c18-bd6d10dc43ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:56:16.414608 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f354e03-d08e-44cf-9c18-bd6d10dc43ec service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:56:16.424124 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1458/2899] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:56:16 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:56:22.224141 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=6 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:56:23.659649 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6698b3-c133-4868-9de9-18126ff3ae0e service cinder] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:56:23.733432 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6698b3-c133-4868-9de9-18126ff3ae0e service cinder] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:56:23.737940 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77cf1c3-43b0-4787-9d78-0c65953caa89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:56:23.738573 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cf1c3-43b0-4787-9d78-0c65953caa89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:23.738854 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cf1c3-43b0-4787-9d78-0c65953caa89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:23.739154 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cf1c3-43b0-4787-9d78-0c65953caa89 admin admin] PATH_INFO: `/v3/users/77a9c6f393f14d00885dc315fddc25a3` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:23.740344 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77cf1c3-43b0-4787-9d78-0c65953caa89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77a9c6f393f14d00885dc315fddc25a3)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:56:23.742297 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77cf1c3-43b0-4787-9d78-0c65953caa89 admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:56:23.953542 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-b77cf1c3-43b0-4787-9d78-0c65953caa89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77a9c6f393f14d00885dc315fddc25a3'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:24.013390 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-b77cf1c3-43b0-4787-9d78-0c65953caa89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77a9c6f393f14d00885dc315fddc25a3'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:24.021066 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-b77cf1c3-43b0-4787-9d78-0c65953caa89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77a9c6f393f14d00885dc315fddc25a3'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:24.033600 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-b77cf1c3-43b0-4787-9d78-0c65953caa89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77a9c6f393f14d00885dc315fddc25a3'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:24.034258 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-b77cf1c3-43b0-4787-9d78-0c65953caa89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77a9c6f393f14d00885dc315fddc25a3'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:24.040074 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1442/2900] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:56:23 2022] DELETE /identity/v3/users/77a9c6f393f14d00885dc315fddc25a3 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:56:24.044935 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a30ba-b250-4474-b57b-ac975f439402 None None] REQUEST_METHOD: `POST` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:24.045449 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a30ba-b250-4474-b57b-ac975f439402 None None] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:24.046616 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a30ba-b250-4474-b57b-ac975f439402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:24.064249 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.auth.core [None req-0d6a30ba-b250-4474-b57b-ac975f439402 None None] MFA Rules not processed for user `9858bbeee69c4062a3e73bac3fef2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80823) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:56:24.065441 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-0d6a30ba-b250-4474-b57b-ac975f439402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:56:24.123603 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1459/2901] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 5 02:56:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:56:24.133357 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77cf1c3-43b0-4787-9d78-0c65953caa89 admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:56:24.134789 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-b77cf1c3-43b0-4787-9d78-0c65953caa89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:56:24.191033 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77cf1c3-43b0-4787-9d78-0c65953caa89 admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:56:24.194591 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21852fc1-f7df-415e-bb73-3b00f5603bfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:56:24.195229 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21852fc1-f7df-415e-bb73-3b00f5603bfa service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:24.195514 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21852fc1-f7df-415e-bb73-3b00f5603bfa service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:24.195790 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21852fc1-f7df-415e-bb73-3b00f5603bfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:24.205169 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21852fc1-f7df-415e-bb73-3b00f5603bfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:56:24.206575 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21852fc1-f7df-415e-bb73-3b00f5603bfa service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:56:24.216498 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1443/2902] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:56:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:56:24.603388 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a30ba-b250-4474-b57b-ac975f439402 None None] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:56:24.607425 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-0d6a30ba-b250-4474-b57b-ac975f439402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:56:24.621267 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a30ba-b250-4474-b57b-ac975f439402 None None] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:56:24.625960 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5325b1-638b-4c74-8654-740f6990573b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:56:24.626610 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5325b1-638b-4c74-8654-740f6990573b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:56:24.626887 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5325b1-638b-4c74-8654-740f6990573b admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:56:24.627191 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5325b1-638b-4c74-8654-740f6990573b admin admin] PATH_INFO: `/v3/projects/ece17f427d294553acc8900b241729fd` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:56:24.628355 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5325b1-638b-4c74-8654-740f6990573b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ece17f427d294553acc8900b241729fd)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:56:24.630643 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5325b1-638b-4c74-8654-740f6990573b admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:56:24.648660 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=100 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:56:24.772971 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-eb5325b1-638b-4c74-8654-740f6990573b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ece17f427d294553acc8900b241729fd', 'request_id': 'req-eb5325b1-638b-4c74-8654-740f6990573b'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:24.836349 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-eb5325b1-638b-4c74-8654-740f6990573b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ece17f427d294553acc8900b241729fd', 'request_id': 'req-eb5325b1-638b-4c74-8654-740f6990573b'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:24.842149 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-eb5325b1-638b-4c74-8654-740f6990573b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ece17f427d294553acc8900b241729fd', 'request_id': 'req-eb5325b1-638b-4c74-8654-740f6990573b'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:24.853286 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-eb5325b1-638b-4c74-8654-740f6990573b admin admin] The token cache is being invalidate because project ece17f427d294553acc8900b241729fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80823) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:56:24.853569 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-eb5325b1-638b-4c74-8654-740f6990573b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:24.854731 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-eb5325b1-638b-4c74-8654-740f6990573b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:56:24.856244 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1460/2903] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:56:24 2022] DELETE /identity/v3/projects/ece17f427d294553acc8900b241729fd => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:56:34.211725 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:56:34.850296 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=18,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:58:13.075833 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21852fc1-f7df-415e-bb73-3b00f5603bfa service neutron] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:58:13.085570 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21852fc1-f7df-415e-bb73-3b00f5603bfa service neutron] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:58:13.136634 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcfc2b2-778f-4d21-9cd2-d8d890be1662 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:58:13.138102 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfc2b2-778f-4d21-9cd2-d8d890be1662 service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:58:13.138384 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfc2b2-778f-4d21-9cd2-d8d890be1662 service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:58:13.138656 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfc2b2-778f-4d21-9cd2-d8d890be1662 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:58:13.140965 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-8dcfc2b2-778f-4d21-9cd2-d8d890be1662 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:58:13.228223 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcfc2b2-778f-4d21-9cd2-d8d890be1662 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:58:13.229690 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcfc2b2-778f-4d21-9cd2-d8d890be1662 service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:58:13.249793 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1444/2904] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:58:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:58:14.427403 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5325b1-638b-4c74-8654-740f6990573b admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:58:14.428864 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-eb5325b1-638b-4c74-8654-740f6990573b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:58:14.441374 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5325b1-638b-4c74-8654-740f6990573b admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:58:14.444865 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16eb01-8577-4c7c-a4c5-47461d8ecde6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:58:14.445458 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16eb01-8577-4c7c-a4c5-47461d8ecde6 service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:58:14.445735 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16eb01-8577-4c7c-a4c5-47461d8ecde6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:58:14.446005 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16eb01-8577-4c7c-a4c5-47461d8ecde6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:58:14.447673 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-7c16eb01-8577-4c7c-a4c5-47461d8ecde6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:58:14.461066 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16eb01-8577-4c7c-a4c5-47461d8ecde6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:58:14.462479 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16eb01-8577-4c7c-a4c5-47461d8ecde6 service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:58:14.473286 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1461/2905] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:58:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:58:23.247021 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=66 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:58:23.297449 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcfc2b2-778f-4d21-9cd2-d8d890be1662 service neutron] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:58:23.306493 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcfc2b2-778f-4d21-9cd2-d8d890be1662 service neutron] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:58:23.310113 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13d431-81a5-44fa-9c09-7a2ca929d5fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:58:23.310945 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13d431-81a5-44fa-9c09-7a2ca929d5fa service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:58:23.311091 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13d431-81a5-44fa-9c09-7a2ca929d5fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:58:23.311295 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13d431-81a5-44fa-9c09-7a2ca929d5fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:58:23.313089 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-cf13d431-81a5-44fa-9c09-7a2ca929d5fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:58:23.323935 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13d431-81a5-44fa-9c09-7a2ca929d5fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:58:23.325378 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13d431-81a5-44fa-9c09-7a2ca929d5fa service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:58:23.333332 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1445/2906] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:58:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:58:24.468478 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=6 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:58:26.733374 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16eb01-8577-4c7c-a4c5-47461d8ecde6 service neutron] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:58:26.742268 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16eb01-8577-4c7c-a4c5-47461d8ecde6 service neutron] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:58:26.746134 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07115b49-2963-4bbf-87cf-3cff16cc7ce3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:58:26.746771 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07115b49-2963-4bbf-87cf-3cff16cc7ce3 service neutron] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:58:26.747310 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07115b49-2963-4bbf-87cf-3cff16cc7ce3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:58:26.747419 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07115b49-2963-4bbf-87cf-3cff16cc7ce3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:58:26.749177 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-07115b49-2963-4bbf-87cf-3cff16cc7ce3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:58:26.760393 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07115b49-2963-4bbf-87cf-3cff16cc7ce3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:58:26.761855 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07115b49-2963-4bbf-87cf-3cff16cc7ce3 service neutron] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:58:26.773883 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1462/2907] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:58:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:58:26.888669 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13d431-81a5-44fa-9c09-7a2ca929d5fa service neutron] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:58:26.897468 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13d431-81a5-44fa-9c09-7a2ca929d5fa service neutron] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:58:26.901052 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997fca06-c26e-4c00-97e8-2ea056192428 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0035fcd8b06400bb7946f7ac37393a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:58:26.901657 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997fca06-c26e-4c00-97e8-2ea056192428 service neutron] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:58:26.901942 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997fca06-c26e-4c00-97e8-2ea056192428 service neutron] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:58:26.902219 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997fca06-c26e-4c00-97e8-2ea056192428 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:58:26.904138 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-997fca06-c26e-4c00-97e8-2ea056192428 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:58:26.917589 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997fca06-c26e-4c00-97e8-2ea056192428 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:58:26.919070 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997fca06-c26e-4c00-97e8-2ea056192428 service neutron] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:58:26.930229 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1446/2908] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:58:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:58:36.767616 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=6 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:58:36.925062 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=12 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:59:46.939929 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07115b49-2963-4bbf-87cf-3cff16cc7ce3 service neutron] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:59:46.940954 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-07115b49-2963-4bbf-87cf-3cff16cc7ce3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:59:46.958727 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07115b49-2963-4bbf-87cf-3cff16cc7ce3 service neutron] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:59:46.964313 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778684d9-9560-4714-8f4b-47e2c5944dc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55374d3bccd541c9a8f82da9b21c2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:59:46.964928 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778684d9-9560-4714-8f4b-47e2c5944dc8 service nova] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:59:46.965207 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778684d9-9560-4714-8f4b-47e2c5944dc8 service nova] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:59:46.965502 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778684d9-9560-4714-8f4b-47e2c5944dc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:59:46.967395 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-778684d9-9560-4714-8f4b-47e2c5944dc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:59:46.985661 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778684d9-9560-4714-8f4b-47e2c5944dc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:59:46.988493 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778684d9-9560-4714-8f4b-47e2c5944dc8 service nova] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:59:47.002346 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1463/2909] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:59:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:59:56.996219 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=6 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:59:58.285721 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997fca06-c26e-4c00-97e8-2ea056192428 service neutron] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:59:58.287165 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-997fca06-c26e-4c00-97e8-2ea056192428 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:59:58.355177 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997fca06-c26e-4c00-97e8-2ea056192428 service neutron] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:59:58.360360 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da85372-3e99-40a0-a6c8-f246b9f1e0b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647f2cb18a41d6a9e124e886faa994', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:59:58.360986 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da85372-3e99-40a0-a6c8-f246b9f1e0b0 service placement] REQUEST_METHOD: `GET` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:59:58.361268 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da85372-3e99-40a0-a6c8-f246b9f1e0b0 service placement] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:59:58.361547 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da85372-3e99-40a0-a6c8-f246b9f1e0b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:59:58.363334 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-7da85372-3e99-40a0-a6c8-f246b9f1e0b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:59:58.374116 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778684d9-9560-4714-8f4b-47e2c5944dc8 service nova] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:59:58.376316 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-778684d9-9560-4714-8f4b-47e2c5944dc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:59:58.380747 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da85372-3e99-40a0-a6c8-f246b9f1e0b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:59:58.388039 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da85372-3e99-40a0-a6c8-f246b9f1e0b0 service placement] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:59:58.398516 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1447/2910] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 02:59:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:59:58.452189 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778684d9-9560-4714-8f4b-47e2c5944dc8 service nova] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:59:58.457084 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e0cf6-973b-4f56-a956-70a2174162ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:59:58.457789 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e0cf6-973b-4f56-a956-70a2174162ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:59:58.458071 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e0cf6-973b-4f56-a956-70a2174162ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:59:58.458346 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e0cf6-973b-4f56-a956-70a2174162ed admin admin] PATH_INFO: `/v3/users/844bb53e0b3d4355aa3dd8c9101ee178` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:59:58.459542 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3e0cf6-973b-4f56-a956-70a2174162ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=844bb53e0b3d4355aa3dd8c9101ee178)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:59:58.461748 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3e0cf6-973b-4f56-a956-70a2174162ed admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:59:58.632316 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-ba3e0cf6-973b-4f56-a956-70a2174162ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '844bb53e0b3d4355aa3dd8c9101ee178'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:59:58.709749 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-ba3e0cf6-973b-4f56-a956-70a2174162ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '844bb53e0b3d4355aa3dd8c9101ee178'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:59:58.717002 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-ba3e0cf6-973b-4f56-a956-70a2174162ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '844bb53e0b3d4355aa3dd8c9101ee178'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:59:58.726225 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-ba3e0cf6-973b-4f56-a956-70a2174162ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '844bb53e0b3d4355aa3dd8c9101ee178'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:59:58.729412 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-ba3e0cf6-973b-4f56-a956-70a2174162ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '844bb53e0b3d4355aa3dd8c9101ee178'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:59:58.735965 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1464/2911] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:59:58 2022] DELETE /identity/v3/users/844bb53e0b3d4355aa3dd8c9101ee178 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:59:59.020249 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da85372-3e99-40a0-a6c8-f246b9f1e0b0 service placement] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:59:59.033856 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da85372-3e99-40a0-a6c8-f246b9f1e0b0 service placement] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:59:59.097568 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ab210-0aae-498d-a297-1fe90325214b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:59:59.098202 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ab210-0aae-498d-a297-1fe90325214b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:59:59.098500 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ab210-0aae-498d-a297-1fe90325214b admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:59:59.098775 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ab210-0aae-498d-a297-1fe90325214b admin admin] PATH_INFO: `/v3/projects/341d618de60b49eca42327deeb008976` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:59:59.099949 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502ab210-0aae-498d-a297-1fe90325214b admin admin] RBAC: Authorizing `identity:delete_project(project_id=341d618de60b49eca42327deeb008976)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:59:59.101872 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502ab210-0aae-498d-a297-1fe90325214b admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:59:59.202348 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-502ab210-0aae-498d-a297-1fe90325214b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '341d618de60b49eca42327deeb008976', 'request_id': 'req-502ab210-0aae-498d-a297-1fe90325214b'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:59:59.269999 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-502ab210-0aae-498d-a297-1fe90325214b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '341d618de60b49eca42327deeb008976', 'request_id': 'req-502ab210-0aae-498d-a297-1fe90325214b'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:59:59.276172 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-502ab210-0aae-498d-a297-1fe90325214b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '341d618de60b49eca42327deeb008976', 'request_id': 'req-502ab210-0aae-498d-a297-1fe90325214b'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:59:59.287279 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-502ab210-0aae-498d-a297-1fe90325214b admin admin] The token cache is being invalidate because project 341d618de60b49eca42327deeb008976 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:59:59.287837 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-502ab210-0aae-498d-a297-1fe90325214b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:59:59.288181 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-502ab210-0aae-498d-a297-1fe90325214b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:59:59.289712 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1448/2912] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:59:59 2022] DELETE /identity/v3/projects/341d618de60b49eca42327deeb008976 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:59:59.300996 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e0cf6-973b-4f56-a956-70a2174162ed admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:59:59.302419 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-ba3e0cf6-973b-4f56-a956-70a2174162ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:59:59.316164 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e0cf6-973b-4f56-a956-70a2174162ed admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:59:59.375717 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef811e69-9961-46cd-8cd4-9e8bf5ce3b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:59:59.376390 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef811e69-9961-46cd-8cd4-9e8bf5ce3b22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:59:59.376620 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef811e69-9961-46cd-8cd4-9e8bf5ce3b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:59:59.376894 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef811e69-9961-46cd-8cd4-9e8bf5ce3b22 admin admin] PATH_INFO: `/v3/users/115ef97f708d42228b15f92fca32d9cc` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:59:59.378067 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef811e69-9961-46cd-8cd4-9e8bf5ce3b22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=115ef97f708d42228b15f92fca32d9cc)` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:59:59.380271 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef811e69-9961-46cd-8cd4-9e8bf5ce3b22 admin admin] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:59:59.401312 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:59:59.607203 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-ef811e69-9961-46cd-8cd4-9e8bf5ce3b22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '115ef97f708d42228b15f92fca32d9cc'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:59:59.698972 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-ef811e69-9961-46cd-8cd4-9e8bf5ce3b22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '115ef97f708d42228b15f92fca32d9cc'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:59:59.707041 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-ef811e69-9961-46cd-8cd4-9e8bf5ce3b22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '115ef97f708d42228b15f92fca32d9cc'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:59:59.708916 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-ef811e69-9961-46cd-8cd4-9e8bf5ce3b22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '115ef97f708d42228b15f92fca32d9cc'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:59:59.719989 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.notifications [None req-ef811e69-9961-46cd-8cd4-9e8bf5ce3b22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '115ef97f708d42228b15f92fca32d9cc'} {{(pid=80823) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:59:59.729640 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1465/2913] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 5 02:59:59 2022] DELETE /identity/v3/users/115ef97f708d42228b15f92fca32d9cc => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:59:59.991133 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ab210-0aae-498d-a297-1fe90325214b admin admin] Authenticating user token {{(pid=80822) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:59:59.992589 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.fernet_utils [None req-502ab210-0aae-498d-a297-1fe90325214b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80822) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 03:00:00.006730 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ab210-0aae-498d-a297-1fe90325214b admin admin] Validating token access rules against request {{(pid=80822) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 03:00:00.024947 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 03:00:00.069144 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235837e8-09ff-460e-876e-6bb2a192ca8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858bbeee69c4062a3e73bac3fef2908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7de4c8b74b3245d8bf8c7d1c57f4237e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80822) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 03:00:00.069782 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235837e8-09ff-460e-876e-6bb2a192ca8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 03:00:00.070059 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235837e8-09ff-460e-876e-6bb2a192ca8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 03:00:00.070329 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235837e8-09ff-460e-876e-6bb2a192ca8d admin admin] PATH_INFO: `/v3/projects/78ebd9980fb94348b5f961943372606d` {{(pid=80822) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 03:00:00.071516 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235837e8-09ff-460e-876e-6bb2a192ca8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=78ebd9980fb94348b5f961943372606d)` {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 03:00:00.073450 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235837e8-09ff-460e-876e-6bb2a192ca8d admin admin] RBAC: Authorization granted {{(pid=80822) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 03:00:00.184726 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-235837e8-09ff-460e-876e-6bb2a192ca8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78ebd9980fb94348b5f961943372606d', 'request_id': 'req-235837e8-09ff-460e-876e-6bb2a192ca8d'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 03:00:00.247282 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-235837e8-09ff-460e-876e-6bb2a192ca8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78ebd9980fb94348b5f961943372606d', 'request_id': 'req-235837e8-09ff-460e-876e-6bb2a192ca8d'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 03:00:00.253973 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-235837e8-09ff-460e-876e-6bb2a192ca8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78ebd9980fb94348b5f961943372606d', 'request_id': 'req-235837e8-09ff-460e-876e-6bb2a192ca8d'} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 03:00:00.265366 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-235837e8-09ff-460e-876e-6bb2a192ca8d admin admin] The token cache is being invalidate because project 78ebd9980fb94348b5f961943372606d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80822) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 03:00:00.265657 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-235837e8-09ff-460e-876e-6bb2a192ca8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 03:00:00.266298 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG keystone.notifications [None req-235837e8-09ff-460e-876e-6bb2a192ca8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80822) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 03:00:00.267847 dv-cinder-815582-13-smb devstack@keystone.service[80822]: [pid: 80822|app: 0|req: 1449/2914] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 5 02:59:59 2022] DELETE /identity/v3/projects/78ebd9980fb94348b5f961943372606d => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 03:00:09.796476 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 03:00:10.262393 dv-cinder-815582-13-smb devstack@keystone.service[80822]: DEBUG dbcounter [-] [80822] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 03:01:09.961919 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef811e69-9961-46cd-8cd4-9e8bf5ce3b22 admin admin] Authenticating user token {{(pid=80823) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 03:01:09.963376 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-ef811e69-9961-46cd-8cd4-9e8bf5ce3b22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 03:01:10.033044 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef811e69-9961-46cd-8cd4-9e8bf5ce3b22 admin admin] Validating token access rules against request {{(pid=80823) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 03:01:10.090302 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6dde3-816f-4ad4-a4ff-6bb4f1e2af2e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647f2cb18a41d6a9e124e886faa994', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63b323c02a614fc28aac6e7a060064ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80823) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 03:01:10.090913 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6dde3-816f-4ad4-a4ff-6bb4f1e2af2e service placement] REQUEST_METHOD: `GET` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 03:01:10.091221 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6dde3-816f-4ad4-a4ff-6bb4f1e2af2e service placement] SCRIPT_NAME: `/identity` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 03:01:10.091495 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6dde3-816f-4ad4-a4ff-6bb4f1e2af2e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80823) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 03:01:10.093217 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.fernet_utils [None req-45f6dde3-816f-4ad4-a4ff-6bb4f1e2af2e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80823) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 03:01:10.104416 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6dde3-816f-4ad4-a4ff-6bb4f1e2af2e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 03:01:10.105988 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6dde3-816f-4ad4-a4ff-6bb4f1e2af2e service placement] RBAC: Authorization granted {{(pid=80823) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 03:01:10.115848 dv-cinder-815582-13-smb devstack@keystone.service[80823]: [pid: 80823|app: 0|req: 1466/2915] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 5 03:01:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 03:01:20.111584 dv-cinder-815582-13-smb devstack@keystone.service[80823]: DEBUG dbcounter [-] [80823] Writing DB stats keystone:SELECT=58 {{(pid=80823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}